2024-05-16T21:19:32.869 INFO:root:teuthology version: 0.0.1.dev272+g08ca118 2024-05-16T21:19:32.869 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology --description fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} --archive /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812 -- /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/orig.config.yaml 2024-05-16T21:19:32.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-16T21:19:33.001 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812 branch: wip-pdonnell-testing-20240515.023933-debug description: fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} email: pdonnell@redhat.com first_in_suite: false job_id: '7709812' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240515.023933-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 43296076bed1da2423ef68e9230eab60284d4c31 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 43296076bed1da2423ef68e9230eab60284d4c31 extra_system_packages: deb: - fscrypt rpm: - fscrypt kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: i64602 sha1: 69a8de64df0b2e98d8ada0e9865445fd4329357b owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 6645 sha1: 43296076bed1da2423ef68e9230eab60284d4c31 sleep_before_teardown: 0 suite: fs:fscrypt suite_branch: i64602 suite_path: /home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 69a8de64df0b2e98d8ada0e9865445fd4329357b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAzAgzbPaeNVMRIcb7wBi8SfBlFbsrTCtgwCxEuX4eQnW+DRCqLaVkpyE5L44DDfqejjm+XuI1Y/SVjN0eNSX4= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATVzC2gC1NYDFMZ1vJ/JrCiYdhhhaPfkFyv2BdJXbVt/IPBN4D0zmeSWCJnvyyVDs6CK6MyGcyUxbblceVikng= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJg5hwUyMtNK7XwqIYM+IC1H4vOmVX/BzJ0gFjqPlOk43bhByzy/7W9fsLpmCZRVkVgv3DX3sfDphpOBc7sVgeM= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - full_sequential_finally: - sleep: duration: 3600 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: install-override-extra_system_packages teuthology_sha1: 08ca1187b5d019c0ae6c90488c6c9faaace42185 timestamp: 2024-05-16_21:11:55 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-16T21:19:33.001 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa; will attempt to use it 2024-05-16T21:19:33.002 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa/tasks 2024-05-16T21:19:33.002 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-16T21:19:33.003 INFO:teuthology.task.internal:Checking packages... 2024-05-16T21:19:33.024 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '43296076bed1da2423ef68e9230eab60284d4c31' 2024-05-16T21:19:33.024 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-16T21:19:33.024 INFO:teuthology.packaging:ref: None 2024-05-16T21:19:33.024 INFO:teuthology.packaging:tag: None 2024-05-16T21:19:33.024 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240515.023933-debug 2024-05-16T21:19:33.024 INFO:teuthology.packaging:sha1: 43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T21:19:33.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240515.023933-debug 2024-05-16T21:19:33.240 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3709.g43296076 2024-05-16T21:19:33.242 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-16T21:19:33.252 INFO:teuthology.task.internal:no buildpackages task found 2024-05-16T21:19:33.252 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-16T21:19:33.274 INFO:teuthology.task.internal:Saving configuration 2024-05-16T21:19:33.293 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-16T21:19:33.303 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-16T21:19:33.329 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 21:13:44.549082', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAzAgzbPaeNVMRIcb7wBi8SfBlFbsrTCtgwCxEuX4eQnW+DRCqLaVkpyE5L44DDfqejjm+XuI1Y/SVjN0eNSX4='} 2024-05-16T21:19:33.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 21:13:44.547856', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATVzC2gC1NYDFMZ1vJ/JrCiYdhhhaPfkFyv2BdJXbVt/IPBN4D0zmeSWCJnvyyVDs6CK6MyGcyUxbblceVikng='} 2024-05-16T21:19:33.374 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 21:13:44.546032', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJg5hwUyMtNK7XwqIYM+IC1H4vOmVX/BzJ0gFjqPlOk43bhByzy/7W9fsLpmCZRVkVgv3DX3sfDphpOBc7sVgeM='} 2024-05-16T21:19:33.374 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-16T21:19:33.386 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-16T21:19:33.386 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-16T21:19:33.386 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['client.0'] 2024-05-16T21:19:33.386 INFO:teuthology.run_tasks:Running task console_log... 2024-05-16T21:19:33.478 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe93a90bac0>, signals=[15]) 2024-05-16T21:19:33.478 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-16T21:19:33.486 INFO:teuthology.task.internal:Opening connections... 2024-05-16T21:19:33.487 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T21:19:33.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:19:33.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T21:19:33.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:19:33.643 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-05-16T21:19:33.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:19:33.720 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-16T21:19:33.726 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-05-16T21:19:33.745 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-05-16T21:19:33.746 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-05-16T21:19:33.804 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-05-16T21:19:33.804 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-05-16T21:19:33.804 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-05-16T21:19:33.804 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-16T21:19:33.805 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-16T21:19:33.806 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-05-16T21:19:33.831 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-05-16T21:19:33.849 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-05-16T21:19:33.849 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-05-16T21:19:33.906 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-05-16T21:19:33.906 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-05-16T21:19:33.906 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-05-16T21:19:33.906 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-05-16T21:19:33.906 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-05-16T21:19:33.906 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-05-16T21:19:33.906 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-16T21:19:33.906 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-05-16T21:19:33.907 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-05-16T21:19:33.907 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-16T21:19:33.907 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-05-16T21:19:33.907 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-16T21:19:33.907 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-16T21:19:33.907 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-16T21:19:33.907 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-05-16T21:19:33.931 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-05-16T21:19:33.950 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-05-16T21:19:33.950 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-05-16T21:19:34.007 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-05-16T21:19:34.007 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-05-16T21:19:34.007 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-05-16T21:19:34.007 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-05-16T21:19:34.007 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-16T21:19:34.008 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-16T21:19:34.008 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-05-16T21:19:34.031 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-16T21:19:34.043 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-16T21:19:34.054 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-16T21:19:34.055 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-05-16T21:19:34.058 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-05-16T21:19:34.061 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-05-16T21:19:34.077 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-16T21:19:34.088 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-16T21:19:34.088 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-05-16T21:19:34.115 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-05-16T21:19:34.118 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-05-16T21:19:34.236 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-16T21:19:34.314 INFO:teuthology.run_tasks:Running task kernel... 2024-05-16T21:19:34.332 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-16T21:19:34.332 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-16T21:19:34.333 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-16T21:19:34.333 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-16T21:19:34.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T21:19:34.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-16T21:19:34.585 DEBUG:teuthology.task.kernel:sha1 for client.0 is 42e114f04cb046558abf08b436bd2a0497043042 2024-05-16T21:19:34.585 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "42e114f04cb046558abf08b436bd2a0497043042"... 2024-05-16T21:19:34.586 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-05-16T21:19:34.603 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-437.el9.x86_64 2024-05-16T21:19:34.603 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 42e114f04cb046558abf08b436bd2a0497043042 2024-05-16T21:19:34.603 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-16T21:19:34.603 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum upgrade -y linux-firmware 2024-05-16T21:19:36.854 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-16T21:19:38.496 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 34 MB/s | 19 MB 00:00 2024-05-16T21:19:42.447 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-05-16T21:19:43.981 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 16 kB 00:00 2024-05-16T21:19:46.018 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-16T21:19:51.149 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-16T21:19:53.264 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-05-16T21:19:53.265 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-05-16T21:19:53.265 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-05-16T21:19:53.382 INFO:teuthology.task.kernel:Downloading kernel 42e114f04cb046558abf08b436bd2a0497043042 on client.0... 2024-05-16T21:19:53.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=42e114f04cb046558abf08b436bd2a0497043042 2024-05-16T21:19:53.666 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/ 2024-05-16T21:19:53.667 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g42e114f04cb0-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-16T21:19:53.669 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi181.front.sepia.ceph.com to complete... 2024-05-16T21:20:09.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16 21:20:09 URL:https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g42e114f04cb0-1.x86_64.rpm [357254834/357254834] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-16T21:20:09.386 INFO:teuthology.orchestra.run.smithi181.stderr:FINISHED --2024-05-16 21:20:09-- 2024-05-16T21:20:09.386 INFO:teuthology.orchestra.run.smithi181.stderr:Total wall clock time: 16s 2024-05-16T21:20:09.387 INFO:teuthology.orchestra.run.smithi181.stderr:Downloaded: 1 files, 341M in 15s (22.2 MB/s) 2024-05-16T21:20:09.390 INFO:teuthology.task.kernel:Installing kernel 42e114f04cb046558abf08b436bd2a0497043042 on client.0... 2024-05-16T21:20:09.390 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-16T21:20:11.464 INFO:teuthology.orchestra.run.smithi181.stdout:Verifying... ######################################## 2024-05-16T21:20:11.851 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing... ######################################## 2024-05-16T21:20:11.977 INFO:teuthology.orchestra.run.smithi181.stdout:Updating / installing... 2024-05-16T21:20:19.919 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-6.9.0_rc3_g42e114f04cb0-1 ######################################## 2024-05-16T21:20:59.360 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-16T21:20:59.361 DEBUG:teuthology.orchestra.run.smithi181:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-16T21:20:59.492 INFO:teuthology.orchestra.run.smithi181.stdout:/boot/System.map-6.9.0-rc3-g42e114f04cb0 2024-05-16T21:20:59.492 INFO:teuthology.orchestra.run.smithi181.stdout:/boot/config-6.9.0-rc3-g42e114f04cb0 2024-05-16T21:20:59.492 INFO:teuthology.orchestra.run.smithi181.stdout:/boot/vmlinuz-6.9.0-rc3-g42e114f04cb0 2024-05-16T21:20:59.492 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/System.map 2024-05-16T21:20:59.492 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/config 2024-05-16T21:20:59.492 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-16T21:20:59.493 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-16T21:20:59.494 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu/mce 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm.ko 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/ansi_cprng.ko 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/anubis.ko 2024-05-16T21:20:59.495 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/arc4.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_memcpy.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_pq.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_tx.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_xor.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/raid6test.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/authenc.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/authencesn.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blake2b_generic.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blowfish_common.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blowfish_generic.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/camellia_generic.ko 2024-05-16T21:20:59.496 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast5_generic.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast6_generic.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast_common.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/ccm.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cmac.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crc32_generic.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crypto_engine.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crypto_user.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cts.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/des_generic.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/dh_generic.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/echainiv.ko 2024-05-16T21:20:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/essiv.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/fcrypt.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/khazad.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/lz4.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/lz4hc.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/md4.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/michael_mic.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/pcbc.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/pcrypt.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/rmd160.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/seed.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/serpent_generic.ko 2024-05-16T21:20:59.498 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/tcrypt.ko 2024-05-16T21:20:59.499 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/tea.ko 2024-05-16T21:20:59.499 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/twofish_common.ko 2024-05-16T21:20:59.499 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/twofish_generic.ko 2024-05-16T21:20:59.499 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/vmac.ko 2024-05-16T21:20:59.499 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/wp512.ko 2024-05-16T21:20:59.499 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xcbc.ko 2024-05-16T21:20:59.499 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xor.ko 2024-05-16T21:20:59.500 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xxhash_generic.ko 2024-05-16T21:20:59.500 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers 2024-05-16T21:20:59.500 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi 2024-05-16T21:20:59.500 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-16T21:20:59.500 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/acpi_pad.ko 2024-05-16T21:20:59.500 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/ec_sys.ko 2024-05-16T21:20:59.501 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/platform_profile.ko 2024-05-16T21:20:59.501 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/sbs.ko 2024-05-16T21:20:59.501 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/sbshc.ko 2024-05-16T21:20:59.501 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/video.ko 2024-05-16T21:20:59.501 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata 2024-05-16T21:20:59.502 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/acard-ahci.ko 2024-05-16T21:20:59.502 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/ahci_platform.ko 2024-05-16T21:20:59.502 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/ata_generic.ko 2024-05-16T21:20:59.502 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/libahci_platform.ko 2024-05-16T21:20:59.502 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_acpi.ko 2024-05-16T21:20:59.502 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ali.ko 2024-05-16T21:20:59.503 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_amd.ko 2024-05-16T21:20:59.503 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_artop.ko 2024-05-16T21:20:59.503 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_atiixp.ko 2024-05-16T21:20:59.503 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_atp867x.ko 2024-05-16T21:20:59.503 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cmd640.ko 2024-05-16T21:20:59.504 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cmd64x.ko 2024-05-16T21:20:59.504 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cypress.ko 2024-05-16T21:20:59.504 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_efar.ko 2024-05-16T21:20:59.504 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt366.ko 2024-05-16T21:20:59.504 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt37x.ko 2024-05-16T21:20:59.504 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-16T21:20:59.505 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-16T21:20:59.505 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_it8213.ko 2024-05-16T21:20:59.505 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_it821x.ko 2024-05-16T21:20:59.505 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_jmicron.ko 2024-05-16T21:20:59.505 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_marvell.ko 2024-05-16T21:20:59.505 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_mpiix.ko 2024-05-16T21:20:59.506 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_netcell.ko 2024-05-16T21:20:59.506 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ninja32.ko 2024-05-16T21:20:59.506 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ns87410.ko 2024-05-16T21:20:59.506 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ns87415.ko 2024-05-16T21:20:59.506 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_oldpiix.ko 2024-05-16T21:20:59.507 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_opti.ko 2024-05-16T21:20:59.507 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_optidma.ko 2024-05-16T21:20:59.507 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pcmcia.ko 2024-05-16T21:20:59.507 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-16T21:20:59.507 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-16T21:20:59.508 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_piccolo.ko 2024-05-16T21:20:59.508 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_rdc.ko 2024-05-16T21:20:59.508 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sch.ko 2024-05-16T21:20:59.508 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_serverworks.ko 2024-05-16T21:20:59.508 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sil680.ko 2024-05-16T21:20:59.508 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sis.ko 2024-05-16T21:20:59.509 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sl82c105.ko 2024-05-16T21:20:59.509 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_triflex.ko 2024-05-16T21:20:59.509 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_via.ko 2024-05-16T21:20:59.509 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pdc_adma.ko 2024-05-16T21:20:59.509 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_inic162x.ko 2024-05-16T21:20:59.510 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_mv.ko 2024-05-16T21:20:59.510 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_nv.ko 2024-05-16T21:20:59.510 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_promise.ko 2024-05-16T21:20:59.510 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_qstor.ko 2024-05-16T21:20:59.510 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sil.ko 2024-05-16T21:20:59.510 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sil24.ko 2024-05-16T21:20:59.511 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sis.ko 2024-05-16T21:20:59.511 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_svw.ko 2024-05-16T21:20:59.511 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sx4.ko 2024-05-16T21:20:59.511 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_uli.ko 2024-05-16T21:20:59.511 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_via.ko 2024-05-16T21:20:59.512 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_vsc.ko 2024-05-16T21:20:59.512 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/auxdisplay 2024-05-16T21:20:59.512 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/auxdisplay/ks0108.ko 2024-05-16T21:20:59.512 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base 2024-05-16T21:20:59.513 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap 2024-05-16T21:20:59.513 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-16T21:20:59.513 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-16T21:20:59.513 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/bcma 2024-05-16T21:20:59.514 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/bcma/bcma.ko 2024-05-16T21:20:59.514 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block 2024-05-16T21:20:59.514 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/aoe 2024-05-16T21:20:59.514 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/aoe/aoe.ko 2024-05-16T21:20:59.514 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/brd.ko 2024-05-16T21:20:59.515 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/drbd 2024-05-16T21:20:59.515 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/drbd/drbd.ko 2024-05-16T21:20:59.515 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/floppy.ko 2024-05-16T21:20:59.515 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/loop.ko 2024-05-16T21:20:59.515 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/mtip32xx 2024-05-16T21:20:59.515 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-16T21:20:59.516 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/nbd.ko 2024-05-16T21:20:59.516 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/null_blk 2024-05-16T21:20:59.516 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/null_blk/null_blk.ko 2024-05-16T21:20:59.516 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/pktcdvd.ko 2024-05-16T21:20:59.516 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/rbd.ko 2024-05-16T21:20:59.516 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/virtio_blk.ko 2024-05-16T21:20:59.517 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkback 2024-05-16T21:20:59.517 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-16T21:20:59.517 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkfront.ko 2024-05-16T21:20:59.517 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/zram 2024-05-16T21:20:59.517 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/zram/zram.ko 2024-05-16T21:20:59.517 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char 2024-05-16T21:20:59.518 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hangcheck-timer.ko 2024-05-16T21:20:59.518 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random 2024-05-16T21:20:59.518 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-16T21:20:59.518 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-16T21:20:59.518 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-16T21:20:59.519 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/via-rng.ko 2024-05-16T21:20:59.519 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-16T21:20:59.519 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi 2024-05-16T21:20:59.519 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-16T21:20:59.519 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-16T21:20:59.520 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-16T21:20:59.520 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-16T21:20:59.520 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-16T21:20:59.520 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-16T21:20:59.520 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/lp.ko 2024-05-16T21:20:59.521 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/mwave 2024-05-16T21:20:59.521 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/mwave/mwave.ko 2024-05-16T21:20:59.521 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ppdev.ko 2024-05-16T21:20:59.521 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tlclk.ko 2024-05-16T21:20:59.521 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm 2024-05-16T21:20:59.521 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm.ko 2024-05-16T21:20:59.521 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-16T21:20:59.522 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-16T21:20:59.522 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-16T21:20:59.522 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-16T21:20:59.522 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-16T21:20:59.522 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/uv_mmtimer.ko 2024-05-16T21:20:59.523 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/virtio_console.ko 2024-05-16T21:20:59.523 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq 2024-05-16T21:20:59.523 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-16T21:20:59.523 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-16T21:20:59.523 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-16T21:20:59.523 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-16T21:20:59.524 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-16T21:20:59.524 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-16T21:20:59.524 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto 2024-05-16T21:20:59.524 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp 2024-05-16T21:20:59.524 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-16T21:20:59.524 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp/ccp.ko 2024-05-16T21:20:59.524 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel 2024-05-16T21:20:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat 2024-05-16T21:20:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_common 2024-05-16T21:20:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-16T21:20:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-16T21:20:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-16T21:20:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/padlock-aes.ko 2024-05-16T21:20:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/padlock-sha.ko 2024-05-16T21:20:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/virtio 2024-05-16T21:20:59.526 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-16T21:20:59.526 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dca 2024-05-16T21:20:59.526 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dca/dca.ko 2024-05-16T21:20:59.526 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/devfreq 2024-05-16T21:20:59.526 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-16T21:20:59.526 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma 2024-05-16T21:20:59.526 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/dw 2024-05-16T21:20:59.527 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-16T21:20:59.527 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/ioat 2024-05-16T21:20:59.527 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-16T21:20:59.527 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac 2024-05-16T21:20:59.527 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/amd64_edac.ko 2024-05-16T21:20:59.527 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/e752x_edac.ko 2024-05-16T21:20:59.527 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/edac_mce_amd.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i3000_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i3200_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i5100_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i5400_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i7300_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i7core_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i82975x_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/ie31200_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/sb_edac.ko 2024-05-16T21:20:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/x38_edac.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware/edd.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio/gpio-ich.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-appleir.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-aureal.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-axff.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-dr.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-elecom.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-elo.ko 2024-05-16T21:20:59.529 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-emsff.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gaff.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gt683r.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gyration.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtekff.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-hyperv.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-icade.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-keytouch.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-kye.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-lcpower.ko 2024-05-16T21:20:59.530 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-led.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-lenovo.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-multitouch.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-ortek.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-penmount.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-petalynx.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-picolcd.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-pl.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-plantronics.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-primax.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-rmi.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-16T21:20:59.531 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-common.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-saitek.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-samsung.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-16T21:20:59.532 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sjoy.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sony.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-speedlink.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-steelseries.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sunplus.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-tivo.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-tmff.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-topseed.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-twinhan.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-uclogic.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-waltop.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-wiimote.ko 2024-05-16T21:20:59.533 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-xinmo.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-zpff.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-zydacron.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/uhid.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/wacom.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_balloon.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_utils.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_vmbus.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/abituguru.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/abituguru3.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-16T21:20:59.534 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ad7414.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ad7418.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adc128d818.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1025.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1026.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1029.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1031.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm9240.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ads7828.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7410.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7411.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7462.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7470.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7475.ko 2024-05-16T21:20:59.535 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7x10.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/amc6821.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/applesmc.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asb100.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asc7621.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/atxp1.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/coretemp.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/dme1737.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ds1621.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ds620.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/emc1403.ko 2024-05-16T21:20:59.536 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/emc6w201.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f71805f.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f71882fg.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f75375s.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/fam15h_power.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/fschmd.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/g760a.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/g762.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/gl518sm.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/gl520sm.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/i5500_temp.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/i5k_amb.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ibmaem.ko 2024-05-16T21:20:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ibmpex.ko 2024-05-16T21:20:59.538 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ina209.ko 2024-05-16T21:20:59.538 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ina2xx.ko 2024-05-16T21:20:59.538 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/it87.ko 2024-05-16T21:20:59.538 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/k10temp.ko 2024-05-16T21:20:59.538 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/k8temp.ko 2024-05-16T21:20:59.538 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lineage-pem.ko 2024-05-16T21:20:59.538 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm63.ko 2024-05-16T21:20:59.538 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm73.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm75.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm77.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm78.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm80.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm83.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm85.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm87.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm90.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm92.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm93.ko 2024-05-16T21:20:59.539 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95234.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95241.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95245.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc2945.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4151.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4215.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4222.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4245.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4260.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4261.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max16065.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max1619.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max1668.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max197.ko 2024-05-16T21:20:59.540 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6639.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6650.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6697.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/mcp3021.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6683.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6775-core.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6775.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct7802.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pc87360.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pc87427.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pcf8591.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-16T21:20:59.541 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/powr1220.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch5627.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch5636.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-16T21:20:59.542 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sht15.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sht21.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/shtc1.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sis5595.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47b397.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47m1.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47m192.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/thmc50.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp102.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp103.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp401.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp421.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/via-cputemp.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/via686a.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/vt1211.ko 2024-05-16T21:20:59.543 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/vt8231.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83627ehf.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83627hf.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83781d.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83791d.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83792d.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83793.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83795.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83l785ts.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83l786ng.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-16T21:20:59.544 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-16T21:20:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-dev.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-mux.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-smbus.ko 2024-05-16T21:20:59.546 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-stub.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_core.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/cxgb4 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx4 2024-05-16T21:20:59.547 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx5 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mthca 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/ipoib 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/iser 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/isert 2024-05-16T21:20:59.548 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srp 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srpt 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-16T21:20:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/gameport.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/joydev.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/keyboard 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/appletouch.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/bcm5974.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/cyapatp.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/sermouse.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-16T21:20:59.550 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/rmi4 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/altera_ps2.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/arc_ps2.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/serio_raw.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/sparse-keymap.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-blinkm.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-lm3530.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-lp3944.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-ss4200.ko 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger 2024-05-16T21:20:59.551 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/bcache 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/bcache/bcache.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-bio-prison.ko 2024-05-16T21:20:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-cache-smq.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-cache.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-crypt.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-delay.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-flakey.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-log-userspace.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-multipath.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-queue-length.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-raid.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-round-robin.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-service-time.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-switch.ko 2024-05-16T21:20:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-thin-pool.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-verity.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/persistent-data 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid0.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid1.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid10.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid456.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptbase.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptctl.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptfc.ko 2024-05-16T21:20:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptlan.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptsas.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptscsih.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptspi.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/lpc_ich.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/lpc_sch.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/mfd-core.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/sm501.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/viperboard.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/vx855.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/wl1273-core.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/altera-stapl 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-16T21:20:59.555 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/apds9802als.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/apds990x.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/bh1770glc.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/cb710 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/cb710/cb710.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/at24.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/max6875.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/enclosure.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/hpilo.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/isl29003.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/isl29020.ko 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d 2024-05-16T21:20:59.556 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei-me.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei-txe.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-gru 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tifm_7xx1.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tifm_core.ko 2024-05-16T21:20:59.557 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tsl2550.ko 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_balloon.ko 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_vmci 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/bonding 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/bonding/bonding.ko 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/b53 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6xxx 2024-05-16T21:20:59.558 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-16T21:20:59.559 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dummy.ko 2024-05-16T21:20:59.559 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/eql.ko 2024-05-16T21:20:59.559 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet 2024-05-16T21:20:59.559 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com 2024-05-16T21:20:59.559 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-16T21:20:59.559 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-16T21:20:59.559 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/adaptec 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/agere 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/alteon 2024-05-16T21:20:59.560 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/altera 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/alx 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-16T21:20:59.561 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/genet 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade 2024-05-16T21:20:59.562 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade/bna 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco 2024-05-16T21:20:59.563 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco/enic 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dnet.ko 2024-05-16T21:20:59.564 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex/benet 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ethoc.ko 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/fealnx.ko 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000e 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/fm10k 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/i40e 2024-05-16T21:20:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/iavf 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igb 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igbvf 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/jme.ko 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-16T21:20:59.566 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/micrel 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi 2024-05-16T21:20:59.567 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/neterion 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/nvidia 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rdc 2024-05-16T21:20:59.568 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rocker 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sfc 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/silan 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-16T21:20:59.569 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis 2024-05-16T21:20:59.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-16T21:20:59.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-16T21:20:59.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc 2024-05-16T21:20:59.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-16T21:20:59.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-16T21:20:59.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-16T21:20:59.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-16T21:20:59.570 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/tehuti 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ti 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via 2024-05-16T21:20:59.571 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/xircom 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/geneve.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/hyperv 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ieee802154 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ifb.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ipvlan 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-16T21:20:59.572 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/macvlan.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/macvtap.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mii.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/net_failover.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/netconsole.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/nlmon.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy 2024-05-16T21:20:59.573 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/amd.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm87xx.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/broadcom.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/cicada.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/davicom.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/dp83640.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/et1011c.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/icplus.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/lxt.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/marvell.ko 2024-05-16T21:20:59.574 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/micrel.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/national.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/phylink.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/qsemi.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/realtek.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/smsc.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/ste10Xp.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/vitesse.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_async.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-16T21:20:59.575 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-16T21:20:59.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-16T21:20:59.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pppoe.ko 2024-05-16T21:20:59.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pppox.ko 2024-05-16T21:20:59.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pptp.ko 2024-05-16T21:20:59.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip 2024-05-16T21:20:59.576 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip/slhc.ko 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip/slip.ko 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/sungem_phy.ko 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/tap.ko 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team.ko 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-16T21:20:59.577 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_random.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/tun.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/veth.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/virtio_net.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vmxnet3 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vxlan 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vxlan/vxlan.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netback 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netfront.ko 2024-05-16T21:20:59.578 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ntb 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ntb/ntb.ko 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host/nvme-core.ko 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host/nvme.ko 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport.ko 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_cs.ko 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_pc.ko 2024-05-16T21:20:59.579 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_serial.ko 2024-05-16T21:20:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci 2024-05-16T21:20:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/hotplug 2024-05-16T21:20:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-16T21:20:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/pcie 2024-05-16T21:20:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-16T21:20:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/xen-pcifront.ko 2024-05-16T21:20:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/i82092.ko 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/pd6729.ko 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl/intel 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/acerhdf.ko 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-16T21:20:59.581 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/hdaps.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel_ips.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-16T21:20:59.582 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/wmi.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-16T21:20:59.583 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps_parport.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/pps_core.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp/ptp.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp/ptp_kvm.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/atl 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/fmpm.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-16T21:20:59.584 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-em3027.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-max6900.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-16T21:20:59.585 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-x1205.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-9xxx.ko 2024-05-16T21:20:59.586 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-sas.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-xxxx.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/BusLogic.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/a100u2w.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aacraid 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/advansys.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/am53c974.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/arcmsr 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/atp870u.ko 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/be2iscsi 2024-05-16T21:20:59.587 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bfa 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bfa/bfa.ko 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2fc 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2i 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ch.ko 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/csiostor 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-16T21:20:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/dc395x.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/dmx3191d.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esas2r 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esp_scsi.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-16T21:20:59.589 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fnic 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fnic/fnic.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hpsa.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hptiop.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hv_storvsc.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/initio.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ipr.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ips.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/isci 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/isci/isci.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-16T21:20:59.590 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libfc 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libfc/libfc.ko 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libiscsi.ko 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libsas 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libsas/libsas.ko 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/lpfc 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid 2024-05-16T21:20:59.591 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mpt3sas 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvsas 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvumi.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pm8001 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pmcraid.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla1280.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-16T21:20:59.592 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla4xxx 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/raid_class.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_debug.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ses.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/st.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/stex.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/sym53c8xx_2 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/virtio_scsi.ko 2024-05-16T21:20:59.593 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/wd719x.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ssb 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ssb/ssb.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/iscsi 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/loopback 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_file.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_iblock.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_mod.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_pscsi.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_user.ko 2024-05-16T21:20:59.594 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/tcm_fc 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-16T21:20:59.595 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/ipwireless 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/n_gsm.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/n_hdlc.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/nozomi.ko 2024-05-16T21:20:59.596 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/8250 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/arc_uart.ko 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/jsm 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/core 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/host 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio.ko 2024-05-16T21:20:59.597 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_aec.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_cif.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_pci_generic.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_sercos3.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/cdc-acm.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/usblp.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/usbtmc.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/host 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image 2024-05-16T21:20:59.598 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image/mdc800.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image/microtek.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/adutux.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/appledisplay.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/emi26.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/emi62.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/ezusb.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/idmouse.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/iowarrior.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/ldusb.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/legousbtower.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/sisusbvga 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-16T21:20:59.599 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usb3503.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usblcd.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/uss720.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/yurex.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/phy 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/phy/phy-generic.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/aircable.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ark3116.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ch341.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cp210x.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cyberjack.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-16T21:20:59.600 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/empeg.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/io_ti.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ipaq.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ipw.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ir-usb.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-16T21:20:59.601 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/keyspan.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mct_u232.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mos7720.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mos7840.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/navman.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/omninet.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/opticon.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/option.ko 2024-05-16T21:20:59.602 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/oti6858.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/pl2303.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/qcaux.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/qcserial.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/quatech2.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/safe_serial.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/sierra.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ssu100.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/symbolserial.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb_debug.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-16T21:20:59.603 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/visor.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/whiteheat.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/uas.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-karma.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-16T21:20:59.604 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/usb-storage.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/vfio.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost 2024-05-16T21:20:59.605 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_net.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_scsi.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/apple_bl.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/lcd.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_balloon.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_mmio.ko 2024-05-16T21:20:59.606 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_ring.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters/ds2482.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters/ds2490.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-16T21:20:59.607 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/wire.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/hpwdt.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/i6300esb.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-16T21:20:59.608 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ib700wdt.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ibmasr.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/it87_wdt.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/machzwd.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/nv_tco.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/softdog.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/via_wdt.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-16T21:20:59.609 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/wdt_pci.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/xen_wdt.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-evtchn.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-gntalloc.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-gntdev.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-pciback 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-privcmd.ko 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xenfs 2024-05-16T21:20:59.610 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/9p 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/9p/9p.ko 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/affs 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/affs/affs.ko 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/befs 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/befs/befs.ko 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/binfmt_misc.ko 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/btrfs 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/btrfs/btrfs.ko 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cachefiles 2024-05-16T21:20:59.611 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cachefiles/cachefiles.ko 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ceph 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ceph/ceph.ko 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/coda 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/coda/coda.ko 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cramfs 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cramfs/cramfs.ko 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/dlm 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/dlm/dlm.ko 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ecryptfs 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/f2fs 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/f2fs/f2fs.ko 2024-05-16T21:20:59.612 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/fat.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/msdos.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/vfat.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse/cuse.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse/fuse.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/gfs2 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/gfs2/gfs2.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfs 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfs/hfs.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfsplus 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfsplus/hfsplus.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/isofs 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/isofs/isofs.ko 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/jfs 2024-05-16T21:20:59.613 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/jfs/jfs.ko 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/lockd 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/lockd/lockd.ko 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/minix 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/minix/minix.ko 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/netfs 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/netfs/netfs.ko 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/blocklayout 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/filelayout 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/flexfilelayout 2024-05-16T21:20:59.614 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfs.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfsv3.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfsv4.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common/grace.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common/nfs_acl.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfsd 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfsd/nfsd.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nilfs2 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nilfs2/nilfs2.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-celtic.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-centeuro.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-croatian.ko 2024-05-16T21:20:59.615 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-cyrillic.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-gaelic.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-greek.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-iceland.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-inuit.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-roman.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-romanian.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-turkish.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1250.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1251.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1255.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp737.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp775.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp850.ko 2024-05-16T21:20:59.616 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp852.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp855.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp857.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp860.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp861.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp862.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp863.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp864.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp865.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp866.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp869.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp874.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp932.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp936.ko 2024-05-16T21:20:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp949.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp950.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_euc-jp.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-1.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-13.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-14.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-15.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-2.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-3.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-4.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-5.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-6.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-7.ko 2024-05-16T21:20:59.618 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-9.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-r.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-ru.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-u.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_utf8.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/cluster 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlm 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlmfs 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-16T21:20:59.619 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/overlayfs 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/overlayfs/overlay.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/pstore 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/pstore/ramoops.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/reiserfs 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/reiserfs/reiserfs.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/romfs 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/romfs/romfs.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/client 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/client/cifs.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common/cifs_arc4.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common/cifs_md4.ko 2024-05-16T21:20:59.620 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/squashfs 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/squashfs/squashfs.ko 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/sysv 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/sysv/sysv.ko 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/udf 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/udf/udf.ko 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ufs 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ufs/ufs.ko 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/xfs 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/xfs/xfs.ko 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/rcu 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/rcu/rcutorture.ko 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/torture.ko 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/trace 2024-05-16T21:20:59.621 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/asn1_encoder.ko 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crc-itu-t.ko 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crc8.ko 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto/libarc4.ko 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto/libdes.ko 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/libcrc32c.ko 2024-05-16T21:20:59.622 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lru_cache.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4/lz4_compress.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4/lz4hc_compress.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/math 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/math/cordic.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/raid6 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/raid6/raid6_pq.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/reed_solomon 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_bm.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_fsm.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_kmp.ko 2024-05-16T21:20:59.623 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/zstd 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/zstd/zstd_compress.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/mm 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/mm/hwpoison-inject.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/6lowpan.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_dest.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_fragment.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_hop.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_mobility.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_routing.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_udp.ko 2024-05-16T21:20:59.624 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/garp.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/mrp.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/p8022.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/psnap.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/stp.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/8021q 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/8021q/8021q.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_fd.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_rdma.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_virtio.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/batman-adv 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/batman-adv/batman-adv.ko 2024-05-16T21:20:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/br_netfilter.ko 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/bridge.ko 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-16T21:20:59.626 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-16T21:20:59.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-16T21:20:59.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-16T21:20:59.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-16T21:20:59.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-16T21:20:59.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-16T21:20:59.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-16T21:20:59.627 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-16T21:20:59.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-16T21:20:59.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-16T21:20:59.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-16T21:20:59.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-16T21:20:59.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-16T21:20:59.628 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-16T21:20:59.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-16T21:20:59.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtables.ko 2024-05-16T21:20:59.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-16T21:20:59.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-16T21:20:59.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-16T21:20:59.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ceph 2024-05-16T21:20:59.629 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ceph/libceph.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core/failover.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core/pktgen.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_diag.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_ipv4.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_ipv6.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dns_resolver 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dns_resolver/dns_resolver.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/dsa_core.ko 2024-05-16T21:20:59.630 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_brcm.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_dsa.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_none.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_trailer.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/6lowpan 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/ieee802154.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ah4.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/esp4.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/fou.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/gre.ko 2024-05-16T21:20:59.631 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/inet_diag.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_gre.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_tunnel.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_vti.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ipcomp.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ipip.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-16T21:20:59.632 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-16T21:20:59.633 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_bic.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_dctcp.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_diag.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_highspeed.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_htcp.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_hybla.ko 2024-05-16T21:20:59.634 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_illinois.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_lp.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_scalable.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_vegas.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_veno.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_westwood.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_yeah.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tunnel4.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/udp_diag.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/udp_tunnel.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ah6.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/esp6.ko 2024-05-16T21:20:59.635 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/fou6.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_tunnel.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_vti.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ipcomp6.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-16T21:20:59.636 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-16T21:20:59.637 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/sit.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/tunnel6.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/key 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/key/af_key.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_core.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_eth.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ip.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ip6.ko 2024-05-16T21:20:59.638 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_netlink.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ppp.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/llc 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/llc/llc.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mac802154 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mac802154/mac802154.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mpls 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mpls/mpls_gso.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-16T21:20:59.639 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-16T21:20:59.640 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conncount.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-16T21:20:59.641 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_flow_table.ko 2024-05-16T21:20:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_log_syslog.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_irc.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_sip.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_tables.ko 2024-05-16T21:20:59.643 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_log.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_chain_nat.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_compat.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_ct.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_fib.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_hash.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_limit.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_log.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_masq.ko 2024-05-16T21:20:59.644 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_nat.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_numgen.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_queue.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_quota.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_redir.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_reject.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_reject_inet.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_socket.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_tunnel.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_AUDIT.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CT.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_DSCP.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_HL.ko 2024-05-16T21:20:59.645 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_HMARK.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_LED.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_LOG.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NETMAP.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NFLOG.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_RATEEST.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_SECMARK.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-16T21:20:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TEE.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TPROXY.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TRACE.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_addrtype.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_bpf.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cgroup.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cluster.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_comment.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connbytes.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connlabel.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connlimit.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connmark.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_conntrack.ko 2024-05-16T21:20:59.647 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cpu.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_dccp.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_devgroup.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_dscp.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ecn.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_esp.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_hashlimit.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_helper.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_hl.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ipcomp.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_iprange.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ipvs.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_l2tp.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_length.ko 2024-05-16T21:20:59.648 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_limit.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_mac.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_mark.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_multiport.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_nat.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_nfacct.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_osf.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_owner.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_physdev.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_pkttype.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_policy.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_quota.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_rateest.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_realm.ko 2024-05-16T21:20:59.649 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_recent.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_sctp.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_set.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_socket.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_state.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_statistic.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_string.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_tcpmss.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_time.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_u32.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netlink 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netlink/netlink_diag.ko 2024-05-16T21:20:59.650 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/nsh 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/nsh/nsh.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/openvswitch.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-geneve.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-gre.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-vxlan.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/packet 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/packet/af_packet_diag.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds_rdma.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds_tcp.ko 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched 2024-05-16T21:20:59.651 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_csum.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_gact.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_mirred.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_nat.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_pedit.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_police.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_simple.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_skbedit.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_vlan.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_basic.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_bpf.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_flow.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_fw.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_route.ko 2024-05-16T21:20:59.652 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_u32.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_cmp.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_ipset.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_meta.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_nbyte.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_text.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_u32.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_choke.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_codel.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_drr.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_fq.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_gred.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_hfsc.ko 2024-05-16T21:20:59.653 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_hhf.ko 2024-05-16T21:20:59.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_htb.ko 2024-05-16T21:20:59.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_ingress.ko 2024-05-16T21:20:59.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_mqprio.ko 2024-05-16T21:20:59.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_mqprio_lib.ko 2024-05-16T21:20:59.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_multiq.ko 2024-05-16T21:20:59.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_netem.ko 2024-05-16T21:20:59.654 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_pie.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_plug.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_prio.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_qfq.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_red.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_sfb.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_sfq.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_tbf.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_teql.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp/sctp.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp/sctp_diag.ko 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss 2024-05-16T21:20:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/sunrpc.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/xprtrdma 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc/tipc.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc/tipc_diag.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/unix 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/unix/unix_diag.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock.ko 2024-05-16T21:20:59.656 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/xfrm 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/encrypted-keys 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/trusted-keys 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/trusted-keys/trusted.ko 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.alias 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.alias.bin 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.alias.bin 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.bin 2024-05-16T21:20:59.657 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.modinfo 2024-05-16T21:20:59.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep 2024-05-16T21:20:59.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep.bin 2024-05-16T21:20:59.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.devname 2024-05-16T21:20:59.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.order 2024-05-16T21:20:59.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.softdep 2024-05-16T21:20:59.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.symbols 2024-05-16T21:20:59.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.symbols.bin 2024-05-16T21:20:59.658 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/vmlinuz 2024-05-16T21:20:59.662 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g42e114f04cb0 2024-05-16T21:20:59.663 DEBUG:teuthology.orchestra.run.smithi181:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-16T21:20:59.685 INFO:teuthology.orchestra.run.smithi181.stdout:postinstall scriptlet (using /bin/sh): 2024-05-16T21:20:59.685 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-16T21:20:59.685 INFO:teuthology.orchestra.run.smithi181.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g42e114f04cb0 /lib/modules/6.9.0-rc3-g42e114f04cb0/vmlinuz 2024-05-16T21:20:59.685 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-05-16T21:20:59.685 INFO:teuthology.orchestra.run.smithi181.stdout:for file in vmlinuz System.map config; do 2024-05-16T21:20:59.685 INFO:teuthology.orchestra.run.smithi181.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g42e114f04cb0/${file}" "/boot/${file}-6.9.0-rc3-g42e114f04cb0"; then 2024-05-16T21:20:59.685 INFO:teuthology.orchestra.run.smithi181.stdout: cp "/lib/modules/6.9.0-rc3-g42e114f04cb0/${file}" "/boot/${file}-6.9.0-rc3-g42e114f04cb0" 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout: fi 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout:done 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -d "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" ] && \ 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" "/boot/dtb-6.9.0-rc3-g42e114f04cb0" >/dev/null 2>&1; then 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g42e114f04cb0" 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout: cp -r "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" "/boot/dtb-6.9.0-rc3-g42e114f04cb0" 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep" ]; then 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout: /usr/sbin/depmod 6.9.0-rc3-g42e114f04cb0 2024-05-16T21:20:59.686 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-05-16T21:20:59.687 INFO:teuthology.orchestra.run.smithi181.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-16T21:20:59.687 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-16T21:20:59.687 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-install remove 6.9.0-rc3-g42e114f04cb0 2024-05-16T21:20:59.687 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-05-16T21:20:59.688 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-05-16T21:20:59.759 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-05-16T21:20:59.759 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-05-16T21:20:59.759 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-05-16T21:20:59.759 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 68.el9 2024-05-16T21:20:59.759 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-05-16T21:20:59.759 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-16T21:20:59.759 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8264254 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-05-16T21:20:59.760 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-05-16T21:20:59.761 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:20:59.761 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-16T21:20:59.761 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-16T21:20:59.761 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-16T21:20:59.761 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-05-16T21:20:59.761 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:20:59.761 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-05-16T21:20:59.762 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-16T21:20:59.762 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 6.9.0-rc3-g42e114f04cb0 2024-05-16T21:20:59.762 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-16T21:21:00.323 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-05-16T21:21:01.781 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-16T21:21:01.800 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-05-16T21:21:01.802 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-05-16T21:21:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.srRSmx5ex2 2024-05-16T21:21:01.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.srRSmx5ex2 2024-05-16T21:21:01.887 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.srRSmx5ex2 2024-05-16T21:21:02.029 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.srRSmx5ex2 is 6KB 2024-05-16T21:21:02.049 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.srRSmx5ex2 2024-05-16T21:21:02.063 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-05-16T21:21:02.125 INFO:teuthology.orchestra.run.smithi181.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-16T21:21:02.125 INFO:teuthology.orchestra.run.smithi181.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-16T21:21:02.125 INFO:teuthology.orchestra.run.smithi181.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-16T21:21:02.125 INFO:teuthology.orchestra.run.smithi181.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g42e114f04cb0.conf 2024-05-16T21:21:02.126 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g42e114f04cb0 2024-05-16T21:21:02.277 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-05-16T21:21:32.280 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-16T21:21:32.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-16T21:21:32.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:22:06.751 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-05-16T21:22:15.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-16T21:22:15.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:22:34.142 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-05-16T21:22:46.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-16T21:22:46.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:22:49.214 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-05-16T21:23:04.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-16T21:23:04.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:23:04.589 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-05-16T21:23:05.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-16T21:23:05.352 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g42e114f04cb0"... 2024-05-16T21:23:05.352 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-05-16T21:23:05.389 INFO:teuthology.orchestra.run.smithi181.stdout:6.9.0-rc3-g42e114f04cb0 2024-05-16T21:23:05.389 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g42e114f04cb0 vs 6.9.0-rc3-g42e114f04cb0 2024-05-16T21:23:05.389 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-16T21:23:05.390 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-16T21:23:06.391 DEBUG:teuthology.parallel:result is None 2024-05-16T21:23:06.391 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-16T21:23:06.402 INFO:teuthology.task.internal:Creating test directory... 2024-05-16T21:23:06.403 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-16T21:23:06.409 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-16T21:23:06.412 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-16T21:23:06.491 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-16T21:23:06.499 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-16T21:23:06.508 INFO:teuthology.task.internal:Creating archive directory... 2024-05-16T21:23:06.508 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-16T21:23:06.510 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-16T21:23:06.513 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-16T21:23:06.612 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-16T21:23:06.619 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-16T21:23:06.619 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-16T21:23:06.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T21:23:06.636 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-16T21:23:06.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T21:23:06.653 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-16T21:23:06.678 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-16T21:23:06.695 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-16T21:23:06.716 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T21:23:06.731 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T21:23:06.753 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T21:23:06.774 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T21:23:06.879 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T21:23:06.988 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T21:23:06.994 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-16T21:23:07.001 INFO:teuthology.task.internal:Configuring sudo... 2024-05-16T21:23:07.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-16T21:23:07.004 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-16T21:23:07.006 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-16T21:23:07.131 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-16T21:23:07.141 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-16T21:23:07.141 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-16T21:23:07.144 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-16T21:23:07.147 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-16T21:23:07.223 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T21:23:07.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T21:23:07.316 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T21:23:07.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T21:23:07.443 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:23:07.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-16T21:23:07.509 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T21:23:07.555 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T21:23:07.599 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T21:23:07.685 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T21:23:07.727 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:23:07.727 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-16T21:23:07.793 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T21:23:07.874 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T21:23:07.963 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T21:23:08.039 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T21:23:08.104 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:23:08.105 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-16T21:23:08.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-05-16T21:23:08.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-05-16T21:23:08.170 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-05-16T21:23:08.206 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T21:23:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T21:23:08.312 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T21:23:08.823 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-16T21:23:08.831 INFO:teuthology.task.internal:Starting timer... 2024-05-16T21:23:08.832 INFO:teuthology.run_tasks:Running task pcp... 2024-05-16T21:23:08.844 INFO:teuthology.run_tasks:Running task selinux... 2024-05-16T21:23:08.853 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-16T21:23:08.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-05-16T21:23:08.911 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-05-16T21:23:08.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2024-05-16T21:23:08.984 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2024-05-16T21:23:08.986 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-05-16T21:23:09.090 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-05-16T21:23:09.095 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-16T21:23:09.095 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-05-16T21:23:09.121 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-05-16T21:23:09.121 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2024-05-16T21:23:09.145 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2024-05-16T21:23:09.145 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-05-16T21:23:09.406 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-05-16T21:23:09.406 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-05-16T21:23:09.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T21:23:09.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T21:23:09.432 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T21:23:09.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T21:23:09.459 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T21:23:09.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T21:23:09.538 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-16T21:23:09.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-05-16T21:23:09.564 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2024-05-16T21:23:09.589 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-05-16T21:23:09.696 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-16T21:23:09.705 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-16T21:23:09.708 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-16T21:23:09.828 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-16T21:23:09.839 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-16T21:23:09.839 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi157.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-16T21:29:15.925 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-05-16T21:29:15.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-05-16T21:29:15.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:29:16.005 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-05-16T21:29:16.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-05-16T21:29:16.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-16T21:29:16.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:29:16.119 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-05-16T21:29:16.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-16T21:29:16.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-16T21:29:16.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T21:29:16.270 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-05-16T21:29:16.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-16T21:29:16.423 INFO:teuthology.run_tasks:Running task clock... 2024-05-16T21:29:16.436 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-16T21:29:16.436 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-16T21:29:16.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T21:29:16.439 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-16T21:29:16.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T21:29:16.442 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-16T21:29:16.442 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T21:29:16.470 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-16T21:29:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-16T21:29:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-16T21:29:16.489 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-16T21:29:16.512 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-05-16T21:29:16.513 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2024-05-16T21:29:16.524 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-05-16T21:29:16.524 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2024-05-16T21:29:16.535 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-16T21:29:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-16T21:29:16.539 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-16T21:29:16.552 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-16T21:29:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-16T21:29:16.575 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-16T21:29:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-05-16T21:29:16.612 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-05-16T21:29:16.613 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T21:29:16.613 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-05-16T21:29:16.613 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.613 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.613 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.613 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.615 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T21:29:16.615 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-05-16T21:29:16.615 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.615 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.615 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.615 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.643 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-05-16T21:29:16.672 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-05-16T21:29:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-16T21:29:16.754 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-16T21:29:16.887 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-05-16T21:29:16.896 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T21:29:16.896 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-05-16T21:29:16.896 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.896 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.896 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.896 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T21:29:16.898 INFO:teuthology.run_tasks:Running task install... 2024-05-16T21:29:16.907 DEBUG:teuthology.task.install:project ceph 2024-05-16T21:29:16.907 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'extra_system_packages': {'deb': ['fscrypt'], 'rpm': ['fscrypt']}} 2024-05-16T21:29:16.907 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'} 2024-05-16T21:29:16.907 INFO:teuthology.task.install:Using flavor: default 2024-05-16T21:29:16.912 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-16T21:29:16.912 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-16T21:29:16.913 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-16T21:29:16.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T21:29:16.915 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-16T21:29:16.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T21:29:16.917 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-16T21:29:16.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T21:29:17.064 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-16T21:29:17.064 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-16T21:29:17.067 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-16T21:29:17.067 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-16T21:29:17.070 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-16T21:29:17.070 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-16T21:29:17.181 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-16T21:29:17.181 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:29:17.181 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-16T21:29:17.207 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-16T21:29:17.207 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-16T21:29:17.236 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-16T21:29:17.236 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:29:17.236 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-16T21:29:17.243 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-16T21:29:17.244 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:29:17.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-16T21:29:17.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-16T21:29:17.274 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-16T21:29:17.274 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-16T21:29:17.322 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-16T21:29:17.322 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-16T21:29:17.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-16T21:29:17.346 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-16T21:29:17.409 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2024-05-16T21:29:17.411 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2024-05-16T21:29:17.421 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-16T21:29:17.450 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-16T21:29:17.487 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-05-16T21:29:17.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-05-16T21:29:17.553 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-16T21:29:17.631 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-05-16T21:29:17.634 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-05-16T21:29:17.641 INFO:teuthology.orchestra.run.smithi157.stdout:57 files removed 2024-05-16T21:29:17.667 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-16T21:29:17.732 INFO:teuthology.orchestra.run.smithi005.stdout:57 files removed 2024-05-16T21:29:17.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-16T21:29:17.961 INFO:teuthology.orchestra.run.smithi181.stdout:57 files removed 2024-05-16T21:29:17.999 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-16T21:29:18.348 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 199 kB/s | 84 kB 00:00 2024-05-16T21:29:18.500 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 178 kB/s | 84 kB 00:00 2024-05-16T21:29:18.715 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-05-16T21:29:18.984 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 27 kB/s | 12 kB 00:00 2024-05-16T21:29:19.024 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 6.9 kB/s | 1.9 kB 00:00 2024-05-16T21:29:19.063 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 134 kB/s | 84 kB 00:00 2024-05-16T21:29:19.409 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-16T21:29:19.499 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.1 MB 00:00 2024-05-16T21:29:19.580 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-05-16T21:29:20.034 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-16T21:29:20.122 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-05-16T21:29:20.778 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-16T21:29:21.250 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-05-16T21:29:21.744 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 34 MB/s | 19 MB 00:00 2024-05-16T21:29:22.913 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-05-16T21:29:25.937 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-16T21:29:26.576 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.2 MB 00:01 2024-05-16T21:29:27.339 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-16T21:29:27.421 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-05-16T21:29:27.985 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 16 kB 00:00 2024-05-16T21:29:28.892 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-16T21:29:29.881 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-05-16T21:29:31.047 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-05-16T21:29:34.314 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-16T21:29:36.683 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T21:29:36.683 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T21:29:36.694 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-16T21:29:36.695 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-16T21:29:36.696 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-16T21:29:36.696 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-16T21:29:36.698 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-16T21:29:36.700 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-16T21:29:36.701 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-16T21:29:36.766 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-16T21:29:36.791 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-16T21:29:36.792 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-16T21:29:36.793 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-16T21:29:36.794 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-16T21:29:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-16T21:29:36.796 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-16T21:29:36.797 INFO:teuthology.orchestra.run.smithi005.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-16T21:29:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-16T21:29:36.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-16T21:29:36.800 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-16T21:29:36.801 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-16T21:29:36.802 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout:Install 150 Packages 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 8 Packages 2024-05-16T21:29:36.803 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:29:36.804 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 223 M 2024-05-16T21:29:36.804 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-05-16T21:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-05-16T21:29:37.407 INFO:teuthology.orchestra.run.smithi005.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-05-16T21:29:37.607 INFO:teuthology.orchestra.run.smithi005.stdout:(2/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 4.2 MB/s | 863 kB 00:00 2024-05-16T21:29:37.657 INFO:teuthology.orchestra.run.smithi005.stdout:(3/158): ceph-immutable-object-cache-19.0.0-370 2.9 MB/s | 147 kB 00:00 2024-05-16T21:29:37.891 INFO:teuthology.orchestra.run.smithi005.stdout:(4/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 9.7 MB/s | 2.3 MB 00:00 2024-05-16T21:29:38.099 INFO:teuthology.orchestra.run.smithi005.stdout:(5/158): ceph-base-19.0.0-3709.g43296076.el9.x8 6.2 MB/s | 5.4 MB 00:00 2024-05-16T21:29:38.141 INFO:teuthology.orchestra.run.smithi005.stdout:(6/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 6.0 MB/s | 1.5 MB 00:00 2024-05-16T21:29:38.642 INFO:teuthology.orchestra.run.smithi005.stdout:(7/158): ceph-mon-19.0.0-3709.g43296076.el9.x86 9.0 MB/s | 4.9 MB 00:00 2024-05-16T21:29:39.725 INFO:teuthology.orchestra.run.smithi005.stdout:(8/158): ceph-radosgw-19.0.0-3709.g43296076.el9 9.4 MB/s | 10 MB 00:01 2024-05-16T21:29:39.752 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T21:29:39.754 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T21:29:39.774 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-16T21:29:39.776 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-16T21:29:39.777 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-16T21:29:39.778 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-16T21:29:39.781 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-16T21:29:39.784 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-16T21:29:39.786 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-16T21:29:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-05-16T21:29:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-05-16T21:29:39.877 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-05-16T21:29:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-05-16T21:29:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-05-16T21:29:39.877 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-16T21:29:39.877 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-16T21:29:39.877 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-16T21:29:39.877 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-16T21:29:39.878 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-16T21:29:39.879 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-16T21:29:39.880 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-16T21:29:39.881 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-16T21:29:39.882 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-16T21:29:39.883 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-16T21:29:39.884 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-16T21:29:39.885 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-16T21:29:39.886 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-16T21:29:39.887 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-16T21:29:39.888 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-05-16T21:29:39.889 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-16T21:29:39.890 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:29:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-05-16T21:29:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-05-16T21:29:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:Install 150 Packages 2024-05-16T21:29:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 8 Packages 2024-05-16T21:29:39.890 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:29:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 223 M 2024-05-16T21:29:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-05-16T21:29:39.984 INFO:teuthology.orchestra.run.smithi005.stdout:(9/158): ceph-common-19.0.0-3709.g43296076.el9. 7.1 MB/s | 20 MB 00:02 2024-05-16T21:29:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:(10/158): ceph-selinux-19.0.0-3709.g43296076.el 89 kB/s | 25 kB 00:00 2024-05-16T21:29:40.185 INFO:teuthology.orchestra.run.smithi005.stdout:(11/158): ceph-osd-19.0.0-3709.g43296076.el9.x8 8.7 MB/s | 18 MB 00:02 2024-05-16T21:29:40.210 INFO:teuthology.orchestra.run.smithi005.stdout:(12/158): cephfs-mirror-19.0.0-3709.g43296076.e 1.1 MB/s | 224 kB 00:00 2024-05-16T21:29:40.243 INFO:teuthology.orchestra.run.smithi005.stdout:(13/158): cephfs-shell-19.0.0-3709.g43296076.el 464 kB/s | 27 kB 00:00 2024-05-16T21:29:40.269 INFO:teuthology.orchestra.run.smithi005.stdout:(14/158): libcephfs-devel-19.0.0-3709.g43296076 543 kB/s | 32 kB 00:00 2024-05-16T21:29:40.344 INFO:teuthology.orchestra.run.smithi005.stdout:(15/158): libcephsqlite-19.0.0-3709.g43296076.e 2.1 MB/s | 157 kB 00:00 2024-05-16T21:29:40.369 INFO:teuthology.orchestra.run.smithi005.stdout:(16/158): libcephfs2-19.0.0-3709.g43296076.el9. 5.9 MB/s | 756 kB 00:00 2024-05-16T21:29:40.420 INFO:teuthology.orchestra.run.smithi005.stdout:(17/158): librados-devel-19.0.0-3709.g43296076. 1.6 MB/s | 127 kB 00:00 2024-05-16T21:29:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:(18/158): libradosstriper1-19.0.0-3709.g4329607 6.5 MB/s | 497 kB 00:00 2024-05-16T21:29:40.503 INFO:teuthology.orchestra.run.smithi005.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 774 kB/s | 45 kB 00:00 2024-05-16T21:29:40.579 INFO:teuthology.orchestra.run.smithi005.stdout:(20/158): python3-ceph-common-19.0.0-3709.g4329 1.8 MB/s | 136 kB 00:00 2024-05-16T21:29:40.646 INFO:teuthology.orchestra.run.smithi005.stdout:(21/158): python3-cephfs-19.0.0-3709.g43296076. 2.4 MB/s | 162 kB 00:00 2024-05-16T21:29:40.729 INFO:teuthology.orchestra.run.smithi005.stdout:(22/158): python3-rados-19.0.0-3709.g43296076.e 3.7 MB/s | 320 kB 00:00 2024-05-16T21:29:40.813 INFO:teuthology.orchestra.run.smithi005.stdout:(23/158): python3-rbd-19.0.0-3709.g43296076.el9 3.5 MB/s | 300 kB 00:00 2024-05-16T21:29:40.834 INFO:teuthology.orchestra.run.smithi181.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-05-16T21:29:40.897 INFO:teuthology.orchestra.run.smithi005.stdout:(24/158): librgw2-19.0.0-3709.g43296076.el9.x86 11 MB/s | 5.2 MB 00:00 2024-05-16T21:29:40.922 INFO:teuthology.orchestra.run.smithi005.stdout:(25/158): python3-rgw-19.0.0-3709.g43296076.el9 917 kB/s | 99 kB 00:00 2024-05-16T21:29:40.955 INFO:teuthology.orchestra.run.smithi005.stdout:(26/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 1.4 MB/s | 86 kB 00:00 2024-05-16T21:29:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:(27/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 2.2 MB/s | 169 kB 00:00 2024-05-16T21:29:41.123 INFO:teuthology.orchestra.run.smithi005.stdout:(28/158): ceph-grafana-dashboards-19.0.0-3709.g 374 kB/s | 34 kB 00:00 2024-05-16T21:29:41.223 INFO:teuthology.orchestra.run.smithi005.stdout:(29/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 1.4 MB/s | 143 kB 00:00 2024-05-16T21:29:41.282 INFO:teuthology.orchestra.run.smithi005.stdout:(30/158): rbd-mirror-19.0.0-3709.g43296076.el9. 8.5 MB/s | 3.0 MB 00:00 2024-05-16T21:29:41.674 INFO:teuthology.orchestra.run.smithi005.stdout:(31/158): ceph-mgr-dashboard-19.0.0-3709.g43296 7.9 MB/s | 3.5 MB 00:00 2024-05-16T21:29:41.726 INFO:teuthology.orchestra.run.smithi181.stdout:(2/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 969 kB/s | 863 kB 00:00 2024-05-16T21:29:41.774 INFO:teuthology.orchestra.run.smithi005.stdout:(32/158): ceph-mgr-modules-core-19.0.0-3709.g43 2.7 MB/s | 274 kB 00:00 2024-05-16T21:29:41.857 INFO:teuthology.orchestra.run.smithi005.stdout:(33/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 594 kB/s | 49 kB 00:00 2024-05-16T21:29:41.923 INFO:teuthology.orchestra.run.smithi181.stdout:(3/158): ceph-immutable-object-cache-19.0.0-370 751 kB/s | 147 kB 00:00 2024-05-16T21:29:41.933 INFO:teuthology.orchestra.run.smithi005.stdout:(34/158): ceph-prometheus-alerts-19.0.0-3709.g4 219 kB/s | 16 kB 00:00 2024-05-16T21:29:42.041 INFO:teuthology.orchestra.run.smithi005.stdout:(35/158): ceph-volume-19.0.0-3709.g43296076.el9 2.5 MB/s | 273 kB 00:00 2024-05-16T21:29:42.233 INFO:teuthology.orchestra.run.smithi005.stdout:(36/158): cephadm-19.0.0-3709.g43296076.el9.noa 3.9 MB/s | 763 kB 00:00 2024-05-16T21:29:42.342 INFO:teuthology.orchestra.run.smithi005.stdout:(37/158): ceph-mgr-diskprediction-local-19.0.0- 7.0 MB/s | 7.4 MB 00:01 2024-05-16T21:29:42.376 INFO:teuthology.orchestra.run.smithi005.stdout:(38/158): cephfs-top-19.0.0-3709.g43296076.el9. 128 kB/s | 18 kB 00:00 2024-05-16T21:29:42.502 INFO:teuthology.orchestra.run.smithi181.stdout:(4/158): ceph-base-19.0.0-3709.g43296076.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-05-16T21:29:42.502 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 21 MB 00:14 2024-05-16T21:29:42.535 INFO:teuthology.orchestra.run.smithi005.stdout:(39/158): fuse-2.9.9-15.el9.x86_64.rpm 418 kB/s | 80 kB 00:00 2024-05-16T21:29:42.626 INFO:teuthology.orchestra.run.smithi005.stdout:(40/158): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-16T21:29:42.668 INFO:teuthology.orchestra.run.smithi005.stdout:(41/158): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-05-16T21:29:42.694 INFO:teuthology.orchestra.run.smithi005.stdout:(42/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-05-16T21:29:42.743 INFO:teuthology.orchestra.run.smithi181.stdout:(5/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 6.2 MB/s | 1.5 MB 00:00 2024-05-16T21:29:42.760 INFO:teuthology.orchestra.run.smithi005.stdout:(43/158): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-16T21:29:42.794 INFO:teuthology.orchestra.run.smithi005.stdout:(44/158): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-05-16T21:29:42.819 INFO:teuthology.orchestra.run.smithi005.stdout:(45/158): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-16T21:29:42.853 INFO:teuthology.orchestra.run.smithi005.stdout:(46/158): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-16T21:29:42.878 INFO:teuthology.orchestra.run.smithi005.stdout:(47/158): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-05-16T21:29:42.885 INFO:teuthology.orchestra.run.smithi181.stdout:(6/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 2.4 MB/s | 2.3 MB 00:00 2024-05-16T21:29:43.419 INFO:teuthology.orchestra.run.smithi181.stdout:(7/158): ceph-mon-19.0.0-3709.g43296076.el9.x86 7.2 MB/s | 4.9 MB 00:00 2024-05-16T21:29:43.696 INFO:teuthology.orchestra.run.smithi005.stdout:(48/158): ceph-test-19.0.0-3709.g43296076.el9.x 12 MB/s | 43 MB 00:03 2024-05-16T21:29:43.887 INFO:teuthology.orchestra.run.smithi005.stdout:(49/158): automake-1.16.2-8.el9.noarch.rpm 666 kB/s | 689 kB 00:01 2024-05-16T21:29:43.962 INFO:teuthology.orchestra.run.smithi005.stdout:(50/158): bison-3.7.4-5.el9.x86_64.rpm 870 kB/s | 943 kB 00:01 2024-05-16T21:29:43.988 INFO:teuthology.orchestra.run.smithi005.stdout:(51/158): elfutils-libelf-devel-0.190-2.el9.x86 215 kB/s | 21 kB 00:00 2024-05-16T21:29:44.080 INFO:teuthology.orchestra.run.smithi005.stdout:(52/158): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-16T21:29:44.122 INFO:teuthology.orchestra.run.smithi005.stdout:(53/158): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-05-16T21:29:44.163 INFO:teuthology.orchestra.run.smithi005.stdout:(54/158): boost-program-options-1.75.0-8.el9.x8 229 kB/s | 107 kB 00:00 2024-05-16T21:29:44.214 INFO:teuthology.orchestra.run.smithi005.stdout:(55/158): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-05-16T21:29:44.264 INFO:teuthology.orchestra.run.smithi005.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-05-16T21:29:44.322 INFO:teuthology.orchestra.run.smithi005.stdout:(57/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-16T21:29:44.327 INFO:teuthology.orchestra.run.smithi181.stdout:(8/158): ceph-radosgw-19.0.0-3709.g43296076.el9 11 MB/s | 10 MB 00:00 2024-05-16T21:29:44.365 INFO:teuthology.orchestra.run.smithi005.stdout:(58/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-05-16T21:29:44.436 INFO:teuthology.orchestra.run.smithi181.stdout:(9/158): ceph-selinux-19.0.0-3709.g43296076.el9 234 kB/s | 25 kB 00:00 2024-05-16T21:29:44.590 INFO:teuthology.orchestra.run.smithi005.stdout:(59/158): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2024-05-16T21:29:44.690 INFO:teuthology.orchestra.run.smithi005.stdout:(60/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 254 kB/s | 25 kB 00:00 2024-05-16T21:29:44.732 INFO:teuthology.orchestra.run.smithi005.stdout:(61/158): libtool-2.4.6-45.el9.x86_64.rpm 1.5 MB/s | 582 kB 00:00 2024-05-16T21:29:44.791 INFO:teuthology.orchestra.run.smithi005.stdout:(62/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-05-16T21:29:44.866 INFO:teuthology.orchestra.run.smithi005.stdout:(63/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-05-16T21:29:44.916 INFO:teuthology.orchestra.run.smithi005.stdout:(64/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.6 MB/s | 3.0 MB 00:00 2024-05-16T21:29:44.941 INFO:teuthology.orchestra.run.smithi005.stdout:(65/158): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-05-16T21:29:44.967 INFO:teuthology.orchestra.run.smithi005.stdout:(66/158): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2024-05-16T21:29:45.336 INFO:teuthology.orchestra.run.smithi181.stdout:(10/158): ceph-common-19.0.0-3709.g43296076.el9 4.0 MB/s | 20 MB 00:04 2024-05-16T21:29:45.587 INFO:teuthology.orchestra.run.smithi181.stdout:(11/158): ceph-osd-19.0.0-3709.g43296076.el9.x8 6.6 MB/s | 18 MB 00:02 2024-05-16T21:29:45.639 INFO:teuthology.orchestra.run.smithi181.stdout:(12/158): cephfs-mirror-19.0.0-3709.g43296076.e 744 kB/s | 224 kB 00:00 2024-05-16T21:29:45.670 INFO:teuthology.orchestra.run.smithi181.stdout:(13/158): cephfs-shell-19.0.0-3709.g43296076.el 328 kB/s | 27 kB 00:00 2024-05-16T21:29:45.704 INFO:teuthology.orchestra.run.smithi181.stdout:(14/158): libcephfs-devel-19.0.0-3709.g43296076 497 kB/s | 32 kB 00:00 2024-05-16T21:29:45.771 INFO:teuthology.orchestra.run.smithi181.stdout:(15/158): libcephsqlite-19.0.0-3709.g43296076.e 2.3 MB/s | 157 kB 00:00 2024-05-16T21:29:45.813 INFO:teuthology.orchestra.run.smithi181.stdout:(16/158): libcephfs2-19.0.0-3709.g43296076.el9. 5.2 MB/s | 756 kB 00:00 2024-05-16T21:29:45.855 INFO:teuthology.orchestra.run.smithi181.stdout:(17/158): librados-devel-19.0.0-3709.g43296076. 1.5 MB/s | 127 kB 00:00 2024-05-16T21:29:45.892 INFO:teuthology.orchestra.run.smithi005.stdout:(67/158): openblas-openmp-0.3.21-2.el9.x86_64.r 4.9 MB/s | 4.7 MB 00:00 2024-05-16T21:29:45.896 INFO:teuthology.orchestra.run.smithi181.stdout:(18/158): libradosstriper1-19.0.0-3709.g4329607 5.9 MB/s | 497 kB 00:00 2024-05-16T21:29:45.997 INFO:teuthology.orchestra.run.smithi181.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 456 kB/s | 45 kB 00:00 2024-05-16T21:29:46.097 INFO:teuthology.orchestra.run.smithi181.stdout:(20/158): python3-ceph-common-19.0.0-3709.g4329 1.3 MB/s | 136 kB 00:00 2024-05-16T21:29:46.189 INFO:teuthology.orchestra.run.smithi181.stdout:(21/158): python3-cephfs-19.0.0-3709.g43296076. 1.7 MB/s | 162 kB 00:00 2024-05-16T21:29:46.322 INFO:teuthology.orchestra.run.smithi181.stdout:(22/158): python3-rados-19.0.0-3709.g43296076.e 2.4 MB/s | 320 kB 00:00 2024-05-16T21:29:46.415 INFO:teuthology.orchestra.run.smithi181.stdout:(23/158): python3-rbd-19.0.0-3709.g43296076.el9 3.2 MB/s | 300 kB 00:00 2024-05-16T21:29:46.515 INFO:teuthology.orchestra.run.smithi181.stdout:(24/158): librgw2-19.0.0-3709.g43296076.el9.x86 7.8 MB/s | 5.2 MB 00:00 2024-05-16T21:29:46.549 INFO:teuthology.orchestra.run.smithi181.stdout:(25/158): python3-rgw-19.0.0-3709.g43296076.el9 749 kB/s | 99 kB 00:00 2024-05-16T21:29:46.582 INFO:teuthology.orchestra.run.smithi181.stdout:(26/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-16T21:29:46.674 INFO:teuthology.orchestra.run.smithi181.stdout:(27/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 1.8 MB/s | 169 kB 00:00 2024-05-16T21:29:46.766 INFO:teuthology.orchestra.run.smithi181.stdout:(28/158): ceph-grafana-dashboards-19.0.0-3709.g 374 kB/s | 34 kB 00:00 2024-05-16T21:29:46.891 INFO:teuthology.orchestra.run.smithi181.stdout:(29/158): rbd-mirror-19.0.0-3709.g43296076.el9. 8.9 MB/s | 3.0 MB 00:00 2024-05-16T21:29:46.925 INFO:teuthology.orchestra.run.smithi181.stdout:(30/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 906 kB/s | 143 kB 00:00 2024-05-16T21:29:47.051 INFO:teuthology.orchestra.run.smithi005.stdout:(68/158): postgresql-13.14-1.el9.x86_64.rpm 780 kB/s | 1.6 MB 00:02 2024-05-16T21:29:47.159 INFO:teuthology.orchestra.run.smithi005.stdout:(69/158): postgresql-contrib-13.14-1.el9.x86_64 719 kB/s | 911 kB 00:01 2024-05-16T21:29:47.318 INFO:teuthology.orchestra.run.smithi005.stdout:(70/158): postgresql-private-libs-13.14-1.el9.x 499 kB/s | 133 kB 00:00 2024-05-16T21:29:47.342 INFO:teuthology.orchestra.run.smithi181.stdout:(31/158): ceph-mgr-dashboard-19.0.0-3709.g43296 7.9 MB/s | 3.5 MB 00:00 2024-05-16T21:29:47.442 INFO:teuthology.orchestra.run.smithi181.stdout:(32/158): ceph-mgr-modules-core-19.0.0-3709.g43 2.7 MB/s | 274 kB 00:00 2024-05-16T21:29:47.526 INFO:teuthology.orchestra.run.smithi181.stdout:(33/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 601 kB/s | 49 kB 00:00 2024-05-16T21:29:47.543 INFO:teuthology.orchestra.run.smithi005.stdout:(71/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.7 MB/s | 4.4 MB 00:02 2024-05-16T21:29:47.622 INFO:teuthology.orchestra.run.smithi181.stdout:(34/158): ceph-prometheus-alerts-19.0.0-3709.g4 172 kB/s | 16 kB 00:00 2024-05-16T21:29:47.685 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-16T21:29:47.718 INFO:teuthology.orchestra.run.smithi181.stdout:(35/158): ceph-volume-19.0.0-3709.g43296076.el9 2.8 MB/s | 273 kB 00:00 2024-05-16T21:29:47.735 INFO:teuthology.orchestra.run.smithi005.stdout:(72/158): python3-attrs-20.3.0-7.el9.noarch.rpm 456 kB/s | 87 kB 00:00 2024-05-16T21:29:47.852 INFO:teuthology.orchestra.run.smithi181.stdout:(36/158): cephadm-19.0.0-3709.g43296076.el9.noa 5.6 MB/s | 763 kB 00:00 2024-05-16T21:29:48.319 INFO:teuthology.orchestra.run.smithi181.stdout:(37/158): ceph-test-19.0.0-3709.g43296076.el9.x 11 MB/s | 43 MB 00:03 2024-05-16T21:29:48.344 INFO:teuthology.orchestra.run.smithi181.stdout:(38/158): cephfs-top-19.0.0-3709.g43296076.el9. 37 kB/s | 18 kB 00:00 2024-05-16T21:29:48.470 INFO:teuthology.orchestra.run.smithi181.stdout:(39/158): ceph-mgr-diskprediction-local-19.0.0- 4.8 MB/s | 7.4 MB 00:01 2024-05-16T21:29:48.713 INFO:teuthology.orchestra.run.smithi005.stdout:(73/158): protobuf-3.14.0-13.el9.x86_64.rpm 742 kB/s | 1.0 MB 00:01 2024-05-16T21:29:49.052 INFO:teuthology.orchestra.run.smithi005.stdout:(74/158): python3-devel-3.9.18-3.el9.x86_64.rpm 714 kB/s | 244 kB 00:00 2024-05-16T21:29:49.153 INFO:teuthology.orchestra.run.smithi181.stdout:(40/158): fuse-2.9.9-15.el9.x86_64.rpm 96 kB/s | 80 kB 00:00 2024-05-16T21:29:49.379 INFO:teuthology.orchestra.run.smithi181.stdout:(41/158): libquadmath-11.4.1-3.el9.x86_64.rpm 215 kB/s | 195 kB 00:00 2024-05-16T21:29:49.394 INFO:teuthology.orchestra.run.smithi005.stdout:(75/158): python3-jinja2-2.11.3-5.el9.noarch.rp 725 kB/s | 248 kB 00:00 2024-05-16T21:29:49.494 INFO:teuthology.orchestra.run.smithi005.stdout:(76/158): python3-jsonpatch-1.21-16.el9.noarch. 257 kB/s | 26 kB 00:00 2024-05-16T21:29:49.595 INFO:teuthology.orchestra.run.smithi005.stdout:(77/158): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-05-16T21:29:49.861 INFO:teuthology.orchestra.run.smithi005.stdout:(78/158): python3-mako-1.1.4-6.el9.noarch.rpm 646 kB/s | 172 kB 00:00 2024-05-16T21:29:49.953 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T21:29:49.954 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T21:29:49.965 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-16T21:29:49.965 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-16T21:29:49.966 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-16T21:29:49.967 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-16T21:29:49.969 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-16T21:29:49.970 INFO:teuthology.orchestra.run.smithi005.stdout:(79/158): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-05-16T21:29:49.971 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-16T21:29:49.972 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-16T21:29:50.034 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-05-16T21:29:50.055 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-05-16T21:29:50.055 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-05-16T21:29:50.055 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-05-16T21:29:50.055 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-05-16T21:29:50.055 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-16T21:29:50.055 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-16T21:29:50.056 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-16T21:29:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-05-16T21:29:50.058 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-16T21:29:50.059 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-16T21:29:50.060 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-16T21:29:50.061 INFO:teuthology.orchestra.run.smithi157.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-16T21:29:50.062 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-16T21:29:50.063 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-16T21:29:50.064 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-16T21:29:50.065 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-16T21:29:50.066 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout:Install 150 Packages 2024-05-16T21:29:50.067 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 8 Packages 2024-05-16T21:29:50.068 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:29:50.068 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 223 M 2024-05-16T21:29:50.068 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-05-16T21:29:50.120 INFO:teuthology.orchestra.run.smithi181.stdout:(42/158): libgfortran-11.4.1-3.el9.x86_64.rpm 452 kB/s | 803 kB 00:01 2024-05-16T21:29:50.187 INFO:teuthology.orchestra.run.smithi181.stdout:(43/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 245 kB/s | 253 kB 00:01 2024-05-16T21:29:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:(44/158): python3-cryptography-36.0.1-4.el9.x86 1.0 MB/s | 1.2 MB 00:01 2024-05-16T21:29:50.694 INFO:teuthology.orchestra.run.smithi157.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-05-16T21:29:50.921 INFO:teuthology.orchestra.run.smithi181.stdout:(45/158): python3-ply-3.11-14.el9.noarch.rpm 133 kB/s | 106 kB 00:00 2024-05-16T21:29:50.961 INFO:teuthology.orchestra.run.smithi157.stdout:(2/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 3.2 MB/s | 863 kB 00:00 2024-05-16T21:29:51.028 INFO:teuthology.orchestra.run.smithi157.stdout:(3/158): ceph-immutable-object-cache-19.0.0-370 2.2 MB/s | 147 kB 00:00 2024-05-16T21:29:51.030 INFO:teuthology.orchestra.run.smithi181.stdout:(46/158): python3-pycparser-2.20-6.el9.noarch.r 161 kB/s | 135 kB 00:00 2024-05-16T21:29:51.104 INFO:teuthology.orchestra.run.smithi157.stdout:(4/158): ceph-base-19.0.0-3709.g43296076.el9.x8 8.8 MB/s | 5.4 MB 00:00 2024-05-16T21:29:51.229 INFO:teuthology.orchestra.run.smithi157.stdout:(5/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 12 MB/s | 1.5 MB 00:00 2024-05-16T21:29:51.255 INFO:teuthology.orchestra.run.smithi181.stdout:(47/158): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-05-16T21:29:51.396 INFO:teuthology.orchestra.run.smithi157.stdout:(6/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 6.2 MB/s | 2.3 MB 00:00 2024-05-16T21:29:51.413 INFO:teuthology.orchestra.run.smithi181.stdout:(48/158): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-05-16T21:29:51.464 INFO:teuthology.orchestra.run.smithi181.stdout:(49/158): boost-program-options-1.75.0-8.el9.x8 2.2 MB/s | 107 kB 00:00 2024-05-16T21:29:51.514 INFO:teuthology.orchestra.run.smithi181.stdout:(50/158): python3-requests-2.25.1-8.el9.noarch. 147 kB/s | 125 kB 00:00 2024-05-16T21:29:51.562 INFO:teuthology.orchestra.run.smithi181.stdout:(51/158): elfutils-libelf-devel-0.190-2.el9.x86 222 kB/s | 21 kB 00:00 2024-05-16T21:29:51.570 INFO:teuthology.orchestra.run.smithi157.stdout:(7/158): ceph-mon-19.0.0-3709.g43296076.el9.x86 14 MB/s | 4.9 MB 00:00 2024-05-16T21:29:51.598 INFO:teuthology.orchestra.run.smithi181.stdout:(52/158): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-05-16T21:29:51.665 INFO:teuthology.orchestra.run.smithi181.stdout:(53/158): flexiblas-3.0.4-8.el9.x86_64.rpm 319 kB/s | 33 kB 00:00 2024-05-16T21:29:51.718 INFO:teuthology.orchestra.run.smithi181.stdout:(54/158): flexiblas-openblas-openmp-3.0.4-8.el9 370 kB/s | 18 kB 00:00 2024-05-16T21:29:51.799 INFO:teuthology.orchestra.run.smithi181.stdout:(55/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-05-16T21:29:51.824 INFO:teuthology.orchestra.run.smithi181.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-05-16T21:29:51.858 INFO:teuthology.orchestra.run.smithi181.stdout:(57/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-16T21:29:51.900 INFO:teuthology.orchestra.run.smithi181.stdout:(58/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 606 kB/s | 45 kB 00:00 2024-05-16T21:29:51.942 INFO:teuthology.orchestra.run.smithi181.stdout:(59/158): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-05-16T21:29:52.000 INFO:teuthology.orchestra.run.smithi181.stdout:(60/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 442 kB/s | 25 kB 00:00 2024-05-16T21:29:52.034 INFO:teuthology.orchestra.run.smithi181.stdout:(61/158): python3-urllib3-1.26.5-5.el9.noarch.r 206 kB/s | 215 kB 00:01 2024-05-16T21:29:52.051 INFO:teuthology.orchestra.run.smithi181.stdout:(62/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.0 MB/s | 47 kB 00:00 2024-05-16T21:29:52.093 INFO:teuthology.orchestra.run.smithi181.stdout:(63/158): libtool-2.4.6-45.el9.x86_64.rpm 3.0 MB/s | 582 kB 00:00 2024-05-16T21:29:52.126 INFO:teuthology.orchestra.run.smithi181.stdout:(64/158): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-05-16T21:29:52.144 INFO:teuthology.orchestra.run.smithi181.stdout:(65/158): openblas-0.3.21-2.el9.x86_64.rpm 713 kB/s | 35 kB 00:00 2024-05-16T21:29:52.235 INFO:teuthology.orchestra.run.smithi181.stdout:(66/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-05-16T21:29:52.321 INFO:teuthology.orchestra.run.smithi157.stdout:(8/158): ceph-radosgw-19.0.0-3709.g43296076.el9 13 MB/s | 10 MB 00:00 2024-05-16T21:29:52.344 INFO:teuthology.orchestra.run.smithi181.stdout:(67/158): openblas-openmp-0.3.21-2.el9.x86_64.r 22 MB/s | 4.7 MB 00:00 2024-05-16T21:29:52.380 INFO:teuthology.orchestra.run.smithi157.stdout:(9/158): ceph-selinux-19.0.0-3709.g43296076.el9 434 kB/s | 25 kB 00:00 2024-05-16T21:29:52.436 INFO:teuthology.orchestra.run.smithi181.stdout:(68/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-16T21:29:52.486 INFO:teuthology.orchestra.run.smithi181.stdout:(69/158): postgresql-contrib-13.14-1.el9.x86_64 6.3 MB/s | 911 kB 00:00 2024-05-16T21:29:52.520 INFO:teuthology.orchestra.run.smithi181.stdout:(70/158): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-05-16T21:29:52.587 INFO:teuthology.orchestra.run.smithi181.stdout:(71/158): postgresql-13.14-1.el9.x86_64.rpm 4.5 MB/s | 1.6 MB 00:00 2024-05-16T21:29:52.645 INFO:teuthology.orchestra.run.smithi181.stdout:(72/158): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-05-16T21:29:52.670 INFO:teuthology.orchestra.run.smithi181.stdout:(73/158): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-05-16T21:29:52.729 INFO:teuthology.orchestra.run.smithi181.stdout:(74/158): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-05-16T21:29:52.788 INFO:teuthology.orchestra.run.smithi181.stdout:(75/158): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-05-16T21:29:52.838 INFO:teuthology.orchestra.run.smithi181.stdout:(76/158): python3-jsonpatch-1.21-16.el9.noarch. 529 kB/s | 26 kB 00:00 2024-05-16T21:29:52.938 INFO:teuthology.orchestra.run.smithi181.stdout:(77/158): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-05-16T21:29:52.964 INFO:teuthology.orchestra.run.smithi181.stdout:(78/158): python3-jsonpointer-2.0-4.el9.noarch. 154 kB/s | 19 kB 00:00 2024-05-16T21:29:53.006 INFO:teuthology.orchestra.run.smithi181.stdout:(79/158): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-16T21:29:53.031 INFO:teuthology.orchestra.run.smithi181.stdout:(80/158): python3-markupsafe-1.1.1-12.el9.x86_6 524 kB/s | 35 kB 00:00 2024-05-16T21:29:53.156 INFO:teuthology.orchestra.run.smithi181.stdout:(81/158): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-05-16T21:29:53.208 INFO:teuthology.orchestra.run.smithi181.stdout:(82/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-05-16T21:29:53.265 INFO:teuthology.orchestra.run.smithi181.stdout:(83/158): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-16T21:29:53.316 INFO:teuthology.orchestra.run.smithi181.stdout:(84/158): python3-prettytable-0.7.2-27.el9.noar 857 kB/s | 42 kB 00:00 2024-05-16T21:29:53.356 INFO:teuthology.orchestra.run.smithi157.stdout:(10/158): ceph-osd-19.0.0-3709.g43296076.el9.x8 9.1 MB/s | 18 MB 00:01 2024-05-16T21:29:53.382 INFO:teuthology.orchestra.run.smithi181.stdout:(85/158): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-05-16T21:29:53.418 INFO:teuthology.orchestra.run.smithi181.stdout:(86/158): python3-oauthlib-3.1.1-5.el9.noarch.r 859 kB/s | 222 kB 00:00 2024-05-16T21:29:53.430 INFO:teuthology.orchestra.run.smithi157.stdout:(11/158): cephfs-mirror-19.0.0-3709.g43296076.e 2.9 MB/s | 224 kB 00:00 2024-05-16T21:29:53.450 INFO:teuthology.orchestra.run.smithi181.stdout:(87/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-16T21:29:53.483 INFO:teuthology.orchestra.run.smithi181.stdout:(88/158): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-16T21:29:53.506 INFO:teuthology.orchestra.run.smithi157.stdout:(12/158): cephfs-shell-19.0.0-3709.g43296076.el 360 kB/s | 27 kB 00:00 2024-05-16T21:29:53.509 INFO:teuthology.orchestra.run.smithi181.stdout:(89/158): python3-pytz-2021.1-5.el9.noarch.rpm 883 kB/s | 51 kB 00:00 2024-05-16T21:29:53.567 INFO:teuthology.orchestra.run.smithi181.stdout:(90/158): python3-requests-oauthlib-1.3.0-12.el 648 kB/s | 54 kB 00:00 2024-05-16T21:29:53.573 INFO:teuthology.orchestra.run.smithi157.stdout:(13/158): libcephfs-devel-19.0.0-3709.g43296076 476 kB/s | 32 kB 00:00 2024-05-16T21:29:53.618 INFO:teuthology.orchestra.run.smithi181.stdout:(91/158): python3-toml-0.10.2-6.el9.noarch.rpm 847 kB/s | 42 kB 00:00 2024-05-16T21:29:53.668 INFO:teuthology.orchestra.run.smithi181.stdout:(92/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 900 kB/s | 44 kB 00:00 2024-05-16T21:29:53.715 INFO:teuthology.orchestra.run.smithi157.stdout:(14/158): libcephfs2-19.0.0-3709.g43296076.el9. 5.2 MB/s | 756 kB 00:00 2024-05-16T21:29:53.777 INFO:teuthology.orchestra.run.smithi181.stdout:(93/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.6 MB/s | 5.1 MB 00:00 2024-05-16T21:29:53.790 INFO:teuthology.orchestra.run.smithi157.stdout:(15/158): libcephsqlite-19.0.0-3709.g43296076.e 2.1 MB/s | 157 kB 00:00 2024-05-16T21:29:53.810 INFO:teuthology.orchestra.run.smithi181.stdout:(94/158): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-05-16T21:29:53.836 INFO:teuthology.orchestra.run.smithi181.stdout:(95/158): qatlib-service-24.02.0-1.el9.x86_64.r 623 kB/s | 36 kB 00:00 2024-05-16T21:29:53.886 INFO:teuthology.orchestra.run.smithi181.stdout:(96/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 633 kB/s | 47 kB 00:00 2024-05-16T21:29:53.920 INFO:teuthology.orchestra.run.smithi181.stdout:(97/158): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-05-16T21:29:53.945 INFO:teuthology.orchestra.run.smithi181.stdout:(98/158): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-16T21:29:53.970 INFO:teuthology.orchestra.run.smithi181.stdout:(99/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-16T21:29:54.004 INFO:teuthology.orchestra.run.smithi181.stdout:(100/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-16T21:29:54.007 INFO:teuthology.orchestra.run.smithi157.stdout:(16/158): ceph-common-19.0.0-3709.g43296076.el9 5.6 MB/s | 20 MB 00:03 2024-05-16T21:29:54.021 INFO:teuthology.orchestra.run.smithi181.stdout:(101/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-05-16T21:29:54.032 INFO:teuthology.orchestra.run.smithi157.stdout:(17/158): librados-devel-19.0.0-3709.g43296076. 525 kB/s | 127 kB 00:00 2024-05-16T21:29:54.166 INFO:teuthology.orchestra.run.smithi157.stdout:(18/158): libradosstriper1-19.0.0-3709.g4329607 3.1 MB/s | 497 kB 00:00 2024-05-16T21:29:54.266 INFO:teuthology.orchestra.run.smithi157.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 450 kB/s | 45 kB 00:00 2024-05-16T21:29:54.367 INFO:teuthology.orchestra.run.smithi157.stdout:(20/158): python3-ceph-common-19.0.0-3709.g4329 1.3 MB/s | 136 kB 00:00 2024-05-16T21:29:54.467 INFO:teuthology.orchestra.run.smithi157.stdout:(21/158): python3-cephfs-19.0.0-3709.g43296076. 1.6 MB/s | 162 kB 00:00 2024-05-16T21:29:54.534 INFO:teuthology.orchestra.run.smithi157.stdout:(22/158): librgw2-19.0.0-3709.g43296076.el9.x86 10 MB/s | 5.2 MB 00:00 2024-05-16T21:29:54.546 INFO:teuthology.orchestra.run.smithi181.stdout:(102/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-05-16T21:29:54.559 INFO:teuthology.orchestra.run.smithi157.stdout:(23/158): python3-rados-19.0.0-3709.g43296076.e 3.4 MB/s | 320 kB 00:00 2024-05-16T21:29:54.601 INFO:teuthology.orchestra.run.smithi157.stdout:(24/158): python3-rbd-19.0.0-3709.g43296076.el9 4.4 MB/s | 300 kB 00:00 2024-05-16T21:29:54.643 INFO:teuthology.orchestra.run.smithi157.stdout:(25/158): python3-rgw-19.0.0-3709.g43296076.el9 1.2 MB/s | 99 kB 00:00 2024-05-16T21:29:54.669 INFO:teuthology.orchestra.run.smithi157.stdout:(26/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-16T21:29:54.752 INFO:teuthology.orchestra.run.smithi157.stdout:(27/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 2.0 MB/s | 169 kB 00:00 2024-05-16T21:29:54.813 INFO:teuthology.orchestra.run.smithi181.stdout:(103/158): lua-devel-5.4.4-4.el9.x86_64.rpm 28 kB/s | 22 kB 00:00 2024-05-16T21:29:54.819 INFO:teuthology.orchestra.run.smithi157.stdout:(28/158): ceph-grafana-dashboards-19.0.0-3709.g 514 kB/s | 34 kB 00:00 2024-05-16T21:29:54.919 INFO:teuthology.orchestra.run.smithi157.stdout:(29/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 1.4 MB/s | 143 kB 00:00 2024-05-16T21:29:55.062 INFO:teuthology.orchestra.run.smithi005.stdout:(80/158): postgresql-server-13.14-1.el9.x86_64. 749 kB/s | 5.8 MB 00:07 2024-05-16T21:29:55.088 INFO:teuthology.orchestra.run.smithi181.stdout:(104/158): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-16T21:29:55.095 INFO:teuthology.orchestra.run.smithi157.stdout:(30/158): rbd-mirror-19.0.0-3709.g43296076.el9. 6.7 MB/s | 3.0 MB 00:00 2024-05-16T21:29:55.420 INFO:teuthology.orchestra.run.smithi005.stdout:(81/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 700 kB/s | 250 kB 00:00 2024-05-16T21:29:55.529 INFO:teuthology.orchestra.run.smithi157.stdout:(31/158): ceph-test-19.0.0-3709.g43296076.el9.x 14 MB/s | 43 MB 00:03 2024-05-16T21:29:55.538 INFO:teuthology.orchestra.run.smithi181.stdout:(105/158): gperftools-libs-2.9.1-2.el9.x86_64.r 687 kB/s | 309 kB 00:00 2024-05-16T21:29:55.595 INFO:teuthology.orchestra.run.smithi157.stdout:(32/158): ceph-mgr-dashboard-19.0.0-3709.g43296 5.2 MB/s | 3.5 MB 00:00 2024-05-16T21:29:55.621 INFO:teuthology.orchestra.run.smithi157.stdout:(33/158): ceph-mgr-modules-core-19.0.0-3709.g43 2.9 MB/s | 274 kB 00:00 2024-05-16T21:29:55.622 INFO:teuthology.orchestra.run.smithi181.stdout:(106/158): grpc-data-1.46.7-10.el9.noarch.rpm 236 kB/s | 19 kB 00:00 2024-05-16T21:29:55.638 INFO:teuthology.orchestra.run.smithi157.stdout:(34/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 1.2 MB/s | 49 kB 00:00 2024-05-16T21:29:55.654 INFO:teuthology.orchestra.run.smithi157.stdout:(35/158): ceph-prometheus-alerts-19.0.0-3709.g4 491 kB/s | 16 kB 00:00 2024-05-16T21:29:55.696 INFO:teuthology.orchestra.run.smithi157.stdout:(36/158): ceph-volume-19.0.0-3709.g43296076.el9 4.6 MB/s | 273 kB 00:00 2024-05-16T21:29:55.722 INFO:teuthology.orchestra.run.smithi181.stdout:(107/158): fscrypt-0.3.4-2.el9.x86_64.rpm 2.3 MB/s | 2.0 MB 00:00 2024-05-16T21:29:55.763 INFO:teuthology.orchestra.run.smithi157.stdout:(37/158): cephadm-19.0.0-3709.g43296076.el9.noa 6.9 MB/s | 763 kB 00:00 2024-05-16T21:29:55.770 INFO:teuthology.orchestra.run.smithi005.stdout:(82/158): python3-oauthlib-3.1.1-5.el9.noarch.r 635 kB/s | 222 kB 00:00 2024-05-16T21:29:55.780 INFO:teuthology.orchestra.run.smithi157.stdout:(38/158): cephfs-top-19.0.0-3709.g43296076.el9. 218 kB/s | 18 kB 00:00 2024-05-16T21:29:55.839 INFO:teuthology.orchestra.run.smithi157.stdout:(39/158): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-05-16T21:29:55.863 INFO:teuthology.orchestra.run.smithi005.stdout:(83/158): python3-babel-2.9.1-2.el9.noarch.rpm 751 kB/s | 6.0 MB 00:08 2024-05-16T21:29:55.897 INFO:teuthology.orchestra.run.smithi181.stdout:(108/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 149 kB/s | 26 kB 00:00 2024-05-16T21:29:55.898 INFO:teuthology.orchestra.run.smithi157.stdout:(40/158): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-05-16T21:29:55.963 INFO:teuthology.orchestra.run.smithi005.stdout:(84/158): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-05-16T21:29:55.972 INFO:teuthology.orchestra.run.smithi181.stdout:(109/158): protobuf-compiler-3.14.0-13.el9.x86_ 442 kB/s | 863 kB 00:01 2024-05-16T21:29:55.988 INFO:teuthology.orchestra.run.smithi005.stdout:(85/158): python3-packaging-20.9-5.el9.noarch.r 355 kB/s | 77 kB 00:00 2024-05-16T21:29:55.990 INFO:teuthology.orchestra.run.smithi157.stdout:(41/158): ceph-mgr-diskprediction-local-19.0.0- 8.3 MB/s | 7.4 MB 00:00 2024-05-16T21:29:56.015 INFO:teuthology.orchestra.run.smithi157.stdout:(42/158): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-05-16T21:29:56.065 INFO:teuthology.orchestra.run.smithi157.stdout:(43/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-05-16T21:29:56.099 INFO:teuthology.orchestra.run.smithi157.stdout:(44/158): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-05-16T21:29:56.140 INFO:teuthology.orchestra.run.smithi181.stdout:(110/158): liboath-2.6.7-2.el9.x86_64.rpm 201 kB/s | 49 kB 00:00 2024-05-16T21:29:56.157 INFO:teuthology.orchestra.run.smithi157.stdout:(45/158): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-05-16T21:29:56.190 INFO:teuthology.orchestra.run.smithi181.stdout:(111/158): libunwind-1.6.2-1.el9.x86_64.rpm 312 kB/s | 67 kB 00:00 2024-05-16T21:29:56.191 INFO:teuthology.orchestra.run.smithi157.stdout:(46/158): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-05-16T21:29:56.216 INFO:teuthology.orchestra.run.smithi157.stdout:(47/158): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-16T21:29:56.267 INFO:teuthology.orchestra.run.smithi157.stdout:(48/158): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-16T21:29:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:(86/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 515 kB/s | 159 kB 00:00 2024-05-16T21:29:56.334 INFO:teuthology.orchestra.run.smithi157.stdout:(49/158): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-16T21:29:56.376 INFO:teuthology.orchestra.run.smithi157.stdout:(50/158): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-05-16T21:29:56.401 INFO:teuthology.orchestra.run.smithi157.stdout:(51/158): elfutils-libelf-devel-0.190-2.el9.x86 322 kB/s | 21 kB 00:00 2024-05-16T21:29:56.405 INFO:teuthology.orchestra.run.smithi005.stdout:(87/158): python3-protobuf-3.14.0-13.el9.noarch 609 kB/s | 269 kB 00:00 2024-05-16T21:29:56.426 INFO:teuthology.orchestra.run.smithi157.stdout:(52/158): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-05-16T21:29:56.468 INFO:teuthology.orchestra.run.smithi157.stdout:(53/158): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-05-16T21:29:56.493 INFO:teuthology.orchestra.run.smithi157.stdout:(54/158): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-16T21:29:56.522 INFO:teuthology.orchestra.run.smithi005.stdout:(88/158): python3-pytz-2021.1-5.el9.noarch.rpm 438 kB/s | 51 kB 00:00 2024-05-16T21:29:56.522 INFO:teuthology.orchestra.run.smithi181.stdout:(112/158): luarocks-3.9.2-5.el9.noarch.rpm 397 kB/s | 151 kB 00:00 2024-05-16T21:29:56.535 INFO:teuthology.orchestra.run.smithi157.stdout:(55/158): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-05-16T21:29:56.561 INFO:teuthology.orchestra.run.smithi157.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-05-16T21:29:56.619 INFO:teuthology.orchestra.run.smithi157.stdout:(57/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-05-16T21:29:56.645 INFO:teuthology.orchestra.run.smithi157.stdout:(58/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-16T21:29:56.689 INFO:teuthology.orchestra.run.smithi005.stdout:(89/158): python3-requests-oauthlib-1.3.0-12.el 321 kB/s | 54 kB 00:00 2024-05-16T21:29:56.728 INFO:teuthology.orchestra.run.smithi157.stdout:(59/158): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-16T21:29:56.756 INFO:teuthology.orchestra.run.smithi005.stdout:(90/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 769 kB/s | 5.1 MB 00:06 2024-05-16T21:29:56.765 INFO:teuthology.orchestra.run.smithi181.stdout:(113/158): libarrow-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-05-16T21:29:56.787 INFO:teuthology.orchestra.run.smithi157.stdout:(60/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2024-05-16T21:29:56.812 INFO:teuthology.orchestra.run.smithi157.stdout:(61/158): libtool-2.4.6-45.el9.x86_64.rpm 3.4 MB/s | 582 kB 00:00 2024-05-16T21:29:56.829 INFO:teuthology.orchestra.run.smithi157.stdout:(62/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 253 kB/s | 25 kB 00:00 2024-05-16T21:29:56.854 INFO:teuthology.orchestra.run.smithi157.stdout:(63/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-05-16T21:29:56.856 INFO:teuthology.orchestra.run.smithi005.stdout:(91/158): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-05-16T21:29:56.881 INFO:teuthology.orchestra.run.smithi005.stdout:(92/158): python3-pyasn1-modules-0.4.8-6.el9.no 477 kB/s | 279 kB 00:00 2024-05-16T21:29:56.905 INFO:teuthology.orchestra.run.smithi157.stdout:(64/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-16T21:29:56.921 INFO:teuthology.orchestra.run.smithi157.stdout:(65/158): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-05-16T21:29:56.947 INFO:teuthology.orchestra.run.smithi157.stdout:(66/158): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-05-16T21:29:56.957 INFO:teuthology.orchestra.run.smithi005.stdout:(93/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 440 kB/s | 44 kB 00:00 2024-05-16T21:29:57.024 INFO:teuthology.orchestra.run.smithi181.stdout:(114/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 2.2 MB/s | 1.8 MB 00:00 2024-05-16T21:29:57.048 INFO:teuthology.orchestra.run.smithi005.stdout:(94/158): qatlib-service-24.02.0-1.el9.x86_64.r 392 kB/s | 36 kB 00:00 2024-05-16T21:29:57.058 INFO:teuthology.orchestra.run.smithi181.stdout:(115/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.5 MB/s | 839 kB 00:00 2024-05-16T21:29:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:(67/158): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-16T21:29:57.149 INFO:teuthology.orchestra.run.smithi005.stdout:(95/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-05-16T21:29:57.178 INFO:teuthology.orchestra.run.smithi181.stdout:(116/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 284 kB/s | 43 kB 00:00 2024-05-16T21:29:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:(68/158): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-05-16T21:29:57.258 INFO:teuthology.orchestra.run.smithi005.stdout:(96/158): qatlib-24.02.0-1.el9.x86_64.rpm 587 kB/s | 221 kB 00:00 2024-05-16T21:29:57.258 INFO:teuthology.orchestra.run.smithi181.stdout:(117/158): python3-asyncssh-2.13.2-5.el9.noarch 1.1 MB/s | 548 kB 00:00 2024-05-16T21:29:57.264 INFO:teuthology.orchestra.run.smithi157.stdout:(69/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-16T21:29:57.309 INFO:teuthology.orchestra.run.smithi181.stdout:(118/158): python3-certifi-2021.10.8-2.el9.noar 115 kB/s | 15 kB 00:00 2024-05-16T21:29:57.331 INFO:teuthology.orchestra.run.smithi157.stdout:(70/158): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 911 kB 00:00 2024-05-16T21:29:57.351 INFO:teuthology.orchestra.run.smithi181.stdout:(119/158): python3-cachetools-4.2.4-1.el9.noarc 110 kB/s | 32 kB 00:00 2024-05-16T21:29:57.357 INFO:teuthology.orchestra.run.smithi157.stdout:(71/158): postgresql-private-libs-13.14-1.el9.x 840 kB/s | 133 kB 00:00 2024-05-16T21:29:57.366 INFO:teuthology.orchestra.run.smithi005.stdout:(97/158): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-05-16T21:29:57.424 INFO:teuthology.orchestra.run.smithi157.stdout:(72/158): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-16T21:29:57.474 INFO:teuthology.orchestra.run.smithi157.stdout:(73/158): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-05-16T21:29:57.541 INFO:teuthology.orchestra.run.smithi181.stdout:(120/158): python3-cheroot-8.6.0-4.el9.noarch.r 609 kB/s | 172 kB 00:00 2024-05-16T21:29:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:(98/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 489 kB/s | 94 kB 00:00 2024-05-16T21:29:57.583 INFO:teuthology.orchestra.run.smithi005.stdout:(99/158): socat-1.7.4.1-5.el9.x86_64.rpm 702 kB/s | 305 kB 00:00 2024-05-16T21:29:57.601 INFO:teuthology.orchestra.run.smithi181.stdout:(121/158): python3-cherrypy-18.6.1-2.el9.noarch 1.2 MB/s | 358 kB 00:00 2024-05-16T21:29:57.607 INFO:teuthology.orchestra.run.smithi157.stdout:(74/158): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-05-16T21:29:57.633 INFO:teuthology.orchestra.run.smithi157.stdout:(75/158): python3-devel-3.9.18-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2024-05-16T21:29:57.660 INFO:teuthology.orchestra.run.smithi181.stdout:(122/158): python3-colorama-0.4.4-12.el9.noarch 300 kB/s | 35 kB 00:00 2024-05-16T21:29:57.692 INFO:teuthology.orchestra.run.smithi005.stdout:(100/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-05-16T21:29:57.693 INFO:teuthology.orchestra.run.smithi181.stdout:(123/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 888 kB/s | 303 kB 00:00 2024-05-16T21:29:57.700 INFO:teuthology.orchestra.run.smithi157.stdout:(76/158): python3-jsonpatch-1.21-16.el9.noarch. 383 kB/s | 26 kB 00:00 2024-05-16T21:29:57.725 INFO:teuthology.orchestra.run.smithi157.stdout:(77/158): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-05-16T21:29:57.751 INFO:teuthology.orchestra.run.smithi005.stdout:(101/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 331 kB/s | 64 kB 00:00 2024-05-16T21:29:57.793 INFO:teuthology.orchestra.run.smithi005.stdout:(102/158): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-05-16T21:29:57.817 INFO:teuthology.orchestra.run.smithi157.stdout:(78/158): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-05-16T21:29:57.842 INFO:teuthology.orchestra.run.smithi157.stdout:(79/158): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-05-16T21:29:57.885 INFO:teuthology.orchestra.run.smithi157.stdout:(80/158): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-05-16T21:29:57.910 INFO:teuthology.orchestra.run.smithi157.stdout:(81/158): python3-mako-1.1.4-6.el9.noarch.rpm 934 kB/s | 172 kB 00:00 2024-05-16T21:29:57.951 INFO:teuthology.orchestra.run.smithi005.stdout:(103/158): abseil-cpp-20211102.0-3.el9.x86_64.r 3.4 MB/s | 548 kB 00:00 2024-05-16T21:29:57.985 INFO:teuthology.orchestra.run.smithi157.stdout:(82/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-05-16T21:29:57.994 INFO:teuthology.orchestra.run.smithi181.stdout:(124/158): python3-google-auth-2.29.0-1.el9.noa 525 kB/s | 206 kB 00:00 2024-05-16T21:29:58.019 INFO:teuthology.orchestra.run.smithi181.stdout:(125/158): python3-grpcio-tools-1.46.7-10.el9.x 445 kB/s | 144 kB 00:00 2024-05-16T21:29:58.027 INFO:teuthology.orchestra.run.smithi005.stdout:(104/158): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-05-16T21:29:58.077 INFO:teuthology.orchestra.run.smithi005.stdout:(105/158): fscrypt-0.3.4-2.el9.x86_64.rpm 16 MB/s | 2.0 MB 00:00 2024-05-16T21:29:58.093 INFO:teuthology.orchestra.run.smithi157.stdout:(83/158): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-05-16T21:29:58.094 INFO:teuthology.orchestra.run.smithi181.stdout:(126/158): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-05-16T21:29:58.119 INFO:teuthology.orchestra.run.smithi005.stdout:(106/158): grpc-data-1.46.7-10.el9.noarch.rpm 469 kB/s | 19 kB 00:00 2024-05-16T21:29:58.161 INFO:teuthology.orchestra.run.smithi181.stdout:(127/158): python3-jaraco-classes-3.2.1-5.el9.n 125 kB/s | 18 kB 00:00 2024-05-16T21:29:58.227 INFO:teuthology.orchestra.run.smithi005.stdout:(107/158): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-05-16T21:29:58.245 INFO:teuthology.orchestra.run.smithi181.stdout:(128/158): python3-jaraco-collections-3.0.0-8.e 155 kB/s | 23 kB 00:00 2024-05-16T21:29:58.252 INFO:teuthology.orchestra.run.smithi157.stdout:(84/158): python3-packaging-20.9-5.el9.noarch.r 289 kB/s | 77 kB 00:00 2024-05-16T21:29:58.253 INFO:teuthology.orchestra.run.smithi005.stdout:(108/158): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-05-16T21:29:58.278 INFO:teuthology.orchestra.run.smithi157.stdout:(85/158): python3-prettytable-0.7.2-27.el9.noar 230 kB/s | 42 kB 00:00 2024-05-16T21:29:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:(109/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-05-16T21:29:58.303 INFO:teuthology.orchestra.run.smithi005.stdout:(110/158): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-05-16T21:29:58.328 INFO:teuthology.orchestra.run.smithi181.stdout:(129/158): python3-jaraco-functools-3.5.0-2.el9 117 kB/s | 19 kB 00:00 2024-05-16T21:29:58.328 INFO:teuthology.orchestra.run.smithi005.stdout:(111/158): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-16T21:29:58.344 INFO:teuthology.orchestra.run.smithi157.stdout:(86/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-05-16T21:29:58.354 INFO:teuthology.orchestra.run.smithi005.stdout:(112/158): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-05-16T21:29:58.354 INFO:teuthology.orchestra.run.smithi181.stdout:(130/158): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-05-16T21:29:58.395 INFO:teuthology.orchestra.run.smithi157.stdout:(87/158): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-05-16T21:29:58.420 INFO:teuthology.orchestra.run.smithi157.stdout:(88/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-05-16T21:29:58.429 INFO:teuthology.orchestra.run.smithi005.stdout:(113/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 18 MB/s | 1.8 MB 00:00 2024-05-16T21:29:58.445 INFO:teuthology.orchestra.run.smithi157.stdout:(89/158): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-05-16T21:29:58.471 INFO:teuthology.orchestra.run.smithi157.stdout:(90/158): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-05-16T21:29:58.471 INFO:teuthology.orchestra.run.smithi181.stdout:(131/158): python3-logutils-0.3.5-21.el9.noarch 400 kB/s | 46 kB 00:00 2024-05-16T21:29:58.490 INFO:teuthology.orchestra.run.smithi005.stdout:(114/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.0 MB/s | 839 kB 00:00 2024-05-16T21:29:58.496 INFO:teuthology.orchestra.run.smithi157.stdout:(91/158): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-05-16T21:29:58.521 INFO:teuthology.orchestra.run.smithi005.stdout:(115/158): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-05-16T21:29:58.546 INFO:teuthology.orchestra.run.smithi005.stdout:(116/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 781 kB/s | 43 kB 00:00 2024-05-16T21:29:58.571 INFO:teuthology.orchestra.run.smithi181.stdout:(132/158): python3-grpcio-1.46.7-10.el9.x86_64. 2.2 MB/s | 2.0 MB 00:00 2024-05-16T21:29:58.572 INFO:teuthology.orchestra.run.smithi005.stdout:(117/158): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-05-16T21:29:58.597 INFO:teuthology.orchestra.run.smithi005.stdout:(118/158): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-05-16T21:29:58.622 INFO:teuthology.orchestra.run.smithi005.stdout:(119/158): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-05-16T21:29:58.629 INFO:teuthology.orchestra.run.smithi157.stdout:(92/158): python3-toml-0.10.2-6.el9.noarch.rpm 262 kB/s | 42 kB 00:00 2024-05-16T21:29:58.648 INFO:teuthology.orchestra.run.smithi005.stdout:(120/158): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-05-16T21:29:58.655 INFO:teuthology.orchestra.run.smithi157.stdout:(93/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 278 kB/s | 44 kB 00:00 2024-05-16T21:29:58.673 INFO:teuthology.orchestra.run.smithi005.stdout:(121/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-05-16T21:29:58.698 INFO:teuthology.orchestra.run.smithi005.stdout:(122/158): python3-colorama-0.4.4-12.el9.noarch 704 kB/s | 35 kB 00:00 2024-05-16T21:29:58.705 INFO:teuthology.orchestra.run.smithi157.stdout:(94/158): qatlib-service-24.02.0-1.el9.x86_64.r 721 kB/s | 36 kB 00:00 2024-05-16T21:29:58.723 INFO:teuthology.orchestra.run.smithi005.stdout:(123/158): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-05-16T21:29:58.729 INFO:teuthology.orchestra.run.smithi181.stdout:(133/158): python3-natsort-7.1.1-5.el9.noarch.r 365 kB/s | 58 kB 00:00 2024-05-16T21:29:58.730 INFO:teuthology.orchestra.run.smithi157.stdout:(95/158): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-05-16T21:29:58.766 INFO:teuthology.orchestra.run.smithi005.stdout:(124/158): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-05-16T21:29:58.781 INFO:teuthology.orchestra.run.smithi157.stdout:(96/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-05-16T21:29:58.788 INFO:teuthology.orchestra.run.smithi181.stdout:(134/158): python3-more-itertools-8.12.0-2.el9. 249 kB/s | 79 kB 00:00 2024-05-16T21:29:58.808 INFO:teuthology.orchestra.run.smithi005.stdout:(125/158): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-05-16T21:29:58.825 INFO:teuthology.orchestra.run.smithi005.stdout:(126/158): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-05-16T21:29:58.831 INFO:teuthology.orchestra.run.smithi157.stdout:(97/158): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-05-16T21:29:58.850 INFO:teuthology.orchestra.run.smithi005.stdout:(127/158): python3-jaraco-classes-3.2.1-5.el9.n 421 kB/s | 18 kB 00:00 2024-05-16T21:29:58.856 INFO:teuthology.orchestra.run.smithi157.stdout:(98/158): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-05-16T21:29:58.875 INFO:teuthology.orchestra.run.smithi005.stdout:(128/158): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-05-16T21:29:58.900 INFO:teuthology.orchestra.run.smithi005.stdout:(129/158): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-05-16T21:29:58.915 INFO:teuthology.orchestra.run.smithi157.stdout:(99/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-05-16T21:29:58.917 INFO:teuthology.orchestra.run.smithi005.stdout:(130/158): python3-jaraco-text-3.2.0-6.el9.noar 472 kB/s | 20 kB 00:00 2024-05-16T21:29:58.938 INFO:teuthology.orchestra.run.smithi181.stdout:(135/158): python3-portend-3.1.0-2.el9.noarch.r 110 kB/s | 16 kB 00:00 2024-05-16T21:29:58.940 INFO:teuthology.orchestra.run.smithi157.stdout:(100/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-05-16T21:29:58.951 INFO:teuthology.orchestra.run.smithi005.stdout:(131/158): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-05-16T21:29:58.968 INFO:teuthology.orchestra.run.smithi005.stdout:(132/158): python3-logutils-0.3.5-21.el9.noarch 920 kB/s | 46 kB 00:00 2024-05-16T21:29:58.993 INFO:teuthology.orchestra.run.smithi005.stdout:(133/158): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-05-16T21:29:58.999 INFO:teuthology.orchestra.run.smithi157.stdout:(101/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2024-05-16T21:29:59.005 INFO:teuthology.orchestra.run.smithi181.stdout:(136/158): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-05-16T21:29:59.010 INFO:teuthology.orchestra.run.smithi005.stdout:(134/158): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-05-16T21:29:59.016 INFO:teuthology.orchestra.run.smithi157.stdout:(102/158): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-05-16T21:29:59.035 INFO:teuthology.orchestra.run.smithi005.stdout:(135/158): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-05-16T21:29:59.052 INFO:teuthology.orchestra.run.smithi005.stdout:(136/158): python3-portend-3.1.0-2.el9.noarch.r 390 kB/s | 16 kB 00:00 2024-05-16T21:29:59.086 INFO:teuthology.orchestra.run.smithi005.stdout:(137/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-16T21:29:59.111 INFO:teuthology.orchestra.run.smithi005.stdout:(138/158): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-05-16T21:29:59.131 INFO:teuthology.orchestra.run.smithi181.stdout:(137/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 470 kB/s | 90 kB 00:00 2024-05-16T21:29:59.137 INFO:teuthology.orchestra.run.smithi005.stdout:(139/158): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-05-16T21:29:59.162 INFO:teuthology.orchestra.run.smithi005.stdout:(140/158): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-05-16T21:29:59.200 INFO:teuthology.orchestra.run.smithi157.stdout:(103/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-05-16T21:29:59.207 INFO:teuthology.orchestra.run.smithi181.stdout:(138/158): python3-pecan-1.4.2-3.el9.noarch.rpm 571 kB/s | 272 kB 00:00 2024-05-16T21:29:59.231 INFO:teuthology.orchestra.run.smithi181.stdout:(139/158): python3-pyperclip-1.8.2-2.el9.noarch 126 kB/s | 28 kB 00:00 2024-05-16T21:29:59.306 INFO:teuthology.orchestra.run.smithi181.stdout:(140/158): python3-repoze-lru-0.7-16.el9.noarch 176 kB/s | 31 kB 00:00 2024-05-16T21:29:59.325 INFO:teuthology.orchestra.run.smithi157.stdout:(104/158): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-05-16T21:29:59.362 INFO:teuthology.orchestra.run.smithi005.stdout:(141/158): python3-rsa-4.9-2.el9.noarch.rpm 262 kB/s | 59 kB 00:00 2024-05-16T21:29:59.387 INFO:teuthology.orchestra.run.smithi005.stdout:(142/158): python3-tempora-5.0.0-2.el9.noarch.r 158 kB/s | 36 kB 00:00 2024-05-16T21:29:59.413 INFO:teuthology.orchestra.run.smithi005.stdout:(143/158): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-16T21:29:59.415 INFO:teuthology.orchestra.run.smithi181.stdout:(141/158): python3-tempora-5.0.0-2.el9.noarch.r 330 kB/s | 36 kB 00:00 2024-05-16T21:29:59.438 INFO:teuthology.orchestra.run.smithi005.stdout:(144/158): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-05-16T21:29:59.457 INFO:teuthology.orchestra.run.smithi181.stdout:(142/158): python3-rsa-4.9-2.el9.noarch.rpm 263 kB/s | 59 kB 00:00 2024-05-16T21:29:59.463 INFO:teuthology.orchestra.run.smithi005.stdout:(145/158): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-05-16T21:29:59.488 INFO:teuthology.orchestra.run.smithi005.stdout:(146/158): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-05-16T21:29:59.514 INFO:teuthology.orchestra.run.smithi005.stdout:(147/158): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-05-16T21:29:59.528 INFO:teuthology.orchestra.run.smithi181.stdout:(143/158): python3-routes-2.5.1-5.el9.noarch.rp 636 kB/s | 188 kB 00:00 2024-05-16T21:29:59.539 INFO:teuthology.orchestra.run.smithi005.stdout:(148/158): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-16T21:29:59.549 INFO:teuthology.orchestra.run.smithi181.stdout:(144/158): python3-typing-extensions-4.4.0-2.el 383 kB/s | 51 kB 00:00 2024-05-16T21:29:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:(149/158): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-05-16T21:29:59.633 INFO:teuthology.orchestra.run.smithi157.stdout:(105/158): abseil-cpp-20211102.0-3.el9.x86_64.r 887 kB/s | 548 kB 00:00 2024-05-16T21:29:59.726 INFO:teuthology.orchestra.run.smithi157.stdout:(106/158): grpc-data-1.46.7-10.el9.noarch.rpm 212 kB/s | 19 kB 00:00 2024-05-16T21:29:59.848 INFO:teuthology.orchestra.run.smithi005.stdout:(150/158): librados2-19.0.0-3709.g43296076.el9. 11 MB/s | 3.3 MB 00:00 2024-05-16T21:29:59.859 INFO:teuthology.orchestra.run.smithi157.stdout:(107/158): gperftools-libs-2.9.1-2.el9.x86_64.r 578 kB/s | 309 kB 00:00 2024-05-16T21:29:59.918 INFO:teuthology.orchestra.run.smithi157.stdout:(108/158): fscrypt-0.3.4-2.el9.x86_64.rpm 2.9 MB/s | 2.0 MB 00:00 2024-05-16T21:29:59.941 INFO:teuthology.orchestra.run.smithi181.stdout:(145/158): python3-websocket-client-1.2.3-2.el9 218 kB/s | 90 kB 00:00 2024-05-16T21:29:59.951 INFO:teuthology.orchestra.run.smithi157.stdout:(109/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-05-16T21:29:59.983 INFO:teuthology.orchestra.run.smithi181.stdout:(146/158): python3-webob-1.8.7-6.el9.noarch.rpm 437 kB/s | 230 kB 00:00 2024-05-16T21:30:00.001 INFO:teuthology.orchestra.run.smithi157.stdout:(110/158): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-05-16T21:30:00.042 INFO:teuthology.orchestra.run.smithi181.stdout:(147/158): python3-werkzeug-2.0.3-3.el9.1.noarc 868 kB/s | 427 kB 00:00 2024-05-16T21:30:00.048 INFO:teuthology.orchestra.run.smithi005.stdout:(151/158): librbd1-19.0.0-3709.g43296076.el9.x8 6.6 MB/s | 3.1 MB 00:00 2024-05-16T21:30:00.060 INFO:teuthology.orchestra.run.smithi157.stdout:(111/158): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-16T21:30:00.085 INFO:teuthology.orchestra.run.smithi157.stdout:(112/158): libunwind-1.6.2-1.el9.x86_64.rpm 502 kB/s | 67 kB 00:00 2024-05-16T21:30:00.092 INFO:teuthology.orchestra.run.smithi181.stdout:(148/158): python3-zc-lockfile-2.0-10.el9.noarc 133 kB/s | 20 kB 00:00 2024-05-16T21:30:00.111 INFO:teuthology.orchestra.run.smithi157.stdout:(113/158): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-05-16T21:30:00.186 INFO:teuthology.orchestra.run.smithi157.stdout:(114/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 15 MB/s | 1.8 MB 00:00 2024-05-16T21:30:00.220 INFO:teuthology.orchestra.run.smithi157.stdout:(115/158): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-05-16T21:30:00.278 INFO:teuthology.orchestra.run.smithi157.stdout:(116/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-05-16T21:30:00.320 INFO:teuthology.orchestra.run.smithi157.stdout:(117/158): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-05-16T21:30:00.342 INFO:teuthology.orchestra.run.smithi181.stdout:(149/158): re2-20211101-3.el9.x86_64.rpm 536 kB/s | 192 kB 00:00 2024-05-16T21:30:00.345 INFO:teuthology.orchestra.run.smithi157.stdout:(118/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 839 kB 00:00 2024-05-16T21:30:00.365 INFO:teuthology.orchestra.run.smithi005.stdout:(152/158): NetworkManager-libnm-1.47.90-1.el9.x 5.7 MB/s | 1.8 MB 00:00 2024-05-16T21:30:00.396 INFO:teuthology.orchestra.run.smithi157.stdout:(119/158): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-05-16T21:30:00.421 INFO:teuthology.orchestra.run.smithi157.stdout:(120/158): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-05-16T21:30:00.424 INFO:teuthology.orchestra.run.smithi005.stdout:(153/158): NetworkManager-team-1.47.90-1.el9.x8 711 kB/s | 41 kB 00:00 2024-05-16T21:30:00.446 INFO:teuthology.orchestra.run.smithi157.stdout:(121/158): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-05-16T21:30:00.483 INFO:teuthology.orchestra.run.smithi005.stdout:(154/158): NetworkManager-tui-1.47.90-1.el9.x86 4.1 MB/s | 248 kB 00:00 2024-05-16T21:30:00.488 INFO:teuthology.orchestra.run.smithi157.stdout:(122/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-05-16T21:30:00.505 INFO:teuthology.orchestra.run.smithi157.stdout:(123/158): python3-colorama-0.4.4-12.el9.noarch 420 kB/s | 35 kB 00:00 2024-05-16T21:30:00.543 INFO:teuthology.orchestra.run.smithi181.stdout:(150/158): librados2-19.0.0-3709.g43296076.el9. 7.4 MB/s | 3.3 MB 00:00 2024-05-16T21:30:00.547 INFO:teuthology.orchestra.run.smithi157.stdout:(124/158): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-05-16T21:30:00.599 INFO:teuthology.orchestra.run.smithi005.stdout:(155/158): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-05-16T21:30:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:(125/158): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-05-16T21:30:00.631 INFO:teuthology.orchestra.run.smithi157.stdout:(126/158): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-05-16T21:30:00.698 INFO:teuthology.orchestra.run.smithi157.stdout:(127/158): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-05-16T21:30:00.723 INFO:teuthology.orchestra.run.smithi157.stdout:(128/158): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-05-16T21:30:00.742 INFO:teuthology.orchestra.run.smithi005.stdout:(156/158): NetworkManager-1.47.90-1.el9.x86_64. 2.6 MB/s | 2.3 MB 00:00 2024-05-16T21:30:00.760 INFO:teuthology.orchestra.run.smithi181.stdout:(151/158): thrift-0.15.0-2.el9.x86_64.rpm 2.2 MB/s | 1.6 MB 00:00 2024-05-16T21:30:00.790 INFO:teuthology.orchestra.run.smithi157.stdout:(129/158): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-05-16T21:30:00.792 INFO:teuthology.orchestra.run.smithi005.stdout:(157/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-05-16T21:30:00.815 INFO:teuthology.orchestra.run.smithi157.stdout:(130/158): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-05-16T21:30:00.907 INFO:teuthology.orchestra.run.smithi157.stdout:(131/158): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-05-16T21:30:00.924 INFO:teuthology.orchestra.run.smithi181.stdout:(152/158): librbd1-19.0.0-3709.g43296076.el9.x8 5.3 MB/s | 3.1 MB 00:00 2024-05-16T21:30:00.941 INFO:teuthology.orchestra.run.smithi157.stdout:(132/158): python3-logutils-0.3.5-21.el9.noarch 369 kB/s | 46 kB 00:00 2024-05-16T21:30:01.000 INFO:teuthology.orchestra.run.smithi157.stdout:(133/158): python3-more-itertools-8.12.0-2.el9. 856 kB/s | 79 kB 00:00 2024-05-16T21:30:01.034 INFO:teuthology.orchestra.run.smithi157.stdout:(134/158): python3-natsort-7.1.1-5.el9.noarch.r 628 kB/s | 58 kB 00:00 2024-05-16T21:30:01.101 INFO:teuthology.orchestra.run.smithi157.stdout:(135/158): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-05-16T21:30:01.126 INFO:teuthology.orchestra.run.smithi157.stdout:(136/158): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-05-16T21:30:01.193 INFO:teuthology.orchestra.run.smithi157.stdout:(137/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 979 kB/s | 90 kB 00:00 2024-05-16T21:30:01.218 INFO:teuthology.orchestra.run.smithi157.stdout:(138/158): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-05-16T21:30:01.285 INFO:teuthology.orchestra.run.smithi157.stdout:(139/158): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-05-16T21:30:01.319 INFO:teuthology.orchestra.run.smithi157.stdout:(140/158): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-16T21:30:01.377 INFO:teuthology.orchestra.run.smithi157.stdout:(141/158): python3-rsa-4.9-2.el9.noarch.rpm 644 kB/s | 59 kB 00:00 2024-05-16T21:30:01.436 INFO:teuthology.orchestra.run.smithi157.stdout:(142/158): python3-tempora-5.0.0-2.el9.noarch.r 306 kB/s | 36 kB 00:00 2024-05-16T21:30:01.478 INFO:teuthology.orchestra.run.smithi157.stdout:(143/158): python3-grpcio-1.46.7-10.el9.x86_64. 2.1 MB/s | 2.0 MB 00:00 2024-05-16T21:30:01.503 INFO:teuthology.orchestra.run.smithi157.stdout:(144/158): python3-typing-extensions-4.4.0-2.el 406 kB/s | 51 kB 00:00 2024-05-16T21:30:01.537 INFO:teuthology.orchestra.run.smithi157.stdout:(145/158): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-16T21:30:01.571 INFO:teuthology.orchestra.run.smithi157.stdout:(146/158): python3-websocket-client-1.2.3-2.el9 973 kB/s | 90 kB 00:00 2024-05-16T21:30:01.604 INFO:teuthology.orchestra.run.smithi157.stdout:(147/158): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-05-16T21:30:01.629 INFO:teuthology.orchestra.run.smithi157.stdout:(148/158): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-05-16T21:30:01.663 INFO:teuthology.orchestra.run.smithi157.stdout:(149/158): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-05-16T21:30:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:(153/158): NetworkManager-team-1.47.90-1.el9.x8 55 kB/s | 41 kB 00:00 2024-05-16T21:30:01.997 INFO:teuthology.orchestra.run.smithi157.stdout:(150/158): librbd1-19.0.0-3709.g43296076.el9.x8 9.3 MB/s | 3.1 MB 00:00 2024-05-16T21:30:02.047 INFO:teuthology.orchestra.run.smithi157.stdout:(151/158): librados2-19.0.0-3709.g43296076.el9. 8.0 MB/s | 3.3 MB 00:00 2024-05-16T21:30:02.172 INFO:teuthology.orchestra.run.smithi157.stdout:(152/158): NetworkManager-1.47.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-05-16T21:30:02.214 INFO:teuthology.orchestra.run.smithi157.stdout:(153/158): NetworkManager-libnm-1.47.90-1.el9.x 11 MB/s | 1.8 MB 00:00 2024-05-16T21:30:02.264 INFO:teuthology.orchestra.run.smithi157.stdout:(154/158): NetworkManager-team-1.47.90-1.el9.x8 452 kB/s | 41 kB 00:00 2024-05-16T21:30:02.315 INFO:teuthology.orchestra.run.smithi157.stdout:(155/158): NetworkManager-tui-1.47.90-1.el9.x86 2.4 MB/s | 248 kB 00:00 2024-05-16T21:30:02.398 INFO:teuthology.orchestra.run.smithi157.stdout:(156/158): openssl-3.2.1-1.el9.x86_64.rpm 10 MB/s | 1.3 MB 00:00 2024-05-16T21:30:02.490 INFO:teuthology.orchestra.run.smithi157.stdout:(157/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-05-16T21:30:02.532 INFO:teuthology.orchestra.run.smithi157.stdout:(158/158): thrift-0.15.0-2.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-05-16T21:30:02.534 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-05-16T21:30:02.535 INFO:teuthology.orchestra.run.smithi157.stdout:Total 18 MB/s | 223 MB 00:12 2024-05-16T21:30:02.635 INFO:teuthology.orchestra.run.smithi181.stdout:(154/158): NetworkManager-tui-1.47.90-1.el9.x86 261 kB/s | 248 kB 00:00 2024-05-16T21:30:03.728 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-05-16T21:30:03.760 INFO:teuthology.orchestra.run.smithi181.stdout:(155/158): NetworkManager-libnm-1.47.90-1.el9.x 616 kB/s | 1.8 MB 00:02 2024-05-16T21:30:03.881 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-05-16T21:30:03.882 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-05-16T21:30:04.277 INFO:teuthology.orchestra.run.smithi181.stdout:(156/158): NetworkManager-1.47.90-1.el9.x86_64. 634 kB/s | 2.3 MB 00:03 2024-05-16T21:30:05.044 INFO:teuthology.orchestra.run.smithi181.stdout:(157/158): openssl-3.2.1-1.el9.x86_64.rpm 574 kB/s | 1.3 MB 00:02 2024-05-16T21:30:05.678 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-05-16T21:30:05.678 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-05-16T21:30:07.602 INFO:teuthology.orchestra.run.smithi181.stdout:(158/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 638 kB/s | 2.4 MB 00:03 2024-05-16T21:30:07.610 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-05-16T21:30:07.611 INFO:teuthology.orchestra.run.smithi181.stdout:Total 8.0 MB/s | 223 MB 00:27 2024-05-16T21:30:10.546 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-05-16T21:30:10.786 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-05-16T21:30:10.786 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-05-16T21:30:11.782 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-05-16T21:30:11.870 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-16T21:30:11.908 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-16T21:30:11.962 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-16T21:30:11.995 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-16T21:30:12.021 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-16T21:30:12.072 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-16T21:30:12.461 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-16T21:30:12.522 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:30:12.630 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:30:12.664 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:30:12.765 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:30:12.794 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T21:30:12.947 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-16T21:30:13.076 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-16T21:30:13.103 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:30:13.209 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:30:13.237 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T21:30:13.311 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T21:30:13.338 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T21:30:13.360 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T21:30:13.466 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-05-16T21:30:13.467 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-05-16T21:30:13.513 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T21:30:13.645 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T21:30:13.802 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T21:30:13.854 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T21:30:13.953 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:14.039 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:14.241 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:14.351 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-16T21:30:14.376 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-16T21:30:14.428 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-16T21:30:14.492 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-16T21:30:14.527 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-16T21:30:14.571 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-16T21:30:14.603 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-16T21:30:14.631 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-16T21:30:14.699 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-16T21:30:14.753 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-16T21:30:14.784 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-16T21:30:14.819 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-16T21:30:14.894 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-16T21:30:14.930 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-16T21:30:14.965 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-16T21:30:14.994 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-16T21:30:15.063 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-16T21:30:15.108 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/166 2024-05-16T21:30:15.182 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-16T21:30:15.315 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-16T21:30:15.368 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-16T21:30:15.888 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-16T21:30:15.980 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-16T21:30:16.010 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-16T21:30:16.055 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-16T21:30:16.094 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-16T21:30:16.135 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-16T21:30:16.288 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-16T21:30:16.367 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-16T21:30:16.422 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-16T21:30:16.455 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-16T21:30:16.546 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-16T21:30:16.611 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-16T21:30:16.683 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-16T21:30:16.715 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-16T21:30:16.752 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-16T21:30:16.799 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-16T21:30:16.835 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-16T21:30:16.878 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-16T21:30:16.920 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-16T21:30:17.055 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-16T21:30:17.150 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-16T21:30:17.180 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-16T21:30:17.222 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-16T21:30:17.315 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-16T21:30:17.355 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-16T21:30:17.395 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-16T21:30:17.421 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-16T21:30:17.446 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-16T21:30:17.519 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-16T21:30:17.638 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-16T21:30:17.678 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-16T21:30:17.706 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-16T21:30:17.756 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-16T21:30:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-16T21:30:17.828 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-16T21:30:17.858 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-16T21:30:17.892 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-16T21:30:17.926 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-16T21:30:17.958 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-16T21:30:17.994 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-16T21:30:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-16T21:30:18.124 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-16T21:30:18.155 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-16T21:30:18.202 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-16T21:30:18.300 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-16T21:30:18.348 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-16T21:30:18.686 INFO:teuthology.orchestra.run.smithi005.stdout:(158/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 757 kB/s | 16 MB 00:21 2024-05-16T21:30:18.689 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-05-16T21:30:18.689 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.3 MB/s | 223 MB 00:41 2024-05-16T21:30:19.065 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-16T21:30:19.112 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-16T21:30:19.146 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-16T21:30:19.244 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-16T21:30:19.295 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-16T21:30:19.382 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-16T21:30:19.432 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-16T21:30:19.609 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-16T21:30:19.638 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-16T21:30:19.723 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-16T21:30:19.903 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-05-16T21:30:20.073 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-05-16T21:30:20.073 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-05-16T21:30:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-05-16T21:30:20.259 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-16T21:30:20.339 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-16T21:30:20.363 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-16T21:30:20.477 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-16T21:30:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-16T21:30:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-16T21:30:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-16T21:30:20.722 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-16T21:30:21.179 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-16T21:30:21.476 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:30:21.674 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:30:21.693 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-16T21:30:21.710 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:30:21.784 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-16T21:30:21.811 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-16T21:30:21.845 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-16T21:30:21.861 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:30:21.901 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T21:30:21.967 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-05-16T21:30:21.968 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-05-16T21:30:22.168 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-16T21:30:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-16T21:30:22.224 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T21:30:22.276 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-16T21:30:22.299 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T21:30:22.306 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:30:22.329 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-16T21:30:22.365 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-16T21:30:22.466 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:30:22.499 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T21:30:22.585 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T21:30:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T21:30:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T21:30:22.852 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-16T21:30:22.878 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T21:30:22.949 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T21:30:22.971 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-16T21:30:23.096 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T21:30:23.477 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T21:30:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T21:30:23.828 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T21:30:24.005 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:24.142 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:24.699 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-16T21:30:24.740 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-16T21:30:24.796 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-16T21:30:24.925 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-16T21:30:24.971 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-16T21:30:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-16T21:30:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-16T21:30:25.147 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-16T21:30:25.170 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:25.209 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:25.271 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-16T21:30:25.344 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-16T21:30:25.390 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-16T21:30:25.446 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-16T21:30:25.576 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-16T21:30:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-16T21:30:25.673 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-16T21:30:25.709 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-16T21:30:25.761 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:25.796 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T21:30:25.830 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-16T21:30:25.888 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T21:30:25.888 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-16T21:30:25.888 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-16T21:30:25.889 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:25.897 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/166 2024-05-16T21:30:25.922 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T21:30:26.008 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-16T21:30:26.195 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-16T21:30:26.275 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-16T21:30:26.980 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-16T21:30:27.088 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-16T21:30:27.149 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-16T21:30:27.202 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-16T21:30:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-16T21:30:27.320 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-16T21:30:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-16T21:30:27.645 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-16T21:30:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-16T21:30:27.802 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-16T21:30:27.937 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-16T21:30:28.026 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-16T21:30:28.120 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-16T21:30:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-16T21:30:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-16T21:30:28.274 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-16T21:30:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-16T21:30:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-05-16T21:30:28.378 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-16T21:30:28.414 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-16T21:30:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-16T21:30:28.452 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-16T21:30:28.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-16T21:30:28.540 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-16T21:30:28.565 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-16T21:30:28.609 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-16T21:30:28.642 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-16T21:30:28.706 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-16T21:30:28.743 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-16T21:30:28.834 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-16T21:30:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-16T21:30:28.966 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-16T21:30:29.010 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-16T21:30:29.065 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-16T21:30:29.091 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:30:29.134 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-16T21:30:29.159 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-16T21:30:29.219 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:30:29.242 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:30:29.334 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:30:29.346 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-16T21:30:29.363 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T21:30:29.520 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-16T21:30:29.532 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-16T21:30:29.578 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-16T21:30:29.583 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-16T21:30:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:30:29.629 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-16T21:30:29.685 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-16T21:30:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:30:29.739 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T21:30:29.754 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-16T21:30:29.802 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T21:30:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-16T21:30:29.823 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T21:30:29.846 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T21:30:29.863 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-16T21:30:29.908 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-16T21:30:29.958 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-16T21:30:30.033 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-16T21:30:30.041 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T21:30:30.113 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-16T21:30:30.187 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T21:30:30.261 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-16T21:30:30.329 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T21:30:30.330 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-16T21:30:30.372 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-16T21:30:30.389 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T21:30:30.470 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-16T21:30:30.481 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:30.640 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-16T21:30:30.718 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-16T21:30:30.750 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T21:30:30.867 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-16T21:30:30.903 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-16T21:30:30.938 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-16T21:30:31.013 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-16T21:30:31.054 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-16T21:30:31.098 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-16T21:30:31.138 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-16T21:30:31.166 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-16T21:30:31.238 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-16T21:30:31.298 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-16T21:30:31.327 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-16T21:30:31.371 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-16T21:30:31.449 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-16T21:30:31.482 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-16T21:30:31.526 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-16T21:30:31.554 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-16T21:30:31.627 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-16T21:30:31.669 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/166 2024-05-16T21:30:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-16T21:30:31.746 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-16T21:30:31.792 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-16T21:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-16T21:30:31.883 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-16T21:30:31.939 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-16T21:30:31.951 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-16T21:30:32.021 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-16T21:30:32.159 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-16T21:30:32.202 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-16T21:30:32.437 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-16T21:30:32.466 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-16T21:30:32.505 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-16T21:30:32.561 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-16T21:30:32.602 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-16T21:30:32.637 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-16T21:30:32.680 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-16T21:30:32.718 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-16T21:30:32.760 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-16T21:30:32.913 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-16T21:30:32.976 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-16T21:30:33.031 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-16T21:30:33.063 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-16T21:30:33.158 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-16T21:30:33.221 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-16T21:30:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-16T21:30:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-16T21:30:33.368 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-16T21:30:33.375 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-16T21:30:33.415 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-16T21:30:33.459 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-16T21:30:33.502 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-16T21:30:33.522 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-16T21:30:33.544 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-16T21:30:33.688 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-16T21:30:33.735 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-16T21:30:33.765 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-16T21:30:33.806 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-16T21:30:33.904 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-16T21:30:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-16T21:30:33.980 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-16T21:30:34.022 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-16T21:30:34.049 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-16T21:30:34.124 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-16T21:30:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-16T21:30:34.304 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-16T21:30:34.332 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-16T21:30:34.366 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-16T21:30:34.405 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-16T21:30:34.445 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-16T21:30:34.475 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-16T21:30:34.509 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-16T21:30:34.543 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-16T21:30:34.585 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-16T21:30:34.619 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-16T21:30:34.700 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-16T21:30:34.750 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-16T21:30:34.781 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-16T21:30:34.829 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-16T21:30:34.939 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-16T21:30:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-16T21:30:35.154 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-16T21:30:35.257 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-16T21:30:35.293 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-16T21:30:35.329 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-16T21:30:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-16T21:30:35.764 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-16T21:30:35.802 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T21:30:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-16T21:30:35.846 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-16T21:30:35.926 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T21:30:35.949 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-16T21:30:35.959 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-16T21:30:36.005 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-16T21:30:36.014 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-16T21:30:36.095 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-16T21:30:36.132 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-16T21:30:36.310 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-16T21:30:36.346 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-16T21:30:36.426 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-16T21:30:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-16T21:30:36.939 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T21:30:37.055 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T21:30:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-16T21:30:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-16T21:30:37.231 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /root 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2024-05-16T21:30:37.790 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:37.961 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T21:30:37.976 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T21:30:37.977 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:37.977 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-16T21:30:37.977 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:38.534 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-16T21:30:38.619 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-16T21:30:38.653 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-16T21:30:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-16T21:30:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-16T21:30:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T21:30:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T21:30:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-16T21:30:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-16T21:30:39.555 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T21:30:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T21:30:39.582 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:39.582 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-16T21:30:39.582 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T21:30:39.582 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T21:30:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-16T21:30:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T21:30:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:39.815 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T21:30:39.838 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T21:30:39.838 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:39.838 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-16T21:30:39.838 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T21:30:39.838 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T21:30:39.838 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T21:30:39.853 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-16T21:30:40.310 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T21:30:40.333 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T21:30:40.333 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:40.333 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-16T21:30:40.334 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T21:30:40.334 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T21:30:40.334 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:40.449 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-16T21:30:40.497 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-16T21:30:40.532 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:40.552 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-16T21:30:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T21:30:40.737 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-16T21:30:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T21:30:40.758 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-16T21:30:40.758 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-16T21:30:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:30:40.786 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-16T21:30:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T21:30:40.863 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-16T21:30:40.951 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-16T21:30:41.084 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-16T21:30:41.136 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-16T21:30:41.168 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-16T21:30:41.196 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-16T21:30:41.628 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T21:30:41.652 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T21:30:41.693 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-16T21:30:41.754 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-16T21:30:41.792 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T21:30:42.145 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:42.193 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T21:30:42.821 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T21:30:42.838 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T21:30:42.877 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T21:30:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T21:30:42.896 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-16T21:30:42.896 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-16T21:30:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:30:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T21:30:43.846 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T21:30:43.878 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T21:30:43.990 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T21:30:44.153 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-16T21:30:44.180 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T21:30:44.203 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T21:30:44.203 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:44.203 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-16T21:30:44.203 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T21:30:44.204 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T21:30:44.204 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:44.256 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T21:30:44.267 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T21:30:44.365 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-16T21:30:44.411 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-16T21:30:45.351 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-16T21:30:45.383 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T21:30:45.406 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T21:30:45.406 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:45.406 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-16T21:30:45.406 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T21:30:45.407 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T21:30:45.407 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:45.450 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T21:30:45.473 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T21:30:45.473 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:45.473 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-16T21:30:45.473 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:45.517 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T21:30:45.540 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T21:30:45.540 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:45.540 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-16T21:30:45.540 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T21:30:45.540 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T21:30:45.541 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:45.868 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T21:30:45.891 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T21:30:45.892 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:45.892 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-16T21:30:45.892 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T21:30:45.892 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T21:30:45.892 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:30:50.147 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-16T21:30:50.188 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-16T21:30:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-16T21:30:50.261 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-16T21:30:50.288 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-16T21:30:50.472 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-16T21:30:50.517 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-16T21:30:50.539 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-16T21:30:50.569 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-16T21:30:50.607 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-16T21:30:51.209 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:30:51.246 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:30:51.266 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:30:52.094 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-16T21:30:52.193 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-16T21:30:52.233 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-16T21:30:52.313 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-16T21:30:52.345 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-16T21:30:52.371 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-16T21:30:52.371 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T21:30:52.447 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T21:30:52.480 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-16T21:30:52.481 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T21:30:52.548 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T21:30:52.573 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-16T21:30:52.578 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:30:52.578 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:30:52.758 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:30:52.758 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T21:30:52.851 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T21:30:52.913 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:30:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T21:30:54.003 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-05-16T21:30:54.003 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-05-16T21:30:54.003 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-05-16T21:30:54.003 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-05-16T21:30:54.004 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-05-16T21:30:54.004 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-05-16T21:30:54.004 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-05-16T21:30:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:30:54.258 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T21:30:54.306 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T21:30:54.306 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:54.306 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-16T21:30:54.306 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:30:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T21:30:55.435 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-05-16T21:30:55.435 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-05-16T21:30:55.435 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-05-16T21:30:55.435 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-05-16T21:30:55.435 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-05-16T21:30:55.436 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-05-16T21:30:55.436 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-05-16T21:30:55.436 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:30:55.612 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T21:30:55.631 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T21:30:55.631 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:55.631 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-16T21:30:55.631 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:30:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T21:30:56.164 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T21:30:56.164 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:56.164 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-16T21:30:56.164 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T21:30:56.164 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T21:30:56.164 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:30:56.428 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T21:30:56.508 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T21:30:56.508 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:56.508 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-16T21:30:56.509 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T21:30:56.509 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T21:30:56.509 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:30:57.020 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T21:30:57.089 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T21:30:57.089 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:57.089 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-16T21:30:57.089 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T21:30:57.089 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T21:30:57.089 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:30:57.221 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-16T21:30:57.276 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T21:30:57.281 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-16T21:30:57.303 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T21:30:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-16T21:30:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T21:30:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T21:30:57.303 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:30:57.358 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-16T21:30:57.551 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T21:30:57.575 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T21:30:57.575 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:57.575 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-16T21:30:57.576 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T21:30:57.576 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T21:30:57.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:30:57.598 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-16T21:30:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-16T21:30:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-16T21:30:57.853 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-16T21:30:58.030 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-16T21:30:58.077 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T21:30:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-16T21:30:58.101 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T21:30:58.101 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:30:58.101 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-16T21:30:58.102 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T21:30:58.102 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T21:30:58.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:30:58.149 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-16T21:30:58.206 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-16T21:30:58.208 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-16T21:30:58.266 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-16T21:30:58.330 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-16T21:30:58.526 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T21:30:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-16T21:30:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-16T21:30:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-16T21:30:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-16T21:30:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-16T21:30:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-16T21:30:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-16T21:30:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-16T21:30:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-16T21:30:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-16T21:30:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-16T21:30:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-16T21:30:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-16T21:30:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-16T21:30:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-16T21:30:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-16T21:30:58.659 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-16T21:30:58.761 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-16T21:30:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T21:30:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T21:30:58.899 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-16T21:30:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-16T21:30:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-16T21:30:58.978 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-16T21:30:59.011 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-16T21:30:59.013 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-16T21:30:59.040 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T21:30:59.438 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T21:30:59.480 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T21:30:59.519 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-16T21:30:59.583 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-16T21:30:59.610 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T21:31:00.363 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T21:31:00.402 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T21:31:00.711 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T21:31:00.762 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T21:31:01.386 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-16T21:31:01.387 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.2-8.el9.noarch 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.7.4-5.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.388 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.4-9.el9.x86_64 2024-05-16T21:31:01.389 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-16T21:31:01.390 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: lua-5.4.4-4.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-16T21:31:01.391 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-13.14-1.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-16T21:31:01.392 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-16T21:31:01.393 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-16T21:31:01.394 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply-3.11-14.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-16T21:31:01.395 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-16T21:31:01.396 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: re2-1:20211101-3.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-16T21:31:01.397 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-16T21:31:01.398 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-16T21:31:01.398 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:01.398 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-05-16T21:31:01.499 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T21:31:01.527 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T21:31:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T21:31:01.782 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T21:31:01.807 DEBUG:teuthology.parallel:result is None 2024-05-16T21:31:01.812 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T21:31:01.863 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-16T21:31:01.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T21:31:01.933 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T21:31:01.975 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T21:31:01.975 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:01.975 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-16T21:31:01.975 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T21:31:01.975 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T21:31:01.975 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:02.030 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T21:31:02.067 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T21:31:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-16T21:31:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T21:31:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T21:31:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-16T21:31:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T21:31:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T21:31:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:02.215 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T21:31:02.226 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T21:31:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-16T21:31:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-16T21:31:02.329 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-16T21:31:02.381 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-16T21:31:03.374 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-16T21:31:03.400 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-16T21:31:03.409 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T21:31:03.432 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T21:31:03.433 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T21:31:03.433 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:03.433 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-16T21:31:03.433 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T21:31:03.433 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T21:31:03.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:03.476 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T21:31:03.500 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T21:31:03.500 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:03.500 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-16T21:31:03.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:03.505 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T21:31:03.505 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:03.505 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-16T21:31:03.505 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T21:31:03.506 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T21:31:03.506 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T21:31:03.558 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T21:31:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T21:31:03.577 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:03.577 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-16T21:31:03.577 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T21:31:03.577 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T21:31:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:03.639 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T21:31:03.639 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:03.639 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-16T21:31:03.639 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:03.772 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T21:31:03.846 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T21:31:03.846 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:03.846 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-16T21:31:03.846 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T21:31:03.846 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T21:31:03.846 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:03.903 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T21:31:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T21:31:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-16T21:31:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T21:31:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T21:31:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:04.243 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T21:31:04.320 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T21:31:04.320 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T21:31:04.320 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-16T21:31:04.321 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T21:31:04.321 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T21:31:04.321 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-16T21:31:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-16T21:31:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-16T21:31:08.563 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-16T21:31:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-16T21:31:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-16T21:31:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-16T21:31:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-16T21:31:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-16T21:31:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-16T21:31:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-16T21:31:09.112 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-16T21:31:09.167 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-16T21:31:09.207 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-16T21:31:09.245 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-16T21:31:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:31:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-16T21:31:09.591 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:31:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-16T21:31:09.612 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:31:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-16T21:31:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-16T21:31:09.775 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-16T21:31:10.522 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-16T21:31:10.613 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-16T21:31:10.655 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-16T21:31:10.706 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:31:10.739 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-16T21:31:10.755 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:31:10.774 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-16T21:31:10.800 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-16T21:31:10.800 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T21:31:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T21:31:10.893 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T21:31:10.934 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-16T21:31:10.934 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T21:31:11.011 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T21:31:11.035 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-16T21:31:11.041 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:31:11.041 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:31:11.229 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:31:11.229 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T21:31:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T21:31:11.379 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:31:12.176 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-16T21:31:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-16T21:31:12.388 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-16T21:31:12.545 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-16T21:31:12.580 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-16T21:31:12.617 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-16T21:31:12.617 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T21:31:12.787 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T21:31:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-16T21:31:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T21:31:13.055 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T21:31:13.094 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-16T21:31:13.126 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:31:13.126 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:31:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T21:31:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T21:31:13.617 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T21:31:13.758 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:31:14.017 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:31:14.017 INFO:teuthology.orchestra.run.smithi181.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-16T21:31:14.017 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:31:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-16T21:31:16.914 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-16T21:31:16.915 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-16T21:31:16.915 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-16T21:31:16.915 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-16T21:31:16.915 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-16T21:31:16.915 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-16T21:31:16.926 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-16T21:31:16.926 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-16T21:31:16.926 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-16T21:31:16.926 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-16T21:31:16.926 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-16T21:31:16.926 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-16T21:31:16.926 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-16T21:31:16.927 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-16T21:31:16.928 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-16T21:31:16.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-16T21:31:16.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-16T21:31:16.931 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-16T21:31:16.931 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-16T21:31:16.931 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-16T21:31:16.933 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-16T21:31:16.933 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-16T21:31:16.933 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-16T21:31:16.933 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-16T21:31:16.933 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-16T21:31:16.933 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/166 2024-05-16T21:31:16.934 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-16T21:31:16.935 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-16T21:31:16.936 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-16T21:31:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-16T21:31:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-16T21:31:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-16T21:31:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-16T21:31:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-16T21:31:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:31:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:19.804 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-05-16T21:31:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-16T21:31:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: lua-5.4.4-4.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-13.14-1.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-16T21:31:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-16T21:31:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-16T21:31:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-16T21:31:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-3.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-16T21:31:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-16T21:31:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-16T21:31:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:19.816 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-05-16T21:31:19.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-16T21:31:19.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-16T21:31:19.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-16T21:31:19.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-16T21:31:19.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-16T21:31:19.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-16T21:31:19.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-16T21:31:19.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-16T21:31:19.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-16T21:31:19.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-16T21:31:19.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-16T21:31:19.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-16T21:31:19.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-16T21:31:19.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-16T21:31:19.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-16T21:31:19.896 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-16T21:31:19.897 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-16T21:31:19.898 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-16T21:31:19.899 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-16T21:31:19.900 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-16T21:31:19.901 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-16T21:31:19.902 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-16T21:31:19.903 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-16T21:31:19.904 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-16T21:31:20.343 DEBUG:teuthology.parallel:result is None 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-16T21:31:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-16T21:31:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.14-1.el9.x86_64 2024-05-16T21:31:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-16T21:31:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-16T21:31:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-05-16T21:31:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-16T21:31:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-16T21:31:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-3.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-16T21:31:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-16T21:31:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-16T21:31:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:22.209 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-05-16T21:31:22.831 DEBUG:teuthology.parallel:result is None 2024-05-16T21:31:22.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T21:31:23.056 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-16T21:31:23.083 INFO:teuthology.orchestra.run.smithi005.stdout:19.0.0-3709.g43296076.el9 2024-05-16T21:31:23.083 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-16T21:31:23.083 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-16T21:31:23.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T21:31:23.305 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-16T21:31:23.331 INFO:teuthology.orchestra.run.smithi157.stdout:19.0.0-3709.g43296076.el9 2024-05-16T21:31:23.331 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-16T21:31:23.331 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-16T21:31:23.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T21:31:23.542 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-16T21:31:23.596 INFO:teuthology.orchestra.run.smithi181.stdout:19.0.0-3709.g43296076.el9 2024-05-16T21:31:23.596 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-16T21:31:23.596 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-16T21:31:23.597 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-16T21:31:23.598 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:23.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-16T21:31:23.629 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:23.630 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-16T21:31:23.660 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:31:23.660 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-16T21:31:23.723 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-16T21:31:23.723 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:23.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-05-16T21:31:23.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-16T21:31:23.824 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:23.824 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-05-16T21:31:23.853 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-16T21:31:23.921 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:31:23.921 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-05-16T21:31:23.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-16T21:31:24.089 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-16T21:31:24.089 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:24.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-16T21:31:24.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-16T21:31:24.187 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:24.187 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-16T21:31:24.211 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-16T21:31:24.275 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:31:24.275 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-16T21:31:24.343 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-16T21:31:24.443 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-16T21:31:24.444 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:24.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-05-16T21:31:24.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-16T21:31:24.536 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:24.536 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-05-16T21:31:24.560 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-16T21:31:24.624 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:31:24.624 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-05-16T21:31:24.686 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-16T21:31:24.786 INFO:teuthology.run_tasks:Running task ceph... 2024-05-16T21:31:24.863 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-16T21:31:24.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-05-16T21:31:24.866 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-05-16T21:31:24.868 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-05-16T21:31:24.929 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-16T21:31:24.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-16T21:31:24.934 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-16T21:31:24.936 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-16T21:31:25.001 INFO:tasks.ceph:Creating extra log directories... 2024-05-16T21:31:25.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-16T21:31:25.004 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-16T21:31:25.006 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-16T21:31:25.073 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-16T21:31:25.073 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-16T21:31:25.073 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-16T21:31:25.073 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:25.073 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-16T21:31:25.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:25.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:25.234 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:25.234 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-16T21:31:25.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:25.357 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:25.397 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:31:25.397 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-16T21:31:25.437 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:25.611 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:25.676 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-16T21:31:25.677 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-16T21:31:25.677 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812', 'branch': 'wip-pdonnell-testing-20240515.023933-debug', 'description': 'fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7709812', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240515.023933-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'extra_system_packages': {'deb': ['fscrypt'], 'rpm': ['fscrypt']}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'i64602', 'sha1': '69a8de64df0b2e98d8ada0e9865445fd4329357b'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 6645, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'sleep_before_teardown': 0, 'suite': 'fs:fscrypt', 'suite_branch': 'i64602', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '69a8de64df0b2e98d8ada0e9865445fd4329357b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAzAgzbPaeNVMRIcb7wBi8SfBlFbsrTCtgwCxEuX4eQnW+DRCqLaVkpyE5L44DDfqejjm+XuI1Y/SVjN0eNSX4=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATVzC2gC1NYDFMZ1vJ/JrCiYdhhhaPfkFyv2BdJXbVt/IPBN4D0zmeSWCJnvyyVDs6CK6MyGcyUxbblceVikng=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJg5hwUyMtNK7XwqIYM+IC1H4vOmVX/BzJ0gFjqPlOk43bhByzy/7W9fsLpmCZRVkVgv3DX3sfDphpOBc7sVgeM='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'full_sequential_finally': [{'sleep': {'duration': 3600}}]}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'install-override-extra_system_packages', 'teuthology_sha1': '08ca1187b5d019c0ae6c90488c6c9faaace42185', 'timestamp': '2024-05-16_21:11:55', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-16T21:31:25.677 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-16T21:31:25.680 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-16T21:31:25.682 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-16T21:31:25.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-05-16T21:31:25.738 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-05-16T21:31:25.740 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-05-16T21:31:25.821 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:25.821 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-05-16T21:31:25.840 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-16T21:31:25.840 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-05-16T21:31:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-16T21:31:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T21:31:25.898 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-16T21:31:25.899 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T21:31:25.899 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T21:31:25.899 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-05-16 21:31:11.715655654 +0000 2024-05-16T21:31:25.899 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-05-16 21:27:05.574781447 +0000 2024-05-16T21:31:25.899 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-05-16 21:27:05.574781447 +0000 2024-05-16T21:31:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-05-16 21:27:05.574781447 +0000 2024-05-16T21:31:25.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-16T21:31:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-05-16T21:31:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-05-16T21:31:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000101834 s, 5.0 MB/s 2024-05-16T21:31:25.966 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-16T21:31:26.023 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-05-16T21:31:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-16T21:31:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T21:31:26.081 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-16T21:31:26.081 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T21:31:26.081 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T21:31:26.081 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-05-16 21:31:11.715655654 +0000 2024-05-16T21:31:26.081 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-05-16 21:27:05.901774324 +0000 2024-05-16T21:31:26.081 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-05-16 21:27:05.901774324 +0000 2024-05-16T21:31:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-05-16 21:27:05.901774324 +0000 2024-05-16T21:31:26.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-16T21:31:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-05-16T21:31:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-05-16T21:31:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000111598 s, 4.6 MB/s 2024-05-16T21:31:26.147 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-16T21:31:26.205 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-05-16T21:31:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-16T21:31:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T21:31:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-16T21:31:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T21:31:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T21:31:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-05-16 21:31:11.715655654 +0000 2024-05-16T21:31:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-05-16 21:27:06.229767178 +0000 2024-05-16T21:31:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-05-16 21:27:06.229767178 +0000 2024-05-16T21:31:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-05-16 21:27:06.229767178 +0000 2024-05-16T21:31:26.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-16T21:31:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-05-16T21:31:26.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-05-16T21:31:26.328 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000113056 s, 4.5 MB/s 2024-05-16T21:31:26.329 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-16T21:31:26.387 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-05-16T21:31:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-16T21:31:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T21:31:26.444 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-16T21:31:26.444 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T21:31:26.444 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T21:31:26.445 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-05-16 21:31:11.716655633 +0000 2024-05-16T21:31:26.445 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-05-16 21:27:06.572759706 +0000 2024-05-16T21:31:26.445 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-05-16 21:27:06.572759706 +0000 2024-05-16T21:31:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-05-16 21:27:06.572759706 +0000 2024-05-16T21:31:26.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-16T21:31:26.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-05-16T21:31:26.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-05-16T21:31:26.509 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000104645 s, 4.9 MB/s 2024-05-16T21:31:26.510 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-16T21:31:26.568 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:26.568 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:26.568 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-05-16T21:31:26.584 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-16T21:31:26.585 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-05-16 21:30:53.250803928 +0000 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-05-16 21:27:00.238599417 +0000 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-05-16 21:27:00.238599417 +0000 2024-05-16T21:31:26.641 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-05-16 21:27:00.238599417 +0000 2024-05-16T21:31:26.642 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-16T21:31:26.704 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-05-16T21:31:26.704 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-05-16T21:31:26.705 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000124282 s, 4.1 MB/s 2024-05-16T21:31:26.706 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-16T21:31:26.762 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-05-16T21:31:26.817 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-16T21:31:26.817 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T21:31:26.817 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-16T21:31:26.817 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T21:31:26.817 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T21:31:26.817 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-05-16 21:30:53.250803928 +0000 2024-05-16T21:31:26.817 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-05-16 21:27:00.567593306 +0000 2024-05-16T21:31:26.818 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-05-16 21:27:00.567593306 +0000 2024-05-16T21:31:26.818 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-05-16 21:27:00.567593306 +0000 2024-05-16T21:31:26.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-16T21:31:26.879 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-05-16T21:31:26.879 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-05-16T21:31:26.879 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 7.7718e-05 s, 6.6 MB/s 2024-05-16T21:31:26.880 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-16T21:31:26.936 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-05-16 21:30:53.251803910 +0000 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-05-16 21:27:00.878587529 +0000 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-05-16 21:27:00.878587529 +0000 2024-05-16T21:31:26.991 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-05-16 21:27:00.878587529 +0000 2024-05-16T21:31:26.992 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-16T21:31:27.053 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-05-16T21:31:27.053 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-05-16T21:31:27.053 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 8.2178e-05 s, 6.2 MB/s 2024-05-16T21:31:27.054 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-16T21:31:27.109 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-05-16 21:30:53.251803910 +0000 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-05-16 21:27:01.197581603 +0000 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-05-16 21:27:01.197581603 +0000 2024-05-16T21:31:27.164 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-05-16 21:27:01.197581603 +0000 2024-05-16T21:31:27.165 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-16T21:31:27.226 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-05-16T21:31:27.226 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-05-16T21:31:27.226 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000108627 s, 4.7 MB/s 2024-05-16T21:31:27.227 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-16T21:31:27.282 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:27.282 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-16T21:31:27.282 INFO:tasks.ceph:Generating config... 2024-05-16T21:31:27.284 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-16T21:31:27.284 INFO:tasks.ceph:[client] debug client = 20 2024-05-16T21:31:27.284 INFO:tasks.ceph:[client] debug ms = 1 2024-05-16T21:31:27.284 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-16T21:31:27.284 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-16T21:31:27.284 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-05-16T21:31:27.284 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-16T21:31:27.284 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-16T21:31:27.284 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-16T21:31:27.284 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-16T21:31:27.284 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-16T21:31:27.284 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-16T21:31:27.285 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-16T21:31:27.285 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-16T21:31:27.285 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-16T21:31:27.286 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-16T21:31:27.287 INFO:tasks.ceph:Setting up mon.a... 2024-05-16T21:31:27.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-16T21:31:27.367 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-05-16T21:31:27.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-16T21:31:27.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-16T21:31:27.452 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.157'), ('mon.c', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]')] 2024-05-16T21:31:27.452 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-16T21:31:27.453 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:27.453 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-16T21:31:27.508 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.157 --addv c '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:27.606 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:27.606 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 4223c61e-038a-4696-b0eb-6b69d601e381 2024-05-16T21:31:27.606 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-05-16T21:31:27.606 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-05-16T21:31:27.606 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 4223c61e-038a-4696-b0eb-6b69d601e381 2024-05-16T21:31:27.607 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-05-16T21:31:27.605409+0000 2024-05-16T21:31:27.607 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-05-16T21:31:27.605409+0000 2024-05-16T21:31:27.607 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 17 (quincy) 2024-05-16T21:31:27.607 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-05-16T21:31:27.607 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-05-16T21:31:27.607 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-05-16T21:31:27.607 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-05-16T21:31:27.607 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-16T21:31:27.608 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-16T21:31:27.623 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4223c61e-038a-4696-b0eb-6b69d601e381... 2024-05-16T21:31:27.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-16T21:31:27.666 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-16T21:31:27.668 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-16T21:31:27.705 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-05-16T21:31:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-05-16T21:31:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-16T21:31:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-05-16T21:31:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-05-16T21:31:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-05-16T21:31:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-05-16T21:31:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn min per osd = 0 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 4223c61e-038a-4696-b0eb-6b69d601e381 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-05-16T21:31:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-05-16T21:31:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2024-05-16T21:31:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-05-16T21:31:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-05-16T21:31:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon down mkfs grace = 300 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-05-16T21:31:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-05-16T21:31:27.716 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-05-16T21:31:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-05-16T21:31:27.719 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.720 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-16T21:31:27.721 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.5,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn min per osd = 0 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on skipped message = False 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 4223c61e-038a-4696-b0eb-6b69d601e381 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-05-16T21:31:27.722 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-05-16T21:31:27.723 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: bdev async discard = True 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: bdev enable discard = True 2024-05-16T21:31:27.724 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore allocator = bitmap 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 1/20 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 20 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 4/10 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.725 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-05-16T21:31:27.726 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.727 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: mon down mkfs grace = 300 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2024-05-16T21:31:27.728 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-16T21:31:27.729 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2024-05-16T21:31:27.730 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2024-05-16T21:31:27.730 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2024-05-16T21:31:27.730 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2024-05-16T21:31:27.730 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-05-16T21:31:27.730 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-05-16T21:31:27.730 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-05-16T21:31:27.805 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-05-16T21:31:27.805 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-05-16T21:31:27.805 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-16T21:31:27.805 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-05-16T21:31:27.805 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.805 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.806 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-16T21:31:27.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.5,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn min per osd = 0 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on skipped message = False 2024-05-16T21:31:27.808 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = 4223c61e-038a-4696-b0eb-6b69d601e381 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-05-16T21:31:27.809 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.810 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore allocator = bitmap 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 1/20 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 20 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 4/10 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-05-16T21:31:27.811 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-16T21:31:27.812 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-05-16T21:31:27.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: mon down mkfs grace = 300 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-16T21:31:27.814 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-16T21:31:27.815 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-05-16T21:31:27.816 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-05-16T21:31:27.816 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-05-16T21:31:27.816 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-05-16T21:31:27.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-05-16T21:31:27.816 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-05-16T21:31:27.816 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-05-16T21:31:27.838 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-16T21:31:27.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-16T21:31:27.903 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-16T21:31:27.903 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:27.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-16T21:31:27.918 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:27.918 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-16T21:31:27.973 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T21:31:27.973 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:27.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-16T21:31:27.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-16T21:31:28.047 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:28.047 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:28.101 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T21:31:28.101 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:28.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-16T21:31:28.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-16T21:31:28.135 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:28.135 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:28.190 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-05-16T21:31:28.190 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:31:28.190 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-16T21:31:28.190 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-16T21:31:28.299 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:31:28.299 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:28.393 INFO:tasks.ceph:Setting up mon nodes... 2024-05-16T21:31:28.394 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-16T21:31:28.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-16T21:31:28.453 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-16T21:31:28.456 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-16T21:31:28.540 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-16T21:31:28.544 INFO:tasks.ceph:Setting up mds nodes... 2024-05-16T21:31:28.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-16T21:31:28.603 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-16T21:31:28.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-16T21:31:28.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-16T21:31:28.729 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-16T21:31:28.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-16T21:31:28.757 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-16T21:31:28.816 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-16T21:31:28.819 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-16T21:31:28.842 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-16T21:31:28.842 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-16T21:31:29.075 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-16T21:31:29.135 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-16T21:31:29.135 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-16T21:31:29.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-16T21:31:29.160 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:29.160 INFO:tasks.ceph:role: osd.0 2024-05-16T21:31:29.161 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T21:31:29.161 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-16T21:31:29.224 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T21:31:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T21:31:29.224 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T21:31:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T21:31:29.225 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T21:31:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-05-16T21:31:29.225 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T21:31:29.225 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T21:31:29.225 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T21:31:29.225 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T21:31:29.256 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-05-16T21:31:29.258 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-05-16T21:31:29.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-16T21:31:29.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-16T21:31:29.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-16T21:31:29.460 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:29.461 INFO:tasks.ceph:role: osd.1 2024-05-16T21:31:29.461 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T21:31:29.461 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-16T21:31:29.524 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T21:31:29.524 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T21:31:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T21:31:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T21:31:29.525 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T21:31:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-05-16T21:31:29.525 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T21:31:29.525 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T21:31:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T21:31:29.525 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T21:31:29.557 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-05-16T21:31:29.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-05-16T21:31:29.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-16T21:31:29.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-16T21:31:29.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-16T21:31:29.761 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:29.761 INFO:tasks.ceph:role: osd.2 2024-05-16T21:31:29.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T21:31:29.761 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-16T21:31:29.825 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T21:31:29.826 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T21:31:29.859 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-05-16T21:31:29.861 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-05-16T21:31:29.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-16T21:31:29.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-16T21:31:30.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-16T21:31:30.065 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:30.066 INFO:tasks.ceph:role: osd.3 2024-05-16T21:31:30.066 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T21:31:30.066 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-16T21:31:30.129 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T21:31:30.129 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T21:31:30.129 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T21:31:30.129 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T21:31:30.129 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T21:31:30.129 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-05-16T21:31:30.129 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T21:31:30.130 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T21:31:30.130 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T21:31:30.130 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T21:31:30.162 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-05-16T21:31:30.164 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-05-16T21:31:30.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-16T21:31:30.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-16T21:31:30.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:30.396+0000 7fb3e04fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-16T21:31:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:30.396+0000 7fb3e04fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-16T21:31:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:30.396+0000 7fb3e04fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-16T21:31:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:30.396+0000 7fb3e04fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-16T21:31:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:30.396+0000 7fb3e04fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-16T21:31:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:30.397+0000 7fb3e04fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-16T21:31:33.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-16T21:31:33.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:33.388+0000 7f752c7c2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-16T21:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:33.388+0000 7f752c7c2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-16T21:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:33.388+0000 7f752c7c2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-16T21:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:33.388+0000 7f752c7c2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-16T21:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:33.388+0000 7f752c7c2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-16T21:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:33.389+0000 7f752c7c2640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-16T21:31:36.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-16T21:31:36.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:36.397+0000 7fe6c64f0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-16T21:31:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:36.397+0000 7fe6c64f0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-16T21:31:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:36.397+0000 7fe6c64f0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-16T21:31:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:36.397+0000 7fe6c64f0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-16T21:31:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:36.397+0000 7fe6c64f0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-16T21:31:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:36.397+0000 7fe6c64f0640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-16T21:31:39.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-16T21:31:39.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:39.384+0000 7f163d7af640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-16T21:31:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:39.384+0000 7f163d7af640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-16T21:31:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:39.384+0000 7f163d7af640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-16T21:31:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:39.384+0000 7f163d7af640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-16T21:31:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:39.384+0000 7f163d7af640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-16T21:31:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:39.384+0000 7f163d7af640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-16T21:31:42.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-16T21:31:42.264 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-16T21:31:42.294 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:42.294 INFO:tasks.ceph:role: osd.4 2024-05-16T21:31:42.294 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T21:31:42.294 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-16T21:31:42.360 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T21:31:42.361 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T21:31:42.393 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-05-16T21:31:42.447 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-05-16T21:31:42.448 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-16T21:31:42.518 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-16T21:31:42.587 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-16T21:31:42.651 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:42.651 INFO:tasks.ceph:role: osd.5 2024-05-16T21:31:42.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T21:31:42.652 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-16T21:31:42.714 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T21:31:42.714 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T21:31:42.714 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T21:31:42.715 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T21:31:42.715 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T21:31:42.715 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-05-16T21:31:42.715 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T21:31:42.715 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T21:31:42.715 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T21:31:42.715 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T21:31:42.747 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-05-16T21:31:42.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-05-16T21:31:42.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-16T21:31:42.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-16T21:31:42.885 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-16T21:31:42.949 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:42.949 INFO:tasks.ceph:role: osd.6 2024-05-16T21:31:42.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T21:31:42.949 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-16T21:31:43.014 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T21:31:43.014 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T21:31:43.014 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T21:31:43.015 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T21:31:43.015 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T21:31:43.015 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-05-16T21:31:43.015 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T21:31:43.015 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T21:31:43.015 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T21:31:43.015 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T21:31:43.046 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-05-16T21:31:43.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-05-16T21:31:43.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-16T21:31:43.115 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-16T21:31:43.182 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-16T21:31:43.246 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T21:31:43.246 INFO:tasks.ceph:role: osd.7 2024-05-16T21:31:43.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T21:31:43.246 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-16T21:31:43.309 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T21:31:43.309 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T21:31:43.309 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T21:31:43.310 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T21:31:43.310 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T21:31:43.310 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-05-16T21:31:43.310 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T21:31:43.310 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T21:31:43.310 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T21:31:43.310 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T21:31:43.341 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-05-16T21:31:43.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-05-16T21:31:43.343 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-16T21:31:43.415 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-16T21:31:43.483 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:43.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:43.580+0000 7f8d47611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-16T21:31:43.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:43.581+0000 7f8d47611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-16T21:31:43.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:43.581+0000 7f8d47611640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-16T21:31:43.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:43.581+0000 7f8d47611640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-16T21:31:43.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:43.581+0000 7f8d47611640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-16T21:31:43.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:43.581+0000 7f8d47611640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-16T21:31:46.434 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-16T21:31:46.461 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:46.556+0000 7f705440f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-16T21:31:46.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:46.557+0000 7f705440f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-16T21:31:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:46.557+0000 7f705440f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-16T21:31:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:46.557+0000 7f705440f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-16T21:31:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:46.557+0000 7f705440f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-16T21:31:46.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:46.557+0000 7f705440f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-16T21:31:49.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-16T21:31:49.433 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:49.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:49.528+0000 7f0f3140f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-16T21:31:49.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:49.529+0000 7f0f3140f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-16T21:31:49.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:49.529+0000 7f0f3140f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-16T21:31:49.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:49.529+0000 7f0f3140f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-16T21:31:49.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:49.529+0000 7f0f3140f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-16T21:31:49.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:49.529+0000 7f0f3140f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-16T21:31:52.374 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-16T21:31:52.400 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:52.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:52.496+0000 7f3d08610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-16T21:31:52.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:52.496+0000 7f3d08610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-16T21:31:52.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:52.496+0000 7f3d08610640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-16T21:31:52.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:52.496+0000 7f3d08610640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-16T21:31:52.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:52.496+0000 7f3d08610640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-16T21:31:52.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:52.496+0000 7f3d08610640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-16T21:31:55.346 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-16T21:31:55.374 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-16T21:31:55.374 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:55.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-16T21:31:55.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:55.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-16T21:31:55.474 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:55.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-16T21:31:55.542 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:55.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-16T21:31:55.608 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:55.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-16T21:31:55.674 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:55.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-16T21:31:55.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:55.718 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:55.722 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:31:55.740 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:55.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-16T21:31:55.833 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:55.833 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-16T21:31:55.861 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:55.861 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-16T21:31:55.929 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:55.929 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-16T21:31:55.995 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:55.996 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-16T21:31:56.061 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:56.062 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-16T21:31:56.126 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:56.126 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-16T21:31:56.190 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:31:56.190 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-16T21:31:56.245 INFO:tasks.ceph:Adding keys to all mons... 2024-05-16T21:31:56.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-16T21:31:56.247 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQAwe0Zm7jz5GhAAWjyGahKoqSjedU6is2lhBQ== 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQAwe0ZmWOztIxAALEzX4EJJcrGCP7ZoZ/HKgA== 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQAwe0Zmqx5zKxAAcFLKr5c1bAYjCHYue1BIIw== 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQAye0ZmdkSvFxAA5+pykmX9PyzAFWdUwe/dCg== 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-05-16T21:31:56.270 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQA1e0ZmHAEzFxAAR/4LYW0ce5/kt+sQIGtRCQ== 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQA4e0ZmiV+2FxAA7jAztuHwMHlMMRORi+es0Q== 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQA7e0ZmMrfwFhAA3/m/SekhouAzfw647Cgcrg== 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQAwe0ZmkHgyIBAAkoin2vsL2eoaz/QSlB72Pw== 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQAwe0ZmQxKaMBAAj7Rge1mcAmfVKbNfu7fwRg== 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQA/e0ZmeRy4IhAA/JFx42eT7j6uAHRIsP35Tw== 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBCe0ZmF6NJIRAAdbIwZRW9OCyVwbiycii3ug== 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2024-05-16T21:31:56.271 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBFe0ZmzhyfHxAAX8zeKuN/kboQKumY+LNXag== 2024-05-16T21:31:56.272 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2024-05-16T21:31:56.272 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBIe0ZmXi2qHRAAiIb4iVEEqACfG78J7II+Dg== 2024-05-16T21:31:56.272 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-05-16T21:31:56.272 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQAxe0ZmPwp5BBAApGZXcUeCgiYeu7NGIhsvXg== 2024-05-16T21:31:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-05-16T21:31:56.273 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwe0Zm7jz5GhAAWjyGahKoqSjedU6is2lhBQ== 2024-05-16T21:31:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-05-16T21:31:56.273 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwe0ZmWOztIxAALEzX4EJJcrGCP7ZoZ/HKgA== 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwe0Zmqx5zKxAAcFLKr5c1bAYjCHYue1BIIw== 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAye0ZmdkSvFxAA5+pykmX9PyzAFWdUwe/dCg== 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA1e0ZmHAEzFxAAR/4LYW0ce5/kt+sQIGtRCQ== 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA4e0ZmiV+2FxAA7jAztuHwMHlMMRORi+es0Q== 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA7e0ZmMrfwFhAA3/m/SekhouAzfw647Cgcrg== 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-05-16T21:31:56.274 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwe0ZmkHgyIBAAkoin2vsL2eoaz/QSlB72Pw== 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwe0ZmQxKaMBAAj7Rge1mcAmfVKbNfu7fwRg== 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA/e0ZmeRy4IhAA/JFx42eT7j6uAHRIsP35Tw== 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBCe0ZmF6NJIRAAdbIwZRW9OCyVwbiycii3ug== 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBFe0ZmzhyfHxAAX8zeKuN/kboQKumY+LNXag== 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBIe0ZmXi2qHRAAiIb4iVEEqACfG78J7II+Dg== 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-05-16T21:31:56.275 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAxe0ZmPwp5BBAApGZXcUeCgiYeu7NGIhsvXg== 2024-05-16T21:31:56.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-16T21:31:56.316 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-16T21:31:56.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T21:31:56.381 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T21:31:56.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T21:31:56.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T21:31:56.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.509 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.572 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.632 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.693 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-16T21:31:56.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-16T21:31:56.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T21:31:56.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T21:31:56.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.940 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:56.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:57.002 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:57.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:57.063 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T21:31:57.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-16T21:31:57.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-16T21:31:57.186 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-16T21:31:57.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-16T21:31:57.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-16T21:31:57.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-16T21:31:57.339 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-16T21:31:57.362 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-16T21:31:57.467 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-16T21:31:57.490 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-16T21:31:57.553 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-16T21:31:57.656 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-16T21:31:57.680 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:57.682 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-16T21:31:57.734 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-16T21:31:57.735 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-16T21:31:57.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-16T21:31:57.738 INFO:tasks.ceph.mon.a:Started 2024-05-16T21:31:57.738 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-16T21:31:57.738 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-16T21:31:57.777 INFO:tasks.ceph.mon.b:Started 2024-05-16T21:31:57.777 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-16T21:31:57.777 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-16T21:31:57.779 INFO:tasks.ceph.mon.c:Started 2024-05-16T21:31:57.779 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-16T21:31:57.779 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-16T21:31:57.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-16T21:31:57.782 INFO:tasks.ceph.mgr.y:Started 2024-05-16T21:31:57.783 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-16T21:31:57.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-16T21:31:57.786 INFO:tasks.ceph.mgr.x:Started 2024-05-16T21:31:57.786 INFO:tasks.ceph:Setting crush tunables to default 2024-05-16T21:31:57.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-05-16T21:31:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.899+0000 7f0884dce640 1 Processor -- start 2024-05-16T21:31:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.899+0000 7f0884dce640 1 -- start start 2024-05-16T21:31:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.900+0000 7f0884dce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 0x7f0880146470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.900+0000 7f0884dce640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0880150320 0x7f0880156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.900+0000 7f0884dce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08800bbc10 con 0x7f088006d6f0 2024-05-16T21:31:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.900+0000 7f0884dce640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f088014f780 con 0x7f0880150320 2024-05-16T21:31:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.900+0000 7f0884dce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0880073520 con 0x7f08800bc630 2024-05-16T21:31:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f088006d6f0 0x7f088014fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59848/0 (socket says 172.21.15.5:59848) 2024-05-16T21:31:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087dd9b640 1 -- 172.21.15.5:0/3200720598 learned_addr learned my addr 172.21.15.5:0/3200720598 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087ed9d640 1 --2- 172.21.15.5:0/3200720598 >> v2:172.21.15.157:3300/0 conn(0x7f0880150320 0x7f0880156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087e59c640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 0x7f0880146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087ed9d640 1 -- 172.21.15.5:0/3200720598 >> v2:172.21.15.157:3300/0 conn(0x7f0880150320 msgr2=0x7f0880156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087ed9d640 1 -- 172.21.15.5:0/3200720598 >> v2:172.21.15.157:3300/0 conn(0x7f0880150320 msgr2=0x7f0880156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087ed9d640 1 --2- 172.21.15.5:0/3200720598 >> v2:172.21.15.157:3300/0 conn(0x7f0880150320 0x7f0880156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087e59c640 1 -- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 msgr2=0x7f0880146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087e59c640 1 -- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 msgr2=0x7f0880146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087e59c640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 0x7f0880146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087e59c640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 0x7f0880146470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-16T21:31:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:57.901+0000 7f087ed9d640 1 --2- 172.21.15.5:0/3200720598 >> v2:172.21.15.157:3300/0 conn(0x7f0880150320 0x7f0880156a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-16T21:31:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.057+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706184641 0 0) 0x7f08800bbc10 con 0x7f088006d6f0 2024-05-16T21:31:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.057+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c003520 con 0x7f088006d6f0 2024-05-16T21:31:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1617691396 0 0) 0x7f086c003520 con 0x7f088006d6f0 2024-05-16T21:31:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 msgr2=0x7f0880146470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 0x7f0880146470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 >> v2:172.21.15.157:3300/0 conn(0x7f0880150320 msgr2=0x7f0880156a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 --2- 172.21.15.5:0/3200720598 >> v2:172.21.15.157:3300/0 conn(0x7f0880150320 0x7f0880156a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0880073800 con 0x7f088006d6f0 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f08680016f0 con 0x7f088006d6f0 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 >> v1:172.21.15.5:6789/0 conn(0x7f088006d6f0 legacy=0x7f088014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f086c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 0x7f086c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086c004d40 0x7f086c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f088014f780 con 0x7f086c004d40 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0880073520 con 0x7f086c003a00 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f086c00bba0 con 0x7f08800bc630 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087e59c640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f086c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087dd9b640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 0x7f086c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.058+0000 7f087ed9d640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086c004d40 0x7f086c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.059+0000 7f087e59c640 1 -- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 msgr2=0x7f086c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.059+0000 7f087e59c640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08800bc630 0x7f086c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.059+0000 7f087e59c640 1 -- 172.21.15.5:0/3200720598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086c004d40 msgr2=0x7f086c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.059+0000 7f087e59c640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086c004d40 0x7f086c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.059+0000 7f087e59c640 1 -- 172.21.15.5:0/3200720598 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c003520 con 0x7f086c003a00 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.060+0000 7f087e59c640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f086c003e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f087800b9e0 tx=0x7f086c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24842eaa321723e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.060+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878030070 con 0x7f086c003a00 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.060+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087802ada0 con 0x7f086c003a00 2024-05-16T21:31:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.060+0000 7f087d59a640 1 -- 172.21.15.5:0/3200720598 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087800b5e0 con 0x7f086c003a00 2024-05-16T21:31:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.061+0000 7f0884dce640 1 -- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 msgr2=0x7f086c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.061+0000 7f0884dce640 1 --2- 172.21.15.5:0/3200720598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f086c003e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f087800b9e0 tx=0x7f086c005830 comp rx=0 tx=0).stop 2024-05-16T21:31:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.061+0000 7f087ed9d640 1 -- 172.21.15.5:0/3200720598 reap_dead start 2024-05-16T21:31:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.061+0000 7f0884dce640 1 -- 172.21.15.5:0/3200720598 shutdown_connections 2024-05-16T21:31:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.061+0000 7f0884dce640 1 -- 172.21.15.5:0/3200720598 >> 172.21.15.5:0/3200720598 conn(0x7f088006f580 msgr2=0x7f088006f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.061+0000 7f0884dce640 1 -- 172.21.15.5:0/3200720598 shutdown_connections 2024-05-16T21:31:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.061+0000 7f0884dce640 1 -- 172.21.15.5:0/3200720598 wait complete. 2024-05-16T21:31:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.063+0000 7f0884dce640 1 Processor -- start 2024-05-16T21:31:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.063+0000 7f0884dce640 1 -- start start 2024-05-16T21:31:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f0884dce640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f08801d7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f0884dce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08801476b0 0x7f0880148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f0884dce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08801e5ce0 0x7f08801e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f0884dce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0880074610 con 0x7f08801476b0 2024-05-16T21:31:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f0884dce640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0880073140 con 0x7f086c003a00 2024-05-16T21:31:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f0884dce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0880149370 con 0x7f08801e5ce0 2024-05-16T21:31:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08801476b0 0x7f0880148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087e59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f08801d7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08801476b0 0x7f0880148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35158/0 (socket says 172.21.15.5:35158) 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 -- 172.21.15.5:0/2859330226 learned_addr learned my addr 172.21.15.5:0/2859330226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087e59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f08801d7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:54726/0 (socket says 172.21.15.5:54726) 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087ed9d640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08801e5ce0 0x7f08801e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 -- 172.21.15.5:0/2859330226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08801e5ce0 msgr2=0x7f08801e60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08801e5ce0 0x7f08801e60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 -- 172.21.15.5:0/2859330226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 msgr2=0x7f08801d7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f08801d7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 -- 172.21.15.5:0/2859330226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08801d8180 con 0x7f08801476b0 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087e59c640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f08801d7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.065+0000 7f087dd9b640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08801476b0 0x7f0880148960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0880071e10 tx=0x7f0868007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.066+0000 7f0876ffd640 1 -- 172.21.15.5:0/2859330226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086800f990 con 0x7f08801476b0 2024-05-16T21:31:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.066+0000 7f0876ffd640 1 -- 172.21.15.5:0/2859330226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0868018070 con 0x7f08801476b0 2024-05-16T21:31:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.066+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0880148ea0 con 0x7f08801476b0 2024-05-16T21:31:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.066+0000 7f0876ffd640 1 -- 172.21.15.5:0/2859330226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086800fdb0 con 0x7f08801476b0 2024-05-16T21:31:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.066+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08801481a0 con 0x7f08801476b0 2024-05-16T21:31:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.066+0000 7f0876ffd640 1 -- 172.21.15.5:0/2859330226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f086801d460 con 0x7f08801476b0 2024-05-16T21:31:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.066+0000 7f0876ffd640 1 -- 172.21.15.5:0/2859330226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0868013580 con 0x7f08801476b0 2024-05-16T21:31:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.067+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0880069b50 con 0x7f08801476b0 2024-05-16T21:31:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.069+0000 7f0876ffd640 1 -- 172.21.15.5:0/2859330226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f08680137d0 con 0x7f08801476b0 2024-05-16T21:31:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.136+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f088014d0a0 con 0x7f08801476b0 2024-05-16T21:31:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.137+0000 7f0876ffd640 1 -- 172.21.15.5:0/2859330226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f08680139b0 con 0x7f08801476b0 2024-05-16T21:31:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-05-16T21:31:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08801476b0 msgr2=0x7f0880148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08801476b0 0x7f0880148960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0880071e10 tx=0x7f0868007660 comp rx=0 tx=0).stop 2024-05-16T21:31:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 shutdown_connections 2024-05-16T21:31:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08801e5ce0 0x7f08801e60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08801476b0 0x7f0880148960 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 --2- 172.21.15.5:0/2859330226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f086c003a00 0x7f08801d7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 >> 172.21.15.5:0/2859330226 conn(0x7f088006f580 msgr2=0x7f0880144e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 shutdown_connections 2024-05-16T21:31:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:31:58.138+0000 7f0884dce640 1 -- 172.21.15.5:0/2859330226 wait complete. 2024-05-16T21:31:58.151 INFO:tasks.ceph:check_enable_crimson: False 2024-05-16T21:31:58.152 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-16T21:31:58.152 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:58.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-16T21:31:58.162 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:58.160+0000 7ff3a5634040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-16T21:31:58.175 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:58.174+0000 7f2bf2f1c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-16T21:31:58.176 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:58.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-16T21:31:58.241 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:58.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-16T21:31:58.305 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:58.303+0000 7ff3a5634040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-16T21:31:58.306 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-05-16T21:31:58.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-16T21:31:58.331 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:58.330+0000 7f2bf2f1c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-16T21:31:58.355 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:58.355 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-16T21:31:58.358 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:58.355+0000 7ff3a5634040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-16T21:31:58.378 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:58.379 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-16T21:31:58.389 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:58.387+0000 7f2bf2f1c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-16T21:31:58.441 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:58.441 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-16T21:31:58.504 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-16T21:31:58.505 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-16T21:31:58.567 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 40b0bbbf-ea89-4e11-95c8-1b6172a5cc26 0 2024-05-16T21:31:58.607 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:58.605+0000 7ff3a5634040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-16T21:31:58.638 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:58.636+0000 7f2bf2f1c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-16T21:31:58.655 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:58.653+0000 7ff3a5634040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-16T21:31:58.686 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:58.684+0000 7f2bf2f1c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-16T21:31:58.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.713+0000 7f0439f3f640 1 Processor -- start 2024-05-16T21:31:58.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.713+0000 7f0439f3f640 1 -- start start 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.714+0000 7f0439f3f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0434148770 0x7f043406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.714+0000 7f0439f3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f043409fd50 0x7f04340bc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.714+0000 7f0439f3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04340bcde0 0x7f04341519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.714+0000 7f0439f3f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f043414e4c0 con 0x7f04340bcde0 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.714+0000 7f0439f3f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f043414ed60 con 0x7f0434148770 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.714+0000 7f0439f3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f04340bdf40 con 0x7f043409fd50 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f042bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f043409fd50 0x7f04340bc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f04337fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0434148770 0x7f043406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f042bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f043409fd50 0x7f04340bc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49348/0 (socket says 172.21.15.157:49348) 2024-05-16T21:31:58.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f04337fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0434148770 0x7f043406d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48402/0 (socket says 172.21.15.157:48402) 2024-05-16T21:31:58.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f042bfff640 1 -- 172.21.15.157:0/598618658 learned_addr learned my addr 172.21.15.157:0/598618658 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:58.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f0433fff640 1 --2- 172.21.15.157:0/598618658 >> v2:172.21.15.5:3300/0 conn(0x7f04340bcde0 0x7f04341519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f042bfff640 1 -- 172.21.15.157:0/598618658 >> v2:172.21.15.157:3300/0 conn(0x7f0434148770 msgr2=0x7f043406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:58.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f042bfff640 1 --2- 172.21.15.157:0/598618658 >> v2:172.21.15.157:3300/0 conn(0x7f0434148770 0x7f043406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f042bfff640 1 -- 172.21.15.157:0/598618658 >> v2:172.21.15.5:3300/0 conn(0x7f04340bcde0 msgr2=0x7f04341519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:58.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f042bfff640 1 --2- 172.21.15.157:0/598618658 >> v2:172.21.15.5:3300/0 conn(0x7f04340bcde0 0x7f04341519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f042bfff640 1 -- 172.21.15.157:0/598618658 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043414e710 con 0x7f043409fd50 2024-05-16T21:31:58.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f04337fe640 1 --2- 172.21.15.157:0/598618658 >> v2:172.21.15.157:3300/0 conn(0x7f0434148770 0x7f043406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:58.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.715+0000 7f0433fff640 1 --2- 172.21.15.157:0/598618658 >> v2:172.21.15.5:3300/0 conn(0x7f04340bcde0 0x7f04341519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:31:58.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.716+0000 7f042bfff640 1 --2- 172.21.15.157:0/598618658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f043409fd50 0x7f04340bc8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f04340c1720 tx=0x7f041c02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7e2b88acc0c404 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:58.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.716+0000 7f0432ffd640 1 -- 172.21.15.157:0/598618658 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c037070 con 0x7f043409fd50 2024-05-16T21:31:58.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.716+0000 7f0432ffd640 1 -- 172.21.15.157:0/598618658 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c032440 con 0x7f043409fd50 2024-05-16T21:31:58.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.716+0000 7f0432ffd640 1 -- 172.21.15.157:0/598618658 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c032810 con 0x7f043409fd50 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 -- 172.21.15.157:0/598618658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f043409fd50 msgr2=0x7f04340bc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 --2- 172.21.15.157:0/598618658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f043409fd50 0x7f04340bc8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f04340c1720 tx=0x7f041c02a1e0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 -- 172.21.15.157:0/598618658 shutdown_connections 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 --2- 172.21.15.157:0/598618658 >> v2:172.21.15.5:3300/0 conn(0x7f04340bcde0 0x7f04341519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 --2- 172.21.15.157:0/598618658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f043409fd50 0x7f04340bc8a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 --2- 172.21.15.157:0/598618658 >> v2:172.21.15.157:3300/0 conn(0x7f0434148770 0x7f043406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 -- 172.21.15.157:0/598618658 >> 172.21.15.157:0/598618658 conn(0x7f04340a3570 msgr2=0x7f04340a3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 -- 172.21.15.157:0/598618658 shutdown_connections 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.717+0000 7f0439f3f640 1 -- 172.21.15.157:0/598618658 wait complete. 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.718+0000 7f0439f3f640 1 Processor -- start 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.718+0000 7f0439f3f640 1 -- start start 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.719+0000 7f0439f3f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f043409fd50 0x7f04341e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.719+0000 7f0439f3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0434148770 0x7f04340bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.719+0000 7f0439f3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04340b7860 0x7f0434143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.719+0000 7f0439f3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f043414f1f0 con 0x7f0434148770 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.719+0000 7f0439f3f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0434148b80 con 0x7f043409fd50 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.719+0000 7f0439f3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f04341e7fc0 con 0x7f04340b7860 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f0433fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04340b7860 0x7f0434143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f04337fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f043409fd50 0x7f04341e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f0433fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04340b7860 0x7f0434143a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49360/0 (socket says 172.21.15.157:49360) 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f0433fff640 1 -- 172.21.15.157:0/4061181480 learned_addr learned my addr 172.21.15.157:0/4061181480 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f04337fe640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f043409fd50 0x7f04341e7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48418/0 (socket says 172.21.15.157:48418) 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f042bfff640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0434148770 0x7f04340bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f04337fe640 1 -- 172.21.15.157:0/4061181480 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04340b7860 msgr2=0x7f0434143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f04337fe640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04340b7860 0x7f0434143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f04337fe640 1 -- 172.21.15.157:0/4061181480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0434148770 msgr2=0x7f04340bf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f04337fe640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0434148770 0x7f04340bf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f04337fe640 1 -- 172.21.15.157:0/4061181480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04340bfce0 con 0x7f043409fd50 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f04337fe640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f043409fd50 0x7f04341e7a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f042400e840 tx=0x7f042400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f0430ff9640 1 -- 172.21.15.157:0/4061181480 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424017070 con 0x7f043409fd50 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f0430ff9640 1 -- 172.21.15.157:0/4061181480 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042400c940 con 0x7f043409fd50 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04340a4bc0 con 0x7f043409fd50 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f0430ff9640 1 -- 172.21.15.157:0/4061181480 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042400cd10 con 0x7f043409fd50 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.720+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04340a5140 con 0x7f043409fd50 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.721+0000 7f0430ff9640 1 -- 172.21.15.157:0/4061181480 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f042401a070 con 0x7f043409fd50 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.721+0000 7f0430ff9640 1 -- 172.21.15.157:0/4061181480 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f042401c790 con 0x7f043409fd50 2024-05-16T21:31:58.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.721+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04340a5380 con 0x7f043409fd50 2024-05-16T21:31:58.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.724+0000 7f0430ff9640 1 -- 172.21.15.157:0/4061181480 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f04340a5380 con 0x7f043409fd50 2024-05-16T21:31:58.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.796+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "40b0bbbf-ea89-4e11-95c8-1b6172a5cc26", "id": 0} v 0) -- 0x7f0434069b50 con 0x7f043409fd50 2024-05-16T21:31:58.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.800+0000 7f0430ff9640 1 -- 172.21.15.157:0/4061181480 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40b0bbbf-ea89-4e11-95c8-1b6172a5cc26", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f042401c9e0 con 0x7f043409fd50 2024-05-16T21:31:58.802 INFO:teuthology.orchestra.run.smithi157.stdout:0 2024-05-16T21:31:58.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f043409fd50 msgr2=0x7f04341e7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f043409fd50 0x7f04341e7a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f042400e840 tx=0x7f042400ed00 comp rx=0 tx=0).stop 2024-05-16T21:31:58.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 shutdown_connections 2024-05-16T21:31:58.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04340b7860 0x7f0434143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0434148770 0x7f04340bf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 --2- 172.21.15.157:0/4061181480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f043409fd50 0x7f04341e7a60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 >> 172.21.15.157:0/4061181480 conn(0x7f04340a3570 msgr2=0x7f0434146bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 shutdown_connections 2024-05-16T21:31:58.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.801+0000 7f0439f3f640 1 -- 172.21.15.157:0/4061181480 wait complete. 2024-05-16T21:31:58.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new e53ef5cc-2a70-418c-b2fa-ea6e25c94912 1 2024-05-16T21:31:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.924+0000 7f25104b6640 1 Processor -- start 2024-05-16T21:31:58.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.924+0000 7f25104b6640 1 -- start start 2024-05-16T21:31:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f25104b6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25080bf330 0x7f250806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f25104b6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2508073510 0x7f2508151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f25104b6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f250806ce00 con 0x7f2508073100 2024-05-16T21:31:58.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f25104b6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2508151860 con 0x7f25080bf330 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f25104b6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f25080bf8a0 con 0x7f2508073510 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f250ea53640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2508073510 0x7f2508151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f250ea53640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2508073510 0x7f2508151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48432/0 (socket says 172.21.15.157:48432) 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f250ea53640 1 -- 172.21.15.157:0/2000521524 learned_addr learned my addr 172.21.15.157:0/2000521524 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f250da51640 1 --1- 172.21.15.157:0/2000521524 >> v1:172.21.15.157:6789/0 conn(0x7f2508073100 0x7f2508148200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:52820/0 (socket says 172.21.15.157:52820) 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.925+0000 7f250e252640 1 --2- 172.21.15.157:0/2000521524 >> v2:172.21.15.5:3300/0 conn(0x7f25080bf330 0x7f250806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.926+0000 7f250ea53640 1 -- 172.21.15.157:0/2000521524 >> v2:172.21.15.5:3300/0 conn(0x7f25080bf330 msgr2=0x7f250806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.926+0000 7f250ea53640 1 --2- 172.21.15.157:0/2000521524 >> v2:172.21.15.5:3300/0 conn(0x7f25080bf330 0x7f250806c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.926+0000 7f250ea53640 1 -- 172.21.15.157:0/2000521524 >> v1:172.21.15.157:6789/0 conn(0x7f2508073100 legacy=0x7f2508148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.926+0000 7f250ea53640 1 -- 172.21.15.157:0/2000521524 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25080bfb80 con 0x7f2508073510 2024-05-16T21:31:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.926+0000 7f250ea53640 1 --2- 172.21.15.157:0/2000521524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073510 0x7f2508151cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f250814f2c0 tx=0x7f250002a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8a81882054b713 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f250d250640 1 -- 172.21.15.157:0/2000521524 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500036070 con 0x7f2508073510 2024-05-16T21:31:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f250d250640 1 -- 172.21.15.157:0/2000521524 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2500031600 con 0x7f2508073510 2024-05-16T21:31:58.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f250d250640 1 -- 172.21.15.157:0/2000521524 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25000319f0 con 0x7f2508073510 2024-05-16T21:31:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f25104b6640 1 -- 172.21.15.157:0/2000521524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073510 msgr2=0x7f2508151cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f25104b6640 1 --2- 172.21.15.157:0/2000521524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073510 0x7f2508151cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f250814f2c0 tx=0x7f250002a7c0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f25104b6640 1 -- 172.21.15.157:0/2000521524 shutdown_connections 2024-05-16T21:31:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f25104b6640 1 --2- 172.21.15.157:0/2000521524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073510 0x7f2508151cf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f25104b6640 1 --2- 172.21.15.157:0/2000521524 >> v2:172.21.15.5:3300/0 conn(0x7f25080bf330 0x7f250806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f25104b6640 1 -- 172.21.15.157:0/2000521524 >> 172.21.15.157:0/2000521524 conn(0x7f25080bd1d0 msgr2=0x7f25080bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f25104b6640 1 -- 172.21.15.157:0/2000521524 shutdown_connections 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.927+0000 7f25104b6640 1 -- 172.21.15.157:0/2000521524 wait complete. 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.929+0000 7f25104b6640 1 Processor -- start 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.929+0000 7f25104b6640 1 -- start start 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f25104b6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073100 0x7f2508147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f25104b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25080bf330 0x7f25081e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f25104b6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2508144230 0x7f250813d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f25104b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2508152230 con 0x7f25080bf330 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f25104b6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2508148910 con 0x7f2508073100 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f25104b6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f25081523b0 con 0x7f2508144230 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250e252640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073100 0x7f2508147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250ea53640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2508144230 0x7f250813d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250e252640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073100 0x7f2508147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48436/0 (socket says 172.21.15.157:48436) 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250e252640 1 -- 172.21.15.157:0/357528042 learned_addr learned my addr 172.21.15.157:0/357528042 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250da51640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25080bf330 0x7f25081e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250ea53640 1 -- 172.21.15.157:0/357528042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073100 msgr2=0x7f2508147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250ea53640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073100 0x7f2508147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250ea53640 1 -- 172.21.15.157:0/357528042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25080bf330 msgr2=0x7f25081e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.930+0000 7f250ea53640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25080bf330 0x7f25081e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f250ea53640 1 -- 172.21.15.157:0/357528042 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25081476a0 con 0x7f2508144230 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f250e252640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073100 0x7f2508147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f250ea53640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2508144230 0x7f250813d850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2500030000 tx=0x7f2500004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f24feffd640 1 -- 172.21.15.157:0/357528042 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500036050 con 0x7f2508144230 2024-05-16T21:31:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f24feffd640 1 -- 172.21.15.157:0/357528042 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2500042070 con 0x7f2508144230 2024-05-16T21:31:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25081e49d0 con 0x7f2508144230 2024-05-16T21:31:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f24feffd640 1 -- 172.21.15.157:0/357528042 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500009510 con 0x7f2508144230 2024-05-16T21:31:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25081505d0 con 0x7f2508144230 2024-05-16T21:31:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f24feffd640 1 -- 172.21.15.157:0/357528042 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2500004490 con 0x7f2508144230 2024-05-16T21:31:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.931+0000 7f24feffd640 1 -- 172.21.15.157:0/357528042 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f2500047cb0 con 0x7f2508144230 2024-05-16T21:31:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.932+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2508069b50 con 0x7f2508144230 2024-05-16T21:31:58.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:58.934+0000 7f24feffd640 1 -- 172.21.15.157:0/357528042 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2500047460 con 0x7f2508144230 2024-05-16T21:31:59.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.007+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e53ef5cc-2a70-418c-b2fa-ea6e25c94912", "id": 1} v 0) -- 0x7f25080c0410 con 0x7f2508144230 2024-05-16T21:31:59.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.011+0000 7f24feffd640 1 -- 172.21.15.157:0/357528042 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e53ef5cc-2a70-418c-b2fa-ea6e25c94912", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2500032020 con 0x7f2508144230 2024-05-16T21:31:59.013 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2508144230 msgr2=0x7f250813d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2508144230 0x7f250813d850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2500030000 tx=0x7f2500004a40 comp rx=0 tx=0).stop 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 shutdown_connections 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2508144230 0x7f250813d850 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25080bf330 0x7f25081e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 --2- 172.21.15.157:0/357528042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2508073100 0x7f2508147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 >> 172.21.15.157:0/357528042 conn(0x7f25080bd1d0 msgr2=0x7f2508073510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 shutdown_connections 2024-05-16T21:31:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.012+0000 7f25104b6640 1 -- 172.21.15.157:0/357528042 wait complete. 2024-05-16T21:31:59.026 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 06dca2f1-dc2c-4264-8589-5667e239f106 2 2024-05-16T21:31:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.134+0000 7f1b5e054640 1 Processor -- start 2024-05-16T21:31:59.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.134+0000 7f1b5e054640 1 -- start start 2024-05-16T21:31:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b5e054640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b5814e5f0 0x7f1b580c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b5e054640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580beca0 0x7f1b58158e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b5e054640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b580c1150 con 0x7f1b580bd590 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b5e054640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5814ea00 con 0x7f1b5814e5f0 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b5e054640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5814ecd0 con 0x7f1b580beca0 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580beca0 0x7f1b58158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b4ffff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1b580bd590 0x7f1b580be590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:52834/0 (socket says 172.21.15.157:52834) 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b4ffff640 1 -- 172.21.15.157:0/379158161 learned_addr learned my addr 172.21.15.157:0/379158161 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b577fe640 1 --2- 172.21.15.157:0/379158161 >> v2:172.21.15.5:3300/0 conn(0x7f1b5814e5f0 0x7f1b580c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b56ffd640 1 -- 172.21.15.157:0/379158161 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342182902 0 0) 0x7f1b580c1150 con 0x7f1b580bd590 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b57fff640 1 -- 172.21.15.157:0/379158161 >> v2:172.21.15.5:3300/0 conn(0x7f1b5814e5f0 msgr2=0x7f1b580c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b57fff640 1 --2- 172.21.15.157:0/379158161 >> v2:172.21.15.5:3300/0 conn(0x7f1b5814e5f0 0x7f1b580c0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b57fff640 1 -- 172.21.15.157:0/379158161 >> v1:172.21.15.157:6789/0 conn(0x7f1b580bd590 legacy=0x7f1b580be590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b57fff640 1 -- 172.21.15.157:0/379158161 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5814efb0 con 0x7f1b580beca0 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.135+0000 7f1b577fe640 1 --2- 172.21.15.157:0/379158161 >> v2:172.21.15.5:3300/0 conn(0x7f1b5814e5f0 0x7f1b580c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:31:59.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.136+0000 7f1b57fff640 1 --2- 172.21.15.157:0/379158161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580beca0 0x7f1b58158e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009d90 tx=0x7f1b5002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa37373215385d3f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.136+0000 7f1b56ffd640 1 -- 172.21.15.157:0/379158161 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50007740 con 0x7f1b580beca0 2024-05-16T21:31:59.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.136+0000 7f1b56ffd640 1 -- 172.21.15.157:0/379158161 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b500078e0 con 0x7f1b580beca0 2024-05-16T21:31:59.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.136+0000 7f1b56ffd640 1 -- 172.21.15.157:0/379158161 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50007cb0 con 0x7f1b580beca0 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.137+0000 7f1b5e054640 1 -- 172.21.15.157:0/379158161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580beca0 msgr2=0x7f1b58158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.137+0000 7f1b5e054640 1 --2- 172.21.15.157:0/379158161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580beca0 0x7f1b58158e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009d90 tx=0x7f1b5002a660 comp rx=0 tx=0).stop 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.137+0000 7f1b5e054640 1 -- 172.21.15.157:0/379158161 shutdown_connections 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.137+0000 7f1b5e054640 1 --2- 172.21.15.157:0/379158161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580beca0 0x7f1b58158e70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.137+0000 7f1b5e054640 1 --2- 172.21.15.157:0/379158161 >> v2:172.21.15.5:3300/0 conn(0x7f1b5814e5f0 0x7f1b580c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.137+0000 7f1b5e054640 1 -- 172.21.15.157:0/379158161 >> 172.21.15.157:0/379158161 conn(0x7f1b580c3ed0 msgr2=0x7f1b580c0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.137+0000 7f1b5e054640 1 -- 172.21.15.157:0/379158161 shutdown_connections 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.137+0000 7f1b5e054640 1 -- 172.21.15.157:0/379158161 wait complete. 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.138+0000 7f1b5e054640 1 Processor -- start 2024-05-16T21:31:59.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.138+0000 7f1b5e054640 1 -- start start 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.139+0000 7f1b5e054640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580bd590 0x7f1b580bb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.139+0000 7f1b5e054640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b580beca0 0x7f1b581e8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.139+0000 7f1b5e054640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5814e5f0 0x7f1b58149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.139+0000 7f1b5e054640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5808db90 con 0x7f1b580beca0 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.139+0000 7f1b5e054640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5808da10 con 0x7f1b5814e5f0 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.139+0000 7f1b5e054640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5808d660 con 0x7f1b580bd590 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.139+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580bd590 0x7f1b580bb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5814e5f0 0x7f1b58149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580bd590 0x7f1b580bb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49384/0 (socket says 172.21.15.157:49384) 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b577fe640 1 -- 172.21.15.157:0/1347019155 learned_addr learned my addr 172.21.15.157:0/1347019155 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b4ffff640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b580beca0 0x7f1b581e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b577fe640 1 -- 172.21.15.157:0/1347019155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5814e5f0 msgr2=0x7f1b58149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b577fe640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5814e5f0 0x7f1b58149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b577fe640 1 -- 172.21.15.157:0/1347019155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b580beca0 msgr2=0x7f1b581e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b577fe640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b580beca0 0x7f1b581e8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b577fe640 1 -- 172.21.15.157:0/1347019155 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b580bbdb0 con 0x7f1b580bd590 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b57fff640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5814e5f0 0x7f1b58149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b577fe640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580bd590 0x7f1b580bb870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c7f0 tx=0x7f1b4800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b54ff9640 1 -- 172.21.15.157:0/1347019155 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48015070 con 0x7f1b580bd590 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b54ff9640 1 -- 172.21.15.157:0/1347019155 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b480077c0 con 0x7f1b580bd590 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b581e8740 con 0x7f1b580bd590 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b54ff9640 1 -- 172.21.15.157:0/1347019155 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48007b70 con 0x7f1b580bd590 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b581d4ed0 con 0x7f1b580bd590 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b54ff9640 1 -- 172.21.15.157:0/1347019155 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b48018070 con 0x7f1b580bd590 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.140+0000 7f1b54ff9640 1 -- 172.21.15.157:0/1347019155 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f1b48011950 con 0x7f1b580bd590 2024-05-16T21:31:59.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.141+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b580a9820 con 0x7f1b580bd590 2024-05-16T21:31:59.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.143+0000 7f1b54ff9640 1 -- 172.21.15.157:0/1347019155 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1b48011c50 con 0x7f1b580bd590 2024-05-16T21:31:59.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.217+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "06dca2f1-dc2c-4264-8589-5667e239f106", "id": 2} v 0) -- 0x7f1b58050940 con 0x7f1b580bd590 2024-05-16T21:31:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.220+0000 7f1b54ff9640 1 -- 172.21.15.157:0/1347019155 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06dca2f1-dc2c-4264-8589-5667e239f106", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f1b48011530 con 0x7f1b580bd590 2024-05-16T21:31:59.222 INFO:teuthology.orchestra.run.smithi157.stdout:2 2024-05-16T21:31:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580bd590 msgr2=0x7f1b580bb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580bd590 0x7f1b580bb870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c7f0 tx=0x7f1b4800ccb0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 shutdown_connections 2024-05-16T21:31:59.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5814e5f0 0x7f1b58149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b580beca0 0x7f1b581e8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 --2- 172.21.15.157:0/1347019155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b580bd590 0x7f1b580bb870 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 >> 172.21.15.157:0/1347019155 conn(0x7f1b580c3ed0 msgr2=0x7f1b580c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 shutdown_connections 2024-05-16T21:31:59.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.221+0000 7f1b5e054640 1 -- 172.21.15.157:0/1347019155 wait complete. 2024-05-16T21:31:59.234 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 9f89cec3-d102-42f6-baee-3650e29b31b3 3 2024-05-16T21:31:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.341+0000 7f68e0973640 1 Processor -- start 2024-05-16T21:31:59.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.341+0000 7f68e0973640 1 -- start start 2024-05-16T21:31:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68e0973640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc1455f0 0x7f68dc14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68e0973640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68dc0bb060 0x7f68dc14e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68e0973640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68dc0bc710 con 0x7f68dc0bb470 2024-05-16T21:31:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68e0973640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f68dc14b590 con 0x7f68dc0bb060 2024-05-16T21:31:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68e0973640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f68dc14f1c0 con 0x7f68dc1455f0 2024-05-16T21:31:59.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68da59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc1455f0 0x7f68dc14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68da59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc1455f0 0x7f68dc14ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49400/0 (socket says 172.21.15.157:49400) 2024-05-16T21:31:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68da59c640 1 -- 172.21.15.157:0/2888243041 learned_addr learned my addr 172.21.15.157:0/2888243041 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68d9d9b640 1 --2- 172.21.15.157:0/2888243041 >> v2:172.21.15.5:3300/0 conn(0x7f68dc0bb060 0x7f68dc14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68da59c640 1 -- 172.21.15.157:0/2888243041 >> v2:172.21.15.5:3300/0 conn(0x7f68dc0bb060 msgr2=0x7f68dc14e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68da59c640 1 --2- 172.21.15.157:0/2888243041 >> v2:172.21.15.5:3300/0 conn(0x7f68dc0bb060 0x7f68dc14e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68da59c640 1 -- 172.21.15.157:0/2888243041 >> v1:172.21.15.5:6789/0 conn(0x7f68dc0bb470 legacy=0x7f68dc0becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:59.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.342+0000 7f68da59c640 1 -- 172.21.15.157:0/2888243041 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc14b220 con 0x7f68dc1455f0 2024-05-16T21:31:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.343+0000 7f68da59c640 1 --2- 172.21.15.157:0/2888243041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc1455f0 0x7f68dc14ba20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68dc06e8b0 tx=0x7f68cc02c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=628b8f0ce68c6c70 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.343+0000 7f68d959a640 1 -- 172.21.15.157:0/2888243041 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc036020 con 0x7f68dc1455f0 2024-05-16T21:31:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.343+0000 7f68d959a640 1 -- 172.21.15.157:0/2888243041 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68cc032800 con 0x7f68dc1455f0 2024-05-16T21:31:59.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.343+0000 7f68d959a640 1 -- 172.21.15.157:0/2888243041 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc032bd0 con 0x7f68dc1455f0 2024-05-16T21:31:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.344+0000 7f68e0973640 1 -- 172.21.15.157:0/2888243041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc1455f0 msgr2=0x7f68dc14ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.344+0000 7f68e0973640 1 --2- 172.21.15.157:0/2888243041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc1455f0 0x7f68dc14ba20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68dc06e8b0 tx=0x7f68cc02c900 comp rx=0 tx=0).stop 2024-05-16T21:31:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.344+0000 7f68e0973640 1 -- 172.21.15.157:0/2888243041 shutdown_connections 2024-05-16T21:31:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.344+0000 7f68e0973640 1 --2- 172.21.15.157:0/2888243041 >> v2:172.21.15.5:3300/0 conn(0x7f68dc0bb060 0x7f68dc14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.344+0000 7f68e0973640 1 --2- 172.21.15.157:0/2888243041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc1455f0 0x7f68dc14ba20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.344+0000 7f68e0973640 1 -- 172.21.15.157:0/2888243041 >> 172.21.15.157:0/2888243041 conn(0x7f68dc0bd160 msgr2=0x7f68dc0bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.344+0000 7f68e0973640 1 -- 172.21.15.157:0/2888243041 shutdown_connections 2024-05-16T21:31:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.344+0000 7f68e0973640 1 -- 172.21.15.157:0/2888243041 wait complete. 2024-05-16T21:31:59.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.346+0000 7f68e0973640 1 Processor -- start 2024-05-16T21:31:59.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.346+0000 7f68e0973640 1 -- start start 2024-05-16T21:31:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68e0973640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68dc0bb060 0x7f68dc071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68e0973640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0bb470 0x7f68dc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68e0973640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc1455f0 0x7f68dc1e0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68e0973640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc073120 con 0x7f68dc0bb060 2024-05-16T21:31:59.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68e0973640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc14f4a0 con 0x7f68dc1455f0 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68e0973640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f68dc1dff20 con 0x7f68dc0bb470 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68d9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0bb470 0x7f68dc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68d9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0bb470 0x7f68dc06d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49416/0 (socket says 172.21.15.157:49416) 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68d9d9b640 1 -- 172.21.15.157:0/1290251624 learned_addr learned my addr 172.21.15.157:0/1290251624 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68da59c640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68dc0bb060 0x7f68dc071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68dad9d640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc1455f0 0x7f68dc1e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68dad9d640 1 -- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0bb470 msgr2=0x7f68dc06d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68dad9d640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0bb470 0x7f68dc06d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68dad9d640 1 -- 172.21.15.157:0/1290251624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68dc0bb060 msgr2=0x7f68dc071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68dad9d640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68dc0bb060 0x7f68dc071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68dad9d640 1 -- 172.21.15.157:0/1290251624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc0716c0 con 0x7f68dc1455f0 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68d9d9b640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0bb470 0x7f68dc06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.347+0000 7f68da59c640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68dc0bb060 0x7f68dc071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:59.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.348+0000 7f68dad9d640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc1455f0 0x7f68dc1e0500 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68d400bdd0 tx=0x7f68d4009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.348+0000 7f68caffd640 1 -- 172.21.15.157:0/1290251624 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4019070 con 0x7f68dc1455f0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.348+0000 7f68caffd640 1 -- 172.21.15.157:0/1290251624 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d400cdf0 con 0x7f68dc1455f0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.348+0000 7f68caffd640 1 -- 172.21.15.157:0/1290251624 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4014660 con 0x7f68dc1455f0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.348+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68dc0a4130 con 0x7f68dc1455f0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.348+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68dc0a4710 con 0x7f68dc1455f0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.348+0000 7f68caffd640 1 -- 172.21.15.157:0/1290251624 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68d401c070 con 0x7f68dc1455f0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.348+0000 7f68caffd640 1 -- 172.21.15.157:0/1290251624 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f68d40044b0 con 0x7f68dc1455f0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.349+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68dc069b50 con 0x7f68dc1455f0 2024-05-16T21:31:59.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.351+0000 7f68caffd640 1 -- 172.21.15.157:0/1290251624 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f68d4004790 con 0x7f68dc1455f0 2024-05-16T21:31:59.396 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:59.393+0000 7ff3a5634040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-16T21:31:59.423 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:59.421+0000 7f2bf2f1c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-16T21:31:59.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.423+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f89cec3-d102-42f6-baee-3650e29b31b3", "id": 3} v 0) -- 0x7f68dc050940 con 0x7f68dc1455f0 2024-05-16T21:31:59.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.426+0000 7f68caffd640 1 -- 172.21.15.157:0/1290251624 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f89cec3-d102-42f6-baee-3650e29b31b3", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f68d4004210 con 0x7f68dc1455f0 2024-05-16T21:31:59.429 INFO:teuthology.orchestra.run.smithi157.stdout:3 2024-05-16T21:31:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.427+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc1455f0 msgr2=0x7f68dc1e0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.427+0000 7f68e0973640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc1455f0 0x7f68dc1e0500 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68d400bdd0 tx=0x7f68d4009ed0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.427+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 shutdown_connections 2024-05-16T21:31:59.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.427+0000 7f68e0973640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68dc1455f0 0x7f68dc1e0500 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.427+0000 7f68e0973640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68dc0bb470 0x7f68dc06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.427+0000 7f68e0973640 1 --2- 172.21.15.157:0/1290251624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68dc0bb060 0x7f68dc071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.428+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 >> 172.21.15.157:0/1290251624 conn(0x7f68dc0bd160 msgr2=0x7f68dc073b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.428+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 shutdown_connections 2024-05-16T21:31:59.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.428+0000 7f68e0973640 1 -- 172.21.15.157:0/1290251624 wait complete. 2024-05-16T21:31:59.441 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd 4 2024-05-16T21:31:59.488 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:59.486+0000 7ff3a5634040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-16T21:31:59.516 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:59.514+0000 7f2bf2f1c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-16T21:31:59.534 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:59.532+0000 7ff3a5634040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-16T21:31:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.546+0000 7f5c2a0b8640 1 Processor -- start 2024-05-16T21:31:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.547+0000 7f5c2a0b8640 1 -- start start 2024-05-16T21:31:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c2a0b8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c2406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c2a0b8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5c2414daa0 0x7f5c2414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c2a0b8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2406ce00 con 0x7f5c24151ef0 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c2a0b8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5c2409ff10 con 0x7f5c2414daa0 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c2a0b8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2414ea00 con 0x7f5c240bb520 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c237fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c2406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c23fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5c2414daa0 0x7f5c2414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c237fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c2406c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49432/0 (socket says 172.21.15.157:49432) 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c23fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5c2414daa0 0x7f5c2414deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48454/0 (socket says 172.21.15.157:48454) 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c237fe640 1 -- 172.21.15.157:0/655416466 learned_addr learned my addr 172.21.15.157:0/655416466 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c237fe640 1 -- 172.21.15.157:0/655416466 >> v2:172.21.15.157:3300/0 conn(0x7f5c2414daa0 msgr2=0x7f5c2414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c237fe640 1 --2- 172.21.15.157:0/655416466 >> v2:172.21.15.157:3300/0 conn(0x7f5c2414daa0 0x7f5c2414deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c237fe640 1 -- 172.21.15.157:0/655416466 >> v1:172.21.15.5:6789/0 conn(0x7f5c24151ef0 legacy=0x7f5c2414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c237fe640 1 -- 172.21.15.157:0/655416466 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2414e3f0 con 0x7f5c240bb520 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.548+0000 7f5c23fff640 1 --2- 172.21.15.157:0/655416466 >> v2:172.21.15.157:3300/0 conn(0x7f5c2414daa0 0x7f5c2414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:59.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.549+0000 7f5c237fe640 1 --2- 172.21.15.157:0/655416466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c2406c8c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009870 tx=0x7f5c1802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36e9d8e9899bbdd server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.549+0000 7f5c227fc640 1 -- 172.21.15.157:0/655416466 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c18037070 con 0x7f5c240bb520 2024-05-16T21:31:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.549+0000 7f5c227fc640 1 -- 172.21.15.157:0/655416466 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1802ae50 con 0x7f5c240bb520 2024-05-16T21:31:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.549+0000 7f5c227fc640 1 -- 172.21.15.157:0/655416466 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c18032860 con 0x7f5c240bb520 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.550+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/655416466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 msgr2=0x7f5c2406c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.550+0000 7f5c2a0b8640 1 --2- 172.21.15.157:0/655416466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c2406c8c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009870 tx=0x7f5c1802a300 comp rx=0 tx=0).stop 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.550+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/655416466 shutdown_connections 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.550+0000 7f5c2a0b8640 1 --2- 172.21.15.157:0/655416466 >> v2:172.21.15.157:3300/0 conn(0x7f5c2414daa0 0x7f5c2414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.550+0000 7f5c2a0b8640 1 --2- 172.21.15.157:0/655416466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c2406c8c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.550+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/655416466 >> 172.21.15.157:0/655416466 conn(0x7f5c240bd160 msgr2=0x7f5c240bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.550+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/655416466 shutdown_connections 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.550+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/655416466 wait complete. 2024-05-16T21:31:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.551+0000 7f5c2a0b8640 1 Processor -- start 2024-05-16T21:31:59.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.552+0000 7f5c2a0b8640 1 -- start start 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c2a0b8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c24070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c2a0b8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c2414daa0 0x7f5c2414f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c2a0b8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c24151ef0 0x7f5c2414c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c2a0b8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24152300 con 0x7f5c24151ef0 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c2a0b8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2414e690 con 0x7f5c2414daa0 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c2a0b8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5c24152480 con 0x7f5c240bb520 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c237fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c24070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c237fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c24070030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49444/0 (socket says 172.21.15.157:49444) 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c22ffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c2414daa0 0x7f5c2414f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c237fe640 1 -- 172.21.15.157:0/3644374401 learned_addr learned my addr 172.21.15.157:0/3644374401 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c23fff640 1 --2- 172.21.15.157:0/3644374401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c24151ef0 0x7f5c2414c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c22ffd640 1 -- 172.21.15.157:0/3644374401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 msgr2=0x7f5c24070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c22ffd640 1 --2- 172.21.15.157:0/3644374401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c24070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c22ffd640 1 -- 172.21.15.157:0/3644374401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c24151ef0 msgr2=0x7f5c2414c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c22ffd640 1 --2- 172.21.15.157:0/3644374401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c24151ef0 0x7f5c2414c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c22ffd640 1 -- 172.21.15.157:0/3644374401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c240ba8e0 con 0x7f5c2414daa0 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.553+0000 7f5c22ffd640 1 --2- 172.21.15.157:0/3644374401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c2414daa0 0x7f5c2414f600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c24072050 tx=0x7f5c1400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.554+0000 7f5c0bfff640 1 -- 172.21.15.157:0/3644374401 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14017070 con 0x7f5c2414daa0 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.554+0000 7f5c0bfff640 1 -- 172.21.15.157:0/3644374401 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c140052d0 con 0x7f5c2414daa0 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.554+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c24151410 con 0x7f5c2414daa0 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.554+0000 7f5c0bfff640 1 -- 172.21.15.157:0/3644374401 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14003830 con 0x7f5c2414daa0 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.554+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c240ba0e0 con 0x7f5c2414daa0 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.554+0000 7f5c0bfff640 1 -- 172.21.15.157:0/3644374401 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c1401a070 con 0x7f5c2414daa0 2024-05-16T21:31:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.554+0000 7f5c0bfff640 1 -- 172.21.15.157:0/3644374401 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5c1401c440 con 0x7f5c2414daa0 2024-05-16T21:31:59.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.555+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c240b9ed0 con 0x7f5c2414daa0 2024-05-16T21:31:59.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.557+0000 7f5c0bfff640 1 -- 172.21.15.157:0/3644374401 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5c14021030 con 0x7f5c2414daa0 2024-05-16T21:31:59.561 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:59.559+0000 7f2bf2f1c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-16T21:31:59.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.628+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd", "id": 4} v 0) -- 0x7f5c24069b50 con 0x7f5c2414daa0 2024-05-16T21:31:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.632+0000 7f5c0bfff640 1 -- 172.21.15.157:0/3644374401 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f5c14011590 con 0x7f5c2414daa0 2024-05-16T21:31:59.634 INFO:teuthology.orchestra.run.smithi157.stdout:4 2024-05-16T21:31:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c2414daa0 msgr2=0x7f5c2414f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 --2- 172.21.15.157:0/3644374401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c2414daa0 0x7f5c2414f600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c24072050 tx=0x7f5c1400c760 comp rx=0 tx=0).stop 2024-05-16T21:31:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 shutdown_connections 2024-05-16T21:31:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 --2- 172.21.15.157:0/3644374401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c24151ef0 0x7f5c2414c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 --2- 172.21.15.157:0/3644374401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c2414daa0 0x7f5c2414f600 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 --2- 172.21.15.157:0/3644374401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c240bb520 0x7f5c24070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 >> 172.21.15.157:0/3644374401 conn(0x7f5c240bd160 msgr2=0x7f5c24073f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 shutdown_connections 2024-05-16T21:31:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.633+0000 7f5c2a0b8640 1 -- 172.21.15.157:0/3644374401 wait complete. 2024-05-16T21:31:59.646 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 184dc921-f299-4041-b72b-d06a3f1bde9c 5 2024-05-16T21:31:59.708 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:59.706+0000 7ff3a5634040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-16T21:31:59.736 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:59.734+0000 7f2bf2f1c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-16T21:31:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.752+0000 7f9053ac8640 1 Processor -- start 2024-05-16T21:31:59.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.752+0000 7f9053ac8640 1 -- start start 2024-05-16T21:31:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9053ac8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f904c070a90 0x7f904c0bfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9053ac8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9053ac8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904c151b50 con 0x7f904c152630 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9053ac8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f904c151e30 con 0x7f904c070a90 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9053ac8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f904c071de0 con 0x7f904c14e960 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9051063640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f904c070a90 0x7f904c0bfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9052065640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9051063640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f904c070a90 0x7f904c0bfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48458/0 (socket says 172.21.15.157:48458) 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.753+0000 7f9051063640 1 -- 172.21.15.157:0/829111381 learned_addr learned my addr 172.21.15.157:0/829111381 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.754+0000 7f9051063640 1 -- 172.21.15.157:0/829111381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 msgr2=0x7f904c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.754+0000 7f9051063640 1 --2- 172.21.15.157:0/829111381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.754+0000 7f9051063640 1 -- 172.21.15.157:0/829111381 >> v1:172.21.15.157:6789/0 conn(0x7f904c152630 legacy=0x7f904c148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.754+0000 7f9051063640 1 -- 172.21.15.157:0/829111381 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c070ea0 con 0x7f904c070a90 2024-05-16T21:31:59.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.754+0000 7f9052065640 1 --2- 172.21.15.157:0/829111381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.754+0000 7f9051063640 1 --2- 172.21.15.157:0/829111381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c070a90 0x7f904c0bfa90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9048009870 tx=0x7f904802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd57d124ab6b331b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9050862640 1 -- 172.21.15.157:0/829111381 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048037070 con 0x7f904c070a90 2024-05-16T21:31:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9050862640 1 -- 172.21.15.157:0/829111381 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904802ae50 con 0x7f904c070a90 2024-05-16T21:31:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9050862640 1 -- 172.21.15.157:0/829111381 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048032860 con 0x7f904c070a90 2024-05-16T21:31:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9053ac8640 1 -- 172.21.15.157:0/829111381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c070a90 msgr2=0x7f904c0bfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9053ac8640 1 --2- 172.21.15.157:0/829111381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c070a90 0x7f904c0bfa90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9048009870 tx=0x7f904802a300 comp rx=0 tx=0).stop 2024-05-16T21:31:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9053ac8640 1 -- 172.21.15.157:0/829111381 shutdown_connections 2024-05-16T21:31:59.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9053ac8640 1 --2- 172.21.15.157:0/829111381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9053ac8640 1 --2- 172.21.15.157:0/829111381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c070a90 0x7f904c0bfa90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.755+0000 7f9053ac8640 1 -- 172.21.15.157:0/829111381 >> 172.21.15.157:0/829111381 conn(0x7f904c0c1750 msgr2=0x7f904c0c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.756+0000 7f9053ac8640 1 -- 172.21.15.157:0/829111381 shutdown_connections 2024-05-16T21:31:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.756+0000 7f9053ac8640 1 -- 172.21.15.157:0/829111381 wait complete. 2024-05-16T21:31:59.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.757+0000 7f9053ac8640 1 Processor -- start 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.757+0000 7f9053ac8640 1 -- start start 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9053ac8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c070a90 0x7f904c1e4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9053ac8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c1ddf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9053ac8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c152630 0x7f904c1454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9053ac8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f904c158d40 con 0x7f904c070a90 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9053ac8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f904c0c01e0 con 0x7f904c152630 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9053ac8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f904c158ec0 con 0x7f904c14e960 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9051063640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c1ddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9052065640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c152630 0x7f904c1454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9051063640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c1ddf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49468/0 (socket says 172.21.15.157:49468) 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9051063640 1 -- 172.21.15.157:0/902949514 learned_addr learned my addr 172.21.15.157:0/902949514 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9051864640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c070a90 0x7f904c1e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9051063640 1 -- 172.21.15.157:0/902949514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c152630 msgr2=0x7f904c1454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9051063640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c152630 0x7f904c1454f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9051063640 1 -- 172.21.15.157:0/902949514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c070a90 msgr2=0x7f904c1e4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.758+0000 7f9051063640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c070a90 0x7f904c1e4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f9051063640 1 -- 172.21.15.157:0/902949514 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c1e4c80 con 0x7f904c14e960 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f9051864640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c070a90 0x7f904c1e4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f9051063640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c1ddf30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9048000c00 tx=0x7f90480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f90427fc640 1 -- 172.21.15.157:0/902949514 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048041070 con 0x7f904c14e960 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f90427fc640 1 -- 172.21.15.157:0/902949514 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904803c660 con 0x7f904c14e960 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c14dd70 con 0x7f904c14e960 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f90427fc640 1 -- 172.21.15.157:0/902949514 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048037040 con 0x7f904c14e960 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c1de7c0 con 0x7f904c14e960 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f90427fc640 1 -- 172.21.15.157:0/902949514 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9048044070 con 0x7f904c14e960 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.759+0000 7f90427fc640 1 -- 172.21.15.157:0/902949514 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f904803d3f0 con 0x7f904c14e960 2024-05-16T21:31:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.760+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c050940 con 0x7f904c14e960 2024-05-16T21:31:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.762+0000 7f90427fc640 1 -- 172.21.15.157:0/902949514 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9048046450 con 0x7f904c14e960 2024-05-16T21:31:59.769 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:59.766+0000 7ff3a5634040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-16T21:31:59.785 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:59.784+0000 7f2bf2f1c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-16T21:31:59.823 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:59.821+0000 7ff3a5634040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-16T21:31:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.835+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "184dc921-f299-4041-b72b-d06a3f1bde9c", "id": 5} v 0) -- 0x7f904c0bc1f0 con 0x7f904c14e960 2024-05-16T21:31:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.839+0000 7f90427fc640 1 -- 172.21.15.157:0/902949514 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "184dc921-f299-4041-b72b-d06a3f1bde9c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f904803ca50 con 0x7f904c14e960 2024-05-16T21:31:59.841 INFO:teuthology.orchestra.run.smithi157.stdout:5 2024-05-16T21:31:59.842 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:59.840+0000 7f2bf2f1c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 msgr2=0x7f904c1ddf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c1ddf30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9048000c00 tx=0x7f90480046c0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 shutdown_connections 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f904c152630 0x7f904c1454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f904c14e960 0x7f904c1ddf30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 --2- 172.21.15.157:0/902949514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c070a90 0x7f904c1e4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 >> 172.21.15.157:0/902949514 conn(0x7f904c0c1750 msgr2=0x7f904c0a04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 shutdown_connections 2024-05-16T21:31:59.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.840+0000 7f9053ac8640 1 -- 172.21.15.157:0/902949514 wait complete. 2024-05-16T21:31:59.853 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new cdba81e7-7752-4507-91d8-92610089ae57 6 2024-05-16T21:31:59.944 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:31:59.941+0000 7ff3a5634040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-16T21:31:59.961 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:31:59.959+0000 7f2bf2f1c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-16T21:31:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.959+0000 7fca4a625640 1 Processor -- start 2024-05-16T21:31:59.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.959+0000 7fca4a625640 1 -- start start 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca4a625640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca440bb300 0x7fca44073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca4a625640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca44073fb0 0x7fca4414b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca4a625640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca440c0380 con 0x7fca4414be70 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca4a625640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fca440735e0 con 0x7fca440bb300 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca4a625640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fca440bc750 con 0x7fca44073fb0 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca437fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca44073fb0 0x7fca4414b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca437fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca44073fb0 0x7fca4414b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48472/0 (socket says 172.21.15.157:48472) 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca437fe640 1 -- 172.21.15.157:0/824934486 learned_addr learned my addr 172.21.15.157:0/824934486 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca43fff640 1 --2- 172.21.15.157:0/824934486 >> v2:172.21.15.5:3300/0 conn(0x7fca440bb300 0x7fca44073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca437fe640 1 -- 172.21.15.157:0/824934486 >> v2:172.21.15.5:3300/0 conn(0x7fca440bb300 msgr2=0x7fca44073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca437fe640 1 --2- 172.21.15.157:0/824934486 >> v2:172.21.15.5:3300/0 conn(0x7fca440bb300 0x7fca44073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca437fe640 1 -- 172.21.15.157:0/824934486 >> v1:172.21.15.157:6789/0 conn(0x7fca4414be70 legacy=0x7fca4414e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.961+0000 7fca437fe640 1 -- 172.21.15.157:0/824934486 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca440be460 con 0x7fca44073fb0 2024-05-16T21:31:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.962+0000 7fca437fe640 1 --2- 172.21.15.157:0/824934486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca44073fb0 0x7fca4414b930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fca44072000 tx=0x7fca3402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0f2c908a3228e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.962+0000 7fca42ffd640 1 -- 172.21.15.157:0/824934486 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34037070 con 0x7fca44073fb0 2024-05-16T21:31:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.962+0000 7fca42ffd640 1 -- 172.21.15.157:0/824934486 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca34032440 con 0x7fca44073fb0 2024-05-16T21:31:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.962+0000 7fca42ffd640 1 -- 172.21.15.157:0/824934486 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34032810 con 0x7fca44073fb0 2024-05-16T21:31:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.963+0000 7fca4a625640 1 -- 172.21.15.157:0/824934486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca44073fb0 msgr2=0x7fca4414b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.963+0000 7fca4a625640 1 --2- 172.21.15.157:0/824934486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca44073fb0 0x7fca4414b930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fca44072000 tx=0x7fca3402a270 comp rx=0 tx=0).stop 2024-05-16T21:31:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.963+0000 7fca4a625640 1 -- 172.21.15.157:0/824934486 shutdown_connections 2024-05-16T21:31:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.963+0000 7fca4a625640 1 --2- 172.21.15.157:0/824934486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca44073fb0 0x7fca4414b930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.963+0000 7fca4a625640 1 --2- 172.21.15.157:0/824934486 >> v2:172.21.15.5:3300/0 conn(0x7fca440bb300 0x7fca44073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.963+0000 7fca4a625640 1 -- 172.21.15.157:0/824934486 >> 172.21.15.157:0/824934486 conn(0x7fca440bd160 msgr2=0x7fca440bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:31:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.963+0000 7fca4a625640 1 -- 172.21.15.157:0/824934486 shutdown_connections 2024-05-16T21:31:59.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.964+0000 7fca4a625640 1 -- 172.21.15.157:0/824934486 wait complete. 2024-05-16T21:31:59.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.966+0000 7fca4a625640 1 Processor -- start 2024-05-16T21:31:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.966+0000 7fca4a625640 1 -- start start 2024-05-16T21:31:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca4a625640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca44073fb0 0x7fca4409f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca4a625640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca440bb300 0x7fca440a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca4a625640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4414be70 0x7fca4409ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:31:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca4a625640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fca440bb710 con 0x7fca440bb300 2024-05-16T21:31:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca4a625640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fca44073270 con 0x7fca4414be70 2024-05-16T21:31:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca4a625640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fca440743c0 con 0x7fca44073fb0 2024-05-16T21:31:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca43fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca44073fb0 0x7fca4409f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca48bc2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4414be70 0x7fca4409ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca43fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca44073fb0 0x7fca4409f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49476/0 (socket says 172.21.15.157:49476) 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca43fff640 1 -- 172.21.15.157:0/3280863050 learned_addr learned my addr 172.21.15.157:0/3280863050 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca437fe640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca440bb300 0x7fca440a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca43fff640 1 -- 172.21.15.157:0/3280863050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4414be70 msgr2=0x7fca4409ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca43fff640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4414be70 0x7fca4409ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca43fff640 1 -- 172.21.15.157:0/3280863050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca440bb300 msgr2=0x7fca440a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca43fff640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca440bb300 0x7fca440a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca43fff640 1 -- 172.21.15.157:0/3280863050 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca440a4f80 con 0x7fca44073fb0 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.968+0000 7fca48bc2640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4414be70 0x7fca4409ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.969+0000 7fca43fff640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca44073fb0 0x7fca4409f1f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca3800e8a0 tx=0x7fca3800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.969+0000 7fca40ff9640 1 -- 172.21.15.157:0/3280863050 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38017070 con 0x7fca44073fb0 2024-05-16T21:31:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.969+0000 7fca40ff9640 1 -- 172.21.15.157:0/3280863050 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3800c940 con 0x7fca44073fb0 2024-05-16T21:31:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.969+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4409d3c0 con 0x7fca44073fb0 2024-05-16T21:31:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.969+0000 7fca40ff9640 1 -- 172.21.15.157:0/3280863050 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3800cd30 con 0x7fca44073fb0 2024-05-16T21:31:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.969+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4413fa40 con 0x7fca44073fb0 2024-05-16T21:31:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.969+0000 7fca40ff9640 1 -- 172.21.15.157:0/3280863050 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca3801a070 con 0x7fca44073fb0 2024-05-16T21:31:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.969+0000 7fca40ff9640 1 -- 172.21.15.157:0/3280863050 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fca3801ca40 con 0x7fca44073fb0 2024-05-16T21:31:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.970+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca44069b50 con 0x7fca44073fb0 2024-05-16T21:31:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:31:59.972+0000 7fca40ff9640 1 -- 172.21.15.157:0/3280863050 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fca3801c450 con 0x7fca44073fb0 2024-05-16T21:32:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.067+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cdba81e7-7752-4507-91d8-92610089ae57", "id": 6} v 0) -- 0x7fca440bbbd0 con 0x7fca44073fb0 2024-05-16T21:32:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.071+0000 7fca40ff9640 1 -- 172.21.15.157:0/3280863050 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cdba81e7-7752-4507-91d8-92610089ae57", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fca3801c630 con 0x7fca44073fb0 2024-05-16T21:32:00.073 INFO:teuthology.orchestra.run.smithi157.stdout:6 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca44073fb0 msgr2=0x7fca4409f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca44073fb0 0x7fca4409f1f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca3800e8a0 tx=0x7fca3800ed60 comp rx=0 tx=0).stop 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 shutdown_connections 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4414be70 0x7fca4409ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca440bb300 0x7fca440a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 --2- 172.21.15.157:0/3280863050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca44073fb0 0x7fca4409f1f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 >> 172.21.15.157:0/3280863050 conn(0x7fca440bd160 msgr2=0x7fca4406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 shutdown_connections 2024-05-16T21:32:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.072+0000 7fca4a625640 1 -- 172.21.15.157:0/3280863050 wait complete. 2024-05-16T21:32:00.090 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 15b15ba1-109b-4af6-8f67-b3a736a52c21 7 2024-05-16T21:32:00.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.196+0000 7fe82eb5e640 1 Processor -- start 2024-05-16T21:32:00.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.196+0000 7fe82eb5e640 1 -- start start 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82eb5e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe82814f110 0x7fe8280bb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82eb5e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8280bbc20 con 0x7fe82806c980 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82eb5e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8280bbf00 con 0x7fe8280bfe70 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82eb5e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe828151c20 con 0x7fe82814f110 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82d0fb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe82814f110 0x7fe8280bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82d0fb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe82814f110 0x7fe8280bb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48486/0 (socket says 172.21.15.157:48486) 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82d0fb640 1 -- 172.21.15.157:0/2021820238 learned_addr learned my addr 172.21.15.157:0/2021820238 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82d0fb640 1 -- 172.21.15.157:0/2021820238 >> v1:172.21.15.157:6789/0 conn(0x7fe8280bfe70 legacy=0x7fe828152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82d0fb640 1 -- 172.21.15.157:0/2021820238 >> v1:172.21.15.5:6789/0 conn(0x7fe82806c980 legacy=0x7fe82814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.197+0000 7fe82d0fb640 1 -- 172.21.15.157:0/2021820238 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82806cd90 con 0x7fe82814f110 2024-05-16T21:32:00.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.198+0000 7fe82d0fb640 1 --2- 172.21.15.157:0/2021820238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe82814f110 0x7fe8280bb520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe820009e50 tx=0x7fe82002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aefd299e217fb63 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.198+0000 7fe8277fe640 1 -- 172.21.15.157:0/2021820238 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820036070 con 0x7fe82814f110 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.198+0000 7fe8277fe640 1 -- 172.21.15.157:0/2021820238 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe820031600 con 0x7fe82814f110 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.198+0000 7fe8277fe640 1 -- 172.21.15.157:0/2021820238 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8200319d0 con 0x7fe82814f110 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.199+0000 7fe82eb5e640 1 -- 172.21.15.157:0/2021820238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe82814f110 msgr2=0x7fe8280bb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.199+0000 7fe82eb5e640 1 --2- 172.21.15.157:0/2021820238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe82814f110 0x7fe8280bb520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe820009e50 tx=0x7fe82002a730 comp rx=0 tx=0).stop 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.199+0000 7fe82eb5e640 1 -- 172.21.15.157:0/2021820238 shutdown_connections 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.199+0000 7fe82eb5e640 1 --2- 172.21.15.157:0/2021820238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe82814f110 0x7fe8280bb520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.199+0000 7fe82eb5e640 1 -- 172.21.15.157:0/2021820238 >> 172.21.15.157:0/2021820238 conn(0x7fe8280bd160 msgr2=0x7fe8280bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.199+0000 7fe82eb5e640 1 -- 172.21.15.157:0/2021820238 shutdown_connections 2024-05-16T21:32:00.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.199+0000 7fe82eb5e640 1 -- 172.21.15.157:0/2021820238 wait complete. 2024-05-16T21:32:00.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.200+0000 7fe82eb5e640 1 Processor -- start 2024-05-16T21:32:00.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.201+0000 7fe82eb5e640 1 -- start start 2024-05-16T21:32:00.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe82eb5e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe82806c980 0x7fe8281423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe82eb5e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8280bfe70 0x7fe828141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe82eb5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe82814f110 0x7fe8280a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe82eb5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281529b0 con 0x7fe82814f110 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe82eb5e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe828152830 con 0x7fe8280bfe70 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe82eb5e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe828159dc0 con 0x7fe82806c980 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8280bfe70 0x7fe828141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe82c8fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe82806c980 0x7fe8281423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8280bfe70 0x7fe828141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48496/0 (socket says 172.21.15.157:48496) 2024-05-16T21:32:00.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 -- 172.21.15.157:0/1762647774 learned_addr learned my addr 172.21.15.157:0/1762647774 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe82d0fb640 1 --2- 172.21.15.157:0/1762647774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe82814f110 0x7fe8280a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 -- 172.21.15.157:0/1762647774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe82806c980 msgr2=0x7fe8281423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 --2- 172.21.15.157:0/1762647774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe82806c980 0x7fe8281423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 -- 172.21.15.157:0/1762647774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe82814f110 msgr2=0x7fe8280a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 --2- 172.21.15.157:0/1762647774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe82814f110 0x7fe8280a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 -- 172.21.15.157:0/1762647774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8281428f0 con 0x7fe8280bfe70 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe827fff640 1 --2- 172.21.15.157:0/1762647774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8280bfe70 0x7fe828141400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe81400c340 tx=0x7fe81400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.202+0000 7fe8257fa640 1 -- 172.21.15.157:0/1762647774 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814017070 con 0x7fe8280bfe70 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.203+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe828141940 con 0x7fe8280bfe70 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.203+0000 7fe8257fa640 1 -- 172.21.15.157:0/1762647774 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8140052d0 con 0x7fe8280bfe70 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.203+0000 7fe8257fa640 1 -- 172.21.15.157:0/1762647774 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814003810 con 0x7fe8280bfe70 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.203+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8280a4f80 con 0x7fe8280bfe70 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.203+0000 7fe8257fa640 1 -- 172.21.15.157:0/1762647774 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe81401a070 con 0x7fe8280bfe70 2024-05-16T21:32:00.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.203+0000 7fe8257fa640 1 -- 172.21.15.157:0/1762647774 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fe814011ae0 con 0x7fe8280bfe70 2024-05-16T21:32:00.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.204+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe828141040 con 0x7fe8280bfe70 2024-05-16T21:32:00.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.206+0000 7fe8257fa640 1 -- 172.21.15.157:0/1762647774 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe814021020 con 0x7fe8280bfe70 2024-05-16T21:32:00.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.278+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "15b15ba1-109b-4af6-8f67-b3a736a52c21", "id": 7} v 0) -- 0x7fe828069b50 con 0x7fe8280bfe70 2024-05-16T21:32:00.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.282+0000 7fe8257fa640 1 -- 172.21.15.157:0/1762647774 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15b15ba1-109b-4af6-8f67-b3a736a52c21", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fe8281428f0 con 0x7fe8280bfe70 2024-05-16T21:32:00.284 INFO:teuthology.orchestra.run.smithi157.stdout:7 2024-05-16T21:32:00.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8280bfe70 msgr2=0x7fe828141400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 --2- 172.21.15.157:0/1762647774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8280bfe70 0x7fe828141400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe81400c340 tx=0x7fe81400c800 comp rx=0 tx=0).stop 2024-05-16T21:32:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 shutdown_connections 2024-05-16T21:32:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 --2- 172.21.15.157:0/1762647774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe82814f110 0x7fe8280a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 --2- 172.21.15.157:0/1762647774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8280bfe70 0x7fe828141400 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 --2- 172.21.15.157:0/1762647774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe82806c980 0x7fe8281423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 >> 172.21.15.157:0/1762647774 conn(0x7fe8280bd160 msgr2=0x7fe8281456b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 shutdown_connections 2024-05-16T21:32:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-16T21:32:00.283+0000 7fe82eb5e640 1 -- 172.21.15.157:0/1762647774 wait complete. 2024-05-16T21:32:00.296 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-16T21:32:00.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-16T21:32:00.298 INFO:tasks.ceph.osd.0:Started 2024-05-16T21:32:00.299 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-16T21:32:00.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-16T21:32:00.301 INFO:tasks.ceph.osd.1:Started 2024-05-16T21:32:00.301 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-16T21:32:00.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-16T21:32:00.303 INFO:tasks.ceph.osd.2:Started 2024-05-16T21:32:00.304 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-16T21:32:00.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-16T21:32:00.306 INFO:tasks.ceph.osd.3:Started 2024-05-16T21:32:00.306 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-16T21:32:00.306 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-16T21:32:00.309 INFO:tasks.ceph.osd.4:Started 2024-05-16T21:32:00.309 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-16T21:32:00.309 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-16T21:32:00.311 INFO:tasks.ceph.osd.5:Started 2024-05-16T21:32:00.311 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-16T21:32:00.311 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-16T21:32:00.313 INFO:tasks.ceph.osd.6:Started 2024-05-16T21:32:00.313 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-16T21:32:00.313 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-16T21:32:00.316 INFO:tasks.ceph.osd.7:Started 2024-05-16T21:32:00.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:00.404 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:00.401+0000 7ff3a5634040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-16T21:32:00.413 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:00.411+0000 7f2bf2f1c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-16T21:32:00.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.457+0000 7f39dc8f2640 1 Processor -- start 2024-05-16T21:32:00.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.457+0000 7f39dc8f2640 1 -- start start 2024-05-16T21:32:00.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39dc8f2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d81522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39dc8f2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f39d8148770 0x7f39d80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39dc8f2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39d80c0620 con 0x7f39d80bf9b0 2024-05-16T21:32:00.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39dc8f2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f39d8151e40 con 0x7f39d8148770 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39dc8f2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f39d8151ad0 con 0x7f39d814e360 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39d6d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39d80bf9b0 0x7f39d80bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59904/0 (socket says 172.21.15.5:59904) 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39d6d9d640 1 -- 172.21.15.5:0/820937774 learned_addr learned my addr 172.21.15.5:0/820937774 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39d659c640 1 --2- 172.21.15.5:0/820937774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d81522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39cffff640 1 --2- 172.21.15.5:0/820937774 >> v2:172.21.15.157:3300/0 conn(0x7f39d8148770 0x7f39d80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39d5d9b640 1 -- 172.21.15.5:0/820937774 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684967150 0 0) 0x7f39d80c0620 con 0x7f39d80bf9b0 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39d5d9b640 1 -- 172.21.15.5:0/820937774 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39c4003520 con 0x7f39d80bf9b0 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.458+0000 7f39d659c640 1 -- 172.21.15.5:0/820937774 >> v2:172.21.15.157:3300/0 conn(0x7f39d8148770 msgr2=0x7f39d80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.459+0000 7f39d659c640 1 --2- 172.21.15.5:0/820937774 >> v2:172.21.15.157:3300/0 conn(0x7f39d8148770 0x7f39d80c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.459+0000 7f39d659c640 1 -- 172.21.15.5:0/820937774 >> v1:172.21.15.5:6789/0 conn(0x7f39d80bf9b0 legacy=0x7f39d80bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.459+0000 7f39d659c640 1 -- 172.21.15.5:0/820937774 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d8152810 con 0x7f39d814e360 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.459+0000 7f39cffff640 1 --2- 172.21.15.5:0/820937774 >> v2:172.21.15.157:3300/0 conn(0x7f39d8148770 0x7f39d80c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:00.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.459+0000 7f39d659c640 1 --2- 172.21.15.5:0/820937774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d81522d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f39c80097d0 tx=0x7f39c802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4da35ac008a9d1bc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:00.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.459+0000 7f39d5d9b640 1 -- 172.21.15.5:0/820937774 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8037070 con 0x7f39d814e360 2024-05-16T21:32:00.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39d5d9b640 1 -- 172.21.15.5:0/820937774 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c8032440 con 0x7f39d814e360 2024-05-16T21:32:00.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39d5d9b640 1 -- 172.21.15.5:0/820937774 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8032810 con 0x7f39d814e360 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39dc8f2640 1 -- 172.21.15.5:0/820937774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 msgr2=0x7f39d81522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39dc8f2640 1 --2- 172.21.15.5:0/820937774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d81522d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f39c80097d0 tx=0x7f39c802a250 comp rx=0 tx=0).stop 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39dc8f2640 1 -- 172.21.15.5:0/820937774 shutdown_connections 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39dc8f2640 1 --2- 172.21.15.5:0/820937774 >> v2:172.21.15.157:3300/0 conn(0x7f39d8148770 0x7f39d80c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39dc8f2640 1 --2- 172.21.15.5:0/820937774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d81522d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39dc8f2640 1 -- 172.21.15.5:0/820937774 >> 172.21.15.5:0/820937774 conn(0x7f39d80c17c0 msgr2=0x7f39d80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39dc8f2640 1 -- 172.21.15.5:0/820937774 shutdown_connections 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.460+0000 7f39dc8f2640 1 -- 172.21.15.5:0/820937774 wait complete. 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.462+0000 7f39dc8f2640 1 Processor -- start 2024-05-16T21:32:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.462+0000 7f39dc8f2640 1 -- start start 2024-05-16T21:32:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39dc8f2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d80bf9b0 0x7f39d8140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39dc8f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8148770 0x7f39d813da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39dc8f2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d813df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39dc8f2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39d8158cc0 con 0x7f39d8148770 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39dc8f2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80c13d0 con 0x7f39d80bf9b0 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39dc8f2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f39d8158e40 con 0x7f39d814e360 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8148770 0x7f39d813da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8148770 0x7f39d813da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35178/0 (socket says 172.21.15.5:35178) 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39cffff640 1 -- 172.21.15.5:0/3536623954 learned_addr learned my addr 172.21.15.5:0/3536623954 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39d6d9d640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d813df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.463+0000 7f39d659c640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d80bf9b0 0x7f39d8140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39d6d9d640 1 -- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d80bf9b0 msgr2=0x7f39d8140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39d6d9d640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d80bf9b0 0x7f39d8140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39d6d9d640 1 -- 172.21.15.5:0/3536623954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8148770 msgr2=0x7f39d813da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39d6d9d640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8148770 0x7f39d813da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39d6d9d640 1 -- 172.21.15.5:0/3536623954 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d8141290 con 0x7f39d814e360 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39d6d9d640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d813df70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f39d000ca70 tx=0x7f39d000ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39ceffd640 1 -- 172.21.15.5:0/3536623954 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d000ab10 con 0x7f39d814e360 2024-05-16T21:32:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39ceffd640 1 -- 172.21.15.5:0/3536623954 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d000acb0 con 0x7f39d814e360 2024-05-16T21:32:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d80728a0 con 0x7f39d814e360 2024-05-16T21:32:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39ceffd640 1 -- 172.21.15.5:0/3536623954 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0012620 con 0x7f39d814e360 2024-05-16T21:32:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d80a4bc0 con 0x7f39d814e360 2024-05-16T21:32:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39ceffd640 1 -- 172.21.15.5:0/3536623954 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39d0012880 con 0x7f39d814e360 2024-05-16T21:32:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.464+0000 7f39ceffd640 1 -- 172.21.15.5:0/3536623954 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f39d0007800 con 0x7f39d814e360 2024-05-16T21:32:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.465+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d8072b10 con 0x7f39d814e360 2024-05-16T21:32:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.467+0000 7f39ceffd640 1 -- 172.21.15.5:0/3536623954 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f39d0020020 con 0x7f39d814e360 2024-05-16T21:32:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.530+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39d8050940 con 0x7f39d814e360 2024-05-16T21:32:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.531+0000 7f39ceffd640 1 -- 172.21.15.5:0/3536623954 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f39d0007a00 con 0x7f39d814e360 2024-05-16T21:32:00.532 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:00.533 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:00.281340+0000","last_up_change":"0.000000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.531+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 msgr2=0x7f39d813df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.531+0000 7f39dc8f2640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d813df70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f39d000ca70 tx=0x7f39d000ce70 comp rx=0 tx=0).stop 2024-05-16T21:32:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.532+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 shutdown_connections 2024-05-16T21:32:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.532+0000 7f39dc8f2640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d814e360 0x7f39d813df70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.532+0000 7f39dc8f2640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d8148770 0x7f39d813da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.532+0000 7f39dc8f2640 1 --2- 172.21.15.5:0/3536623954 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d80bf9b0 0x7f39d8140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.532+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 >> 172.21.15.5:0/3536623954 conn(0x7f39d80c17c0 msgr2=0x7f39d80be6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.532+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 shutdown_connections 2024-05-16T21:32:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:00.532+0000 7f39dc8f2640 1 -- 172.21.15.5:0/3536623954 wait complete. 2024-05-16T21:32:00.544 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-16T21:32:00.544 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-16T21:32:00.549 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:00.547+0000 7ff3a5634040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-16T21:32:00.566 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:00.565+0000 7f2bf2f1c040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-16T21:32:00.807 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:00.804+0000 7ff3a5634040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-16T21:32:00.841 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:00.839+0000 7f2bf2f1c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-16T21:32:00.859 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:00.857+0000 7ff3a5634040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-16T21:32:00.896 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:00.894+0000 7f2bf2f1c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-16T21:32:00.923 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-05-16T21:32:00.920+0000 7f08ebcb1640 -1 Falling back to public interface 2024-05-16T21:32:00.925 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-05-16T21:32:00.924+0000 7f4102c20640 -1 Falling back to public interface 2024-05-16T21:32:00.928 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-05-16T21:32:00.925+0000 7f7c7920d640 -1 Falling back to public interface 2024-05-16T21:32:00.931 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-05-16T21:32:00.929+0000 7fb11fa30640 -1 Falling back to public interface 2024-05-16T21:32:00.935 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-05-16T21:32:00.933+0000 7f4081810640 -1 Falling back to public interface 2024-05-16T21:32:00.940 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-05-16T21:32:00.937+0000 7f4fd80b5640 -1 Falling back to public interface 2024-05-16T21:32:00.943 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-05-16T21:32:00.941+0000 7f456100f640 -1 Falling back to public interface 2024-05-16T21:32:00.952 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-05-16T21:32:00.951+0000 7f15b37c0640 -1 Falling back to public interface 2024-05-16T21:32:00.979 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:00.977+0000 7ff3a5634040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-16T21:32:01.021 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:01.020+0000 7f2bf2f1c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-16T21:32:01.259 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:01.256+0000 7ff3a5634040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-16T21:32:01.305 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:01.303+0000 7ff3a5634040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-16T21:32:01.318 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:01.317+0000 7f2bf2f1c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-16T21:32:01.349 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:01.369 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:01.368+0000 7f2bf2f1c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-16T21:32:01.453 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.451+0000 7fa6fa684640 1 Processor -- start 2024-05-16T21:32:01.453 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.452+0000 7fa6fa684640 1 -- start start 2024-05-16T21:32:01.455 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6fa684640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa6f4148690 0x7fa6f40bef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:01.455 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6fa684640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6f40bf890 con 0x7fa6f406c6e0 2024-05-16T21:32:01.455 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6fa684640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6f414e4a0 con 0x7fa6f414ef80 2024-05-16T21:32:01.455 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6fa684640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa6f414e780 con 0x7fa6f4148690 2024-05-16T21:32:01.455 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6f8c21640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6f406c6e0 0x7fa6f4158c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59912/0 (socket says 172.21.15.5:59912) 2024-05-16T21:32:01.456 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6f8c21640 1 -- 172.21.15.5:0/2388950651 learned_addr learned my addr 172.21.15.5:0/2388950651 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:01.456 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6f37fe640 1 --2- 172.21.15.5:0/2388950651 >> v2:172.21.15.157:3300/0 conn(0x7fa6f4148690 0x7fa6f40bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:01.456 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6f2ffd640 1 -- 172.21.15.5:0/2388950651 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732698225 0 0) 0x7fa6ec001490 con 0x7fa6f406c6e0 2024-05-16T21:32:01.456 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6f2ffd640 1 -- 172.21.15.5:0/2388950651 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e0003520 con 0x7fa6f406c6e0 2024-05-16T21:32:01.456 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6f37fe640 1 -- 172.21.15.5:0/2388950651 >> v1:172.21.15.157:6789/0 conn(0x7fa6f414ef80 legacy=0x7fa6f40bb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:01.456 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6f37fe640 1 -- 172.21.15.5:0/2388950651 >> v1:172.21.15.5:6789/0 conn(0x7fa6f406c6e0 legacy=0x7fa6f4158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:01.456 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.453+0000 7fa6f37fe640 1 -- 172.21.15.5:0/2388950651 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f414ea60 con 0x7fa6f4148690 2024-05-16T21:32:01.457 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.454+0000 7fa6f37fe640 1 --2- 172.21.15.5:0/2388950651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 0x7fa6f40bef50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40097a0 tx=0x7fa6e402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7abb7530672977a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:01.457 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.454+0000 7fa6f2ffd640 1 -- 172.21.15.5:0/2388950651 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4037070 con 0x7fa6f4148690 2024-05-16T21:32:01.457 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.454+0000 7fa6f2ffd640 1 -- 172.21.15.5:0/2388950651 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e4032640 con 0x7fa6f4148690 2024-05-16T21:32:01.457 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.454+0000 7fa6f2ffd640 1 -- 172.21.15.5:0/2388950651 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4032a10 con 0x7fa6f4148690 2024-05-16T21:32:01.458 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.455+0000 7fa6fa684640 1 -- 172.21.15.5:0/2388950651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 msgr2=0x7fa6f40bef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:01.458 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.455+0000 7fa6fa684640 1 --2- 172.21.15.5:0/2388950651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 0x7fa6f40bef50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40097a0 tx=0x7fa6e402a2c0 comp rx=0 tx=0).stop 2024-05-16T21:32:01.458 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.455+0000 7fa6fa684640 1 -- 172.21.15.5:0/2388950651 shutdown_connections 2024-05-16T21:32:01.458 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.455+0000 7fa6fa684640 1 --2- 172.21.15.5:0/2388950651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 0x7fa6f40bef50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:01.458 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.455+0000 7fa6fa684640 1 -- 172.21.15.5:0/2388950651 >> 172.21.15.5:0/2388950651 conn(0x7fa6f406d7f0 msgr2=0x7fa6f406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:01.458 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.455+0000 7fa6fa684640 1 -- 172.21.15.5:0/2388950651 shutdown_connections 2024-05-16T21:32:01.458 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.455+0000 7fa6fa684640 1 -- 172.21.15.5:0/2388950651 wait complete. 2024-05-16T21:32:01.459 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.457+0000 7fa6fa684640 1 Processor -- start 2024-05-16T21:32:01.459 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.457+0000 7fa6fa684640 1 -- start start 2024-05-16T21:32:01.461 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6fa684640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6f406c6e0 0x7fa6f4070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:01.461 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6fa684640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 0x7fa6f40b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:01.461 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6fa684640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6f414ef80 0x7fa6f4147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:01.461 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6fa684640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f40bf610 con 0x7fa6f406c6e0 2024-05-16T21:32:01.461 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6fa684640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f40bf490 con 0x7fa6f4148690 2024-05-16T21:32:01.461 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6fa684640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f406caf0 con 0x7fa6f414ef80 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6f406c6e0 0x7fa6f4070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6f406c6e0 0x7fa6f4070ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35186/0 (socket says 172.21.15.5:35186) 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f3fff640 1 -- 172.21.15.5:0/1408243872 learned_addr learned my addr 172.21.15.5:0/1408243872 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f37fe640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 0x7fa6f40b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f8c21640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6f414ef80 0x7fa6f4147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f3fff640 1 -- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6f414ef80 msgr2=0x7fa6f4147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f3fff640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6f414ef80 0x7fa6f4147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f3fff640 1 -- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 msgr2=0x7fa6f40b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f3fff640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 0x7fa6f40b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f3fff640 1 -- 172.21.15.5:0/1408243872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f40b6e60 con 0x7fa6f406c6e0 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.458+0000 7fa6f37fe640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 0x7fa6f40b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.459+0000 7fa6f3fff640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6f406c6e0 0x7fa6f4070ea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c400 tx=0x7fa6dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.459+0000 7fa6f0ff9640 1 -- 172.21.15.5:0/1408243872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc017070 con 0x7fa6f406c6e0 2024-05-16T21:32:01.462 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.459+0000 7fa6f0ff9640 1 -- 172.21.15.5:0/1408243872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6dc0052d0 con 0x7fa6f406c6e0 2024-05-16T21:32:01.463 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.459+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f4070a30 con 0x7fa6f406c6e0 2024-05-16T21:32:01.463 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.459+0000 7fa6f0ff9640 1 -- 172.21.15.5:0/1408243872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc003830 con 0x7fa6f406c6e0 2024-05-16T21:32:01.463 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.459+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f4151d10 con 0x7fa6f406c6e0 2024-05-16T21:32:01.463 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.459+0000 7fa6f0ff9640 1 -- 172.21.15.5:0/1408243872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa6dc01a070 con 0x7fa6f406c6e0 2024-05-16T21:32:01.463 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.459+0000 7fa6f0ff9640 1 -- 172.21.15.5:0/1408243872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa6dc011b30 con 0x7fa6f406c6e0 2024-05-16T21:32:01.463 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:01.457+0000 7ff3a5634040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-16T21:32:01.463 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.460+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f41527f0 con 0x7fa6f406c6e0 2024-05-16T21:32:01.464 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.463+0000 7fa6f0ff9640 1 -- 172.21.15.5:0/1408243872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa6f41527f0 con 0x7fa6f406c6e0 2024-05-16T21:32:01.528 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.526+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6f406a050 con 0x7fa6f406c6e0 2024-05-16T21:32:01.528 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.527+0000 7fa6f0ff9640 1 -- 172.21.15.5:0/1408243872 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa6dc021020 con 0x7fa6f406c6e0 2024-05-16T21:32:01.529 INFO:teuthology.misc.health.smithi005.stdout: 2024-05-16T21:32:01.529 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:00.281340+0000","last_up_change":"0.000000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6f406c6e0 msgr2=0x7fa6f4070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6f406c6e0 0x7fa6f4070ea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c400 tx=0x7fa6dc00c8c0 comp rx=0 tx=0).stop 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 shutdown_connections 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6f414ef80 0x7fa6f4147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6f4148690 0x7fa6f40b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 --2- 172.21.15.5:0/1408243872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6f406c6e0 0x7fa6f4070ea0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 >> 172.21.15.5:0/1408243872 conn(0x7fa6f406d7f0 msgr2=0x7fa6f406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 shutdown_connections 2024-05-16T21:32:01.530 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:01.528+0000 7fa6fa684640 1 -- 172.21.15.5:0/1408243872 wait complete. 2024-05-16T21:32:01.539 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-16T21:32:01.541 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:01.539+0000 7f2bf2f1c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-16T21:32:01.597 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:01.594+0000 7ff3a5634040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-16T21:32:01.646 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:01.643+0000 7ff3a5634040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-16T21:32:01.686 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:01.684+0000 7f2bf2f1c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-16T21:32:01.714 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:01.712+0000 7ff3a5634040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-16T21:32:01.738 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:01.737+0000 7f2bf2f1c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-16T21:32:01.759 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:01.757+0000 7ff3a5634040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-16T21:32:01.812 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:01.811+0000 7f2bf2f1c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-16T21:32:01.860 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:01.858+0000 7f2bf2f1c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-16T21:32:02.235 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:02.232+0000 7ff3a5634040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-16T21:32:02.352 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:02.349+0000 7ff3a5634040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-16T21:32:02.369 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:02.367+0000 7f2bf2f1c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-16T21:32:02.493 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-05-16T21:32:02.491+0000 7f2bf2f1c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-16T21:32:03.370 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:03.367+0000 7ff3448fb640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-16T21:32:03.370 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-16T21:32:03.367+0000 7ff3448fb640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-16T21:32:04.418 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-05-16T21:32:04.416+0000 7f4102c20640 -1 osd.0 0 log_to_monitors true 2024-05-16T21:32:04.447 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-05-16T21:32:04.446+0000 7f4081810640 -1 osd.3 0 log_to_monitors true 2024-05-16T21:32:04.461 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-05-16T21:32:04.460+0000 7f456100f640 -1 osd.2 0 log_to_monitors true 2024-05-16T21:32:04.470 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-05-16T21:32:04.468+0000 7f15b37c0640 -1 osd.1 0 log_to_monitors true 2024-05-16T21:32:04.486 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-05-16T21:32:04.484+0000 7f7c7920d640 -1 osd.5 0 log_to_monitors true 2024-05-16T21:32:04.487 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-05-16T21:32:04.486+0000 7f4fd80b5640 -1 osd.4 0 log_to_monitors true 2024-05-16T21:32:04.497 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-05-16T21:32:04.496+0000 7fb11fa30640 -1 osd.7 0 log_to_monitors true 2024-05-16T21:32:04.499 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-05-16T21:32:04.498+0000 7f08ebcb1640 -1 osd.6 0 log_to_monitors true 2024-05-16T21:32:07.735 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-05-16T21:32:07.733+0000 7f15af756640 -1 osd.1 0 waiting for initial osdmap 2024-05-16T21:32:07.756 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-05-16T21:32:07.754+0000 7f15a7551640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T21:32:07.772 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-05-16T21:32:07.770+0000 7f40fe517640 -1 osd.0 0 waiting for initial osdmap 2024-05-16T21:32:07.781 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-05-16T21:32:07.780+0000 7f08e7c47640 -1 osd.6 0 waiting for initial osdmap 2024-05-16T21:32:07.786 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-05-16T21:32:07.785+0000 7fb11af78640 -1 osd.7 0 waiting for initial osdmap 2024-05-16T21:32:07.787 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-05-16T21:32:07.786+0000 7f40f6312640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T21:32:07.794 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-05-16T21:32:07.793+0000 7f08dfa42640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T21:32:07.795 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-05-16T21:32:07.793+0000 7f407d104640 -1 osd.3 0 waiting for initial osdmap 2024-05-16T21:32:07.799 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-05-16T21:32:07.798+0000 7fb112d73640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T21:32:07.805 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-05-16T21:32:07.804+0000 7f4074eff640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T21:32:07.809 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-05-16T21:32:07.807+0000 7f455c9ff640 -1 osd.2 0 waiting for initial osdmap 2024-05-16T21:32:07.814 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-05-16T21:32:07.813+0000 7f4fd404b640 -1 osd.4 0 waiting for initial osdmap 2024-05-16T21:32:07.822 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-05-16T21:32:07.821+0000 7f45547fa640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T21:32:07.830 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-05-16T21:32:07.829+0000 7f4fcbe46640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T21:32:07.837 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-05-16T21:32:07.835+0000 7f7c74b98640 -1 osd.5 0 waiting for initial osdmap 2024-05-16T21:32:07.849 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-05-16T21:32:07.848+0000 7f7c6c993640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T21:32:08.346 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:08.465 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.463+0000 7fe77fb3f640 1 Processor -- start 2024-05-16T21:32:08.465 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.463+0000 7fe77fb3f640 1 -- start start 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.464+0000 7fe77fb3f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe7780bd8a0 0x7fe7780be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.464+0000 7fe77fb3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe77806d550 0x7fe77814e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.464+0000 7fe77fb3f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7780bfeb0 con 0x7fe77806d960 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.464+0000 7fe77fb3f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe7780bdcb0 con 0x7fe77806d550 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.464+0000 7fe77fb3f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe7780bea80 con 0x7fe7780bd8a0 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.465+0000 7fe77d0da640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe77806d550 0x7fe77814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.465+0000 7fe77d0da640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe77806d550 0x7fe77814e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37138/0 (socket says 172.21.15.5:37138) 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.465+0000 7fe77d0da640 1 -- 172.21.15.5:0/3844989874 learned_addr learned my addr 172.21.15.5:0/3844989874 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.465+0000 7fe77d8db640 1 --2- 172.21.15.5:0/3844989874 >> v2:172.21.15.157:3300/0 conn(0x7fe7780bd8a0 0x7fe7780be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.465+0000 7fe77d0da640 1 -- 172.21.15.5:0/3844989874 >> v2:172.21.15.157:3300/0 conn(0x7fe7780bd8a0 msgr2=0x7fe7780be1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.465+0000 7fe77d0da640 1 --2- 172.21.15.5:0/3844989874 >> v2:172.21.15.157:3300/0 conn(0x7fe7780bd8a0 0x7fe7780be1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.465+0000 7fe77d0da640 1 -- 172.21.15.5:0/3844989874 >> v1:172.21.15.157:6789/0 conn(0x7fe77806d960 legacy=0x7fe778151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:08.467 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.465+0000 7fe77d0da640 1 -- 172.21.15.5:0/3844989874 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7780be6e0 con 0x7fe77806d550 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.466+0000 7fe77d0da640 1 --2- 172.21.15.5:0/3844989874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe77806d550 0x7fe77814e930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe77808d7b0 tx=0x7fe76802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92a51f1ae2d5114 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.466+0000 7fe77c8d9640 1 -- 172.21.15.5:0/3844989874 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768037070 con 0x7fe77806d550 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.466+0000 7fe77c8d9640 1 -- 172.21.15.5:0/3844989874 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76802ae50 con 0x7fe77806d550 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.466+0000 7fe77c8d9640 1 -- 172.21.15.5:0/3844989874 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768032860 con 0x7fe77806d550 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.467+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3844989874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe77806d550 msgr2=0x7fe77814e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.467+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3844989874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe77806d550 0x7fe77814e930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe77808d7b0 tx=0x7fe76802a300 comp rx=0 tx=0).stop 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.467+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3844989874 shutdown_connections 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.467+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3844989874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe77806d550 0x7fe77814e930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.467+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3844989874 >> v2:172.21.15.157:3300/0 conn(0x7fe7780bd8a0 0x7fe7780be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.467+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3844989874 >> 172.21.15.5:0/3844989874 conn(0x7fe7780c3a00 msgr2=0x7fe7780c3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.467+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3844989874 shutdown_connections 2024-05-16T21:32:08.469 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.467+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3844989874 wait complete. 2024-05-16T21:32:08.470 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.468+0000 7fe77fb3f640 1 Processor -- start 2024-05-16T21:32:08.470 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.468+0000 7fe77fb3f640 1 -- start start 2024-05-16T21:32:08.472 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.469+0000 7fe77fb3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe77806d550 0x7fe7780b8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:08.472 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.469+0000 7fe77fb3f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe77806d960 0x7fe7780b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.469+0000 7fe77fb3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7780bd8a0 0x7fe7780bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.469+0000 7fe77fb3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7780bf290 con 0x7fe7780bd8a0 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77fb3f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe7780befb0 con 0x7fe77806d960 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77fb3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe7780c34a0 con 0x7fe77806d550 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7780bd8a0 0x7fe7780bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7780bd8a0 0x7fe7780bc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37146/0 (socket says 172.21.15.5:37146) 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 -- 172.21.15.5:0/3345755741 learned_addr learned my addr 172.21.15.5:0/3345755741 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77d0da640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe77806d960 0x7fe7780b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77d8db640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe77806d550 0x7fe7780b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 -- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe77806d550 msgr2=0x7fe7780b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe77806d550 0x7fe7780b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 -- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe77806d960 msgr2=0x7fe7780b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe77806d960 0x7fe7780b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.473 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 -- 172.21.15.5:0/3345755741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7780b8cc0 con 0x7fe7780bd8a0 2024-05-16T21:32:08.474 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77e0dc640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7780bd8a0 0x7fe7780bc3f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe77000c700 tx=0x7fe77000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:08.474 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe76e7fc640 1 -- 172.21.15.5:0/3345755741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770003b70 con 0x7fe7780bd8a0 2024-05-16T21:32:08.474 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe76e7fc640 1 -- 172.21.15.5:0/3345755741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe770003d10 con 0x7fe7780bd8a0 2024-05-16T21:32:08.474 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe76e7fc640 1 -- 172.21.15.5:0/3345755741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77000aa50 con 0x7fe7780bd8a0 2024-05-16T21:32:08.474 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.470+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7781e82d0 con 0x7fe7780bd8a0 2024-05-16T21:32:08.474 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.471+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7780a50d0 con 0x7fe7780bd8a0 2024-05-16T21:32:08.475 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.472+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe778069940 con 0x7fe7780bd8a0 2024-05-16T21:32:08.475 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.472+0000 7fe76e7fc640 1 -- 172.21.15.5:0/3345755741 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fe77000abf0 con 0x7fe7780bd8a0 2024-05-16T21:32:08.475 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.473+0000 7fe76e7fc640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe75c076240 0x7fe75c078750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:08.475 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.473+0000 7fe76e7fc640 1 -- 172.21.15.5:0/3345755741 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fe7700964c0 con 0x7fe7780bd8a0 2024-05-16T21:32:08.475 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.473+0000 7fe77d8db640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe75c076240 0x7fe75c078750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:08.475 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.473+0000 7fe77d8db640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe75c076240 0x7fe75c078750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe774009aa0 tx=0x7fe774009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:08.479 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.478+0000 7fe76e7fc640 1 -- 172.21.15.5:0/3345755741 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe7780b8cc0 con 0x7fe7780bd8a0 2024-05-16T21:32:08.670 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.669+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7780bfb60 con 0x7fe7780bd8a0 2024-05-16T21:32:08.671 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.669+0000 7fe76e7fc640 1 -- 172.21.15.5:0/3345755741 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fe770060640 con 0x7fe7780bd8a0 2024-05-16T21:32:08.671 INFO:teuthology.misc.health.smithi005.stdout: 2024-05-16T21:32:08.671 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":12,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:06.366318+0000","last_up_change":"0.000000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.671+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe75c076240 msgr2=0x7fe75c078750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.671+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe75c076240 0x7fe75c078750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe774009aa0 tx=0x7fe774009190 comp rx=0 tx=0).stop 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.671+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7780bd8a0 msgr2=0x7fe7780bc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.671+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7780bd8a0 0x7fe7780bc3f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe77000c700 tx=0x7fe77000cbc0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.672+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 shutdown_connections 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.672+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe75c076240 0x7fe75c078750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.672+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7780bd8a0 0x7fe7780bc3f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.672+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe77806d960 0x7fe7780b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.672+0000 7fe77fb3f640 1 --2- 172.21.15.5:0/3345755741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe77806d550 0x7fe7780b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.672+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 >> 172.21.15.5:0/3345755741 conn(0x7fe7780c3a00 msgr2=0x7fe77814b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.672+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 shutdown_connections 2024-05-16T21:32:08.674 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:08.672+0000 7fe77fb3f640 1 -- 172.21.15.5:0/3345755741 wait complete. 2024-05-16T21:32:08.683 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-16T21:32:15.491 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:15.608 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.607+0000 7f1253dee640 1 Processor -- start 2024-05-16T21:32:15.608 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.607+0000 7f1253dee640 1 -- start start 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f1253dee640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f124c0beab0 0x7f124c1453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f1253dee640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f124c0bbed0 con 0x7f124c0b5df0 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f1253dee640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f124c0ba500 con 0x7f124c0b9fe0 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f1253dee640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f124c0b5460 con 0x7f124c0beab0 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f125238b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f124c0b5df0 0x7f124c0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44504/0 (socket says 172.21.15.5:44504) 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f125238b640 1 -- 172.21.15.5:0/892875456 learned_addr learned my addr 172.21.15.5:0/892875456 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150463612 0 0) 0x7f124c0bbed0 con 0x7f124c0b5df0 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f1251389640 1 --2- 172.21.15.5:0/892875456 >> v2:172.21.15.157:3300/0 conn(0x7f124c0beab0 0x7f124c1453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.608+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1238003520 con 0x7f124c0b5df0 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 915372832 0 0) 0x7f1238003520 con 0x7f124c0b5df0 2024-05-16T21:32:15.612 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 >> v2:172.21.15.157:3300/0 conn(0x7f124c0beab0 msgr2=0x7f124c1453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 --2- 172.21.15.5:0/892875456 >> v2:172.21.15.157:3300/0 conn(0x7f124c0beab0 0x7f124c1453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 >> v1:172.21.15.157:6789/0 conn(0x7f124c0b9fe0 legacy=0x7f124c0bb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124c0ba7e0 con 0x7f124c0b5df0 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f1244001a70 con 0x7f124c0b5df0 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 >> v1:172.21.15.5:6789/0 conn(0x7f124c0b5df0 legacy=0x7f124c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1238003a00 0x7f1238003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f1238004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12380051c0 0x7f123800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f124c0b5460 con 0x7f1238004800 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f123800c160 con 0x7f1238003a00 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f123800c360 con 0x7f12380051c0 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1251389640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f1238004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1251b8a640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1238003a00 0x7f1238003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.613 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f125238b640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12380051c0 0x7f123800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1251389640 1 -- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12380051c0 msgr2=0x7f123800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1251389640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12380051c0 0x7f123800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1251389640 1 -- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1238003a00 msgr2=0x7f1238003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1251389640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1238003a00 0x7f1238003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f1251389640 1 -- 172.21.15.5:0/892875456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1238003520 con 0x7f1238004800 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f125238b640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12380051c0 0x7f123800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.609+0000 7f125238b640 1 -- 172.21.15.5:0/892875456 reap_dead start 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.610+0000 7f1251389640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f1238004c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f124c06e410 tx=0x7f1238005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d138008e227fd14 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.610+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c036070 con 0x7f1238004800 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.610+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123c005990 con 0x7f1238004800 2024-05-16T21:32:15.614 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.610+0000 7f1250b88640 1 -- 172.21.15.5:0/892875456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c009680 con 0x7f1238004800 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.611+0000 7f1253dee640 1 -- 172.21.15.5:0/892875456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 msgr2=0x7f1238004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.611+0000 7f1253dee640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f1238004c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f124c06e410 tx=0x7f1238005830 comp rx=0 tx=0).stop 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.611+0000 7f1253dee640 1 -- 172.21.15.5:0/892875456 shutdown_connections 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.611+0000 7f1253dee640 1 --2- 172.21.15.5:0/892875456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f1238004c10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.611+0000 7f1253dee640 1 -- 172.21.15.5:0/892875456 >> 172.21.15.5:0/892875456 conn(0x7f124c0a1390 msgr2=0x7f124c0a17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.611+0000 7f1253dee640 1 -- 172.21.15.5:0/892875456 shutdown_connections 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.611+0000 7f1253dee640 1 -- 172.21.15.5:0/892875456 wait complete. 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.613+0000 7f1253dee640 1 Processor -- start 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.613+0000 7f1253dee640 1 -- start start 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1253dee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f124c14a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1253dee640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124c0a40c0 0x7f124c072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.617 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1253dee640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f124c1e4610 0x7f124c1e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1253dee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f124c1453d0 con 0x7f1238004800 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1253dee640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f124c0b5880 con 0x7f124c0a40c0 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1253dee640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f124c145550 con 0x7f124c1e4610 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f124c14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f124c14a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37164/0 (socket says 172.21.15.5:37164) 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 -- 172.21.15.5:0/69670179 learned_addr learned my addr 172.21.15.5:0/69670179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251389640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124c0a40c0 0x7f124c072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f125238b640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f124c1e4610 0x7f124c1e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 -- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f124c1e4610 msgr2=0x7f124c1e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f124c1e4610 0x7f124c1e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 -- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124c0a40c0 msgr2=0x7f124c072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124c0a40c0 0x7f124c072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.618 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 -- 172.21.15.5:0/69670179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124c072650 con 0x7f1238004800 2024-05-16T21:32:15.619 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f1251b8a640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f124c14a580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f124800f850 tx=0x7f124800fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:15.619 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f12427fc640 1 -- 172.21.15.5:0/69670179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12480052e0 con 0x7f1238004800 2024-05-16T21:32:15.619 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.614+0000 7f12427fc640 1 -- 172.21.15.5:0/69670179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1248018070 con 0x7f1238004800 2024-05-16T21:32:15.619 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.615+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124c0b9560 con 0x7f1238004800 2024-05-16T21:32:15.619 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.615+0000 7f12427fc640 1 -- 172.21.15.5:0/69670179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124800d970 con 0x7f1238004800 2024-05-16T21:32:15.619 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.615+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f124c14b7e0 con 0x7f1238004800 2024-05-16T21:32:15.620 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.615+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124c069940 con 0x7f1238004800 2024-05-16T21:32:15.620 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.616+0000 7f12427fc640 1 -- 172.21.15.5:0/69670179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f124800db10 con 0x7f1238004800 2024-05-16T21:32:15.620 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.617+0000 7f12427fc640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1230076300 0x7f1230078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.620 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.617+0000 7f12427fc640 1 -- 172.21.15.5:0/69670179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f1248097050 con 0x7f1238004800 2024-05-16T21:32:15.620 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.617+0000 7f1251389640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1230076300 0x7f1230078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.620 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.618+0000 7f1251389640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1230076300 0x7f1230078810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f123c033000 tx=0x7f123c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:15.623 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.622+0000 7f12427fc640 1 -- 172.21.15.5:0/69670179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1248060d90 con 0x7f1238004800 2024-05-16T21:32:15.815 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.813+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f124c0bf2d0 con 0x7f1238004800 2024-05-16T21:32:15.816 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.814+0000 7f12427fc640 1 -- 172.21.15.5:0/69670179 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12836 (secure 0 0 0) 0x7f1248060690 con 0x7f1238004800 2024-05-16T21:32:15.816 INFO:teuthology.misc.health.smithi005.stdout: 2024-05-16T21:32:15.816 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":17,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:12.752026+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:15.818 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1230076300 msgr2=0x7f1230078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.818 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1230076300 0x7f1230078810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f123c033000 tx=0x7f123c008030 comp rx=0 tx=0).stop 2024-05-16T21:32:15.818 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 msgr2=0x7f124c14a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.818 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f124c14a580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f124800f850 tx=0x7f124800fd10 comp rx=0 tx=0).stop 2024-05-16T21:32:15.818 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 shutdown_connections 2024-05-16T21:32:15.818 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1230076300 0x7f1230078810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.819 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f124c1e4610 0x7f124c1e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.819 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124c0a40c0 0x7f124c072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.819 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 --2- 172.21.15.5:0/69670179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1238004800 0x7f124c14a580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.819 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 >> 172.21.15.5:0/69670179 conn(0x7f124c0a1390 msgr2=0x7f124c0bd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:15.819 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 shutdown_connections 2024-05-16T21:32:15.819 INFO:teuthology.misc.health.smithi005.stderr:2024-05-16T21:32:15.816+0000 7f1253dee640 1 -- 172.21.15.5:0/69670179 wait complete. 2024-05-16T21:32:15.828 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-16T21:32:15.828 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-16T21:32:15.828 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-16T21:32:15.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-16T21:32:15.830 INFO:tasks.ceph.mds.a:Started 2024-05-16T21:32:15.831 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-16T21:32:15.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-16T21:32:15.833 INFO:tasks.ceph.mds.c:Started 2024-05-16T21:32:15.833 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-16T21:32:15.833 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-16T21:32:15.835 INFO:tasks.ceph.mds.b:Started 2024-05-16T21:32:15.836 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-16T21:32:15.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:15.918 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-05-16T21:32:15.919 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-05-16T21:32:15.931 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-05-16T21:32:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.953+0000 7f1f0bc84640 1 Processor -- start 2024-05-16T21:32:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.953+0000 7f1f0bc84640 1 -- start start 2024-05-16T21:32:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.954+0000 7f1f0bc84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f040be3f0 0x7f1f0406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.954+0000 7f1f0bc84640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0406ce00 con 0x7f1f041500b0 2024-05-16T21:32:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.954+0000 7f1f0bc84640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f040bba30 con 0x7f1f0414cb00 2024-05-16T21:32:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.954+0000 7f1f0bc84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1f040bbd10 con 0x7f1f040be3f0 2024-05-16T21:32:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f0a221640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f041500b0 0x7f1f04156bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44516/0 (socket says 172.21.15.5:44516) 2024-05-16T21:32:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f0a221640 1 -- 172.21.15.5:0/1836170468 learned_addr learned my addr 172.21.15.5:0/1836170468 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f09a20640 1 --2- 172.21.15.5:0/1836170468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f040be3f0 0x7f1f0406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f08a1e640 1 -- 172.21.15.5:0/1836170468 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175870262 0 0) 0x7f1f0406ce00 con 0x7f1f041500b0 2024-05-16T21:32:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f08a1e640 1 -- 172.21.15.5:0/1836170468 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1eec003520 con 0x7f1f041500b0 2024-05-16T21:32:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f08a1e640 1 -- 172.21.15.5:0/1836170468 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708623664 0 0) 0x7f1f040bba30 con 0x7f1f0414cb00 2024-05-16T21:32:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f08a1e640 1 -- 172.21.15.5:0/1836170468 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f0406ce00 con 0x7f1f0414cb00 2024-05-16T21:32:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f09a20640 1 -- 172.21.15.5:0/1836170468 >> v1:172.21.15.157:6789/0 conn(0x7f1f0414cb00 legacy=0x7f1f0414f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f09a20640 1 -- 172.21.15.5:0/1836170468 >> v1:172.21.15.5:6789/0 conn(0x7f1f041500b0 legacy=0x7f1f04156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.955+0000 7f1f09a20640 1 -- 172.21.15.5:0/1836170468 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f040bbff0 con 0x7f1f040be3f0 2024-05-16T21:32:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.956+0000 7f1f09a20640 1 --2- 172.21.15.5:0/1836170468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f040be3f0 0x7f1f0406c8c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0097d0 tx=0x7f1efc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5828b778d1a95501 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.956+0000 7f1f08a1e640 1 -- 172.21.15.5:0/1836170468 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc037070 con 0x7f1f040be3f0 2024-05-16T21:32:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.956+0000 7f1f08a1e640 1 -- 172.21.15.5:0/1836170468 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1efc032440 con 0x7f1f040be3f0 2024-05-16T21:32:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.956+0000 7f1f08a1e640 1 -- 172.21.15.5:0/1836170468 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc032810 con 0x7f1f040be3f0 2024-05-16T21:32:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.957+0000 7f1f0bc84640 1 -- 172.21.15.5:0/1836170468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f040be3f0 msgr2=0x7f1f0406c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.957+0000 7f1f0bc84640 1 --2- 172.21.15.5:0/1836170468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f040be3f0 0x7f1f0406c8c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0097d0 tx=0x7f1efc02a210 comp rx=0 tx=0).stop 2024-05-16T21:32:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.957+0000 7f1f0bc84640 1 -- 172.21.15.5:0/1836170468 shutdown_connections 2024-05-16T21:32:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.957+0000 7f1f0bc84640 1 --2- 172.21.15.5:0/1836170468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f040be3f0 0x7f1f0406c8c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.957+0000 7f1f0bc84640 1 -- 172.21.15.5:0/1836170468 >> 172.21.15.5:0/1836170468 conn(0x7f1f040bd0f0 msgr2=0x7f1f040bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.957+0000 7f1f0bc84640 1 -- 172.21.15.5:0/1836170468 shutdown_connections 2024-05-16T21:32:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.957+0000 7f1f0bc84640 1 -- 172.21.15.5:0/1836170468 wait complete. 2024-05-16T21:32:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.958+0000 7f1f0bc84640 1 Processor -- start 2024-05-16T21:32:15.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.958+0000 7f1f0bc84640 1 -- start start 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.959+0000 7f1f0bc84640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f040be3f0 0x7f1f0414eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.959+0000 7f1f0bc84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f0414cb00 0x7f1f04071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.959+0000 7f1f0bc84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f041500b0 0x7f1f04143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.959+0000 7f1f0bc84640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04074d00 con 0x7f1f041500b0 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.959+0000 7f1f0bc84640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04074b80 con 0x7f1f040be3f0 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.959+0000 7f1f0bc84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0414cf10 con 0x7f1f0414cb00 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f041500b0 0x7f1f04143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f09a20640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f040be3f0 0x7f1f0414eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f041500b0 0x7f1f04143a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37202/0 (socket says 172.21.15.5:37202) 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 -- 172.21.15.5:0/3220517755 learned_addr learned my addr 172.21.15.5:0/3220517755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0921f640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f0414cb00 0x7f1f04071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 -- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f0414cb00 msgr2=0x7f1f04071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f0414cb00 0x7f1f04071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 -- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f040be3f0 msgr2=0x7f1f0414eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f040be3f0 0x7f1f0414eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 -- 172.21.15.5:0/3220517755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f04071960 con 0x7f1f041500b0 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0a221640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f041500b0 0x7f1f04143a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400ca70 tx=0x7f1ef400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f027fc640 1 -- 172.21.15.5:0/3220517755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef400abd0 con 0x7f1f041500b0 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f027fc640 1 -- 172.21.15.5:0/3220517755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef400ad70 con 0x7f1f041500b0 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0414d6e0 con 0x7f1f041500b0 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f027fc640 1 -- 172.21.15.5:0/3220517755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4012640 con 0x7f1f041500b0 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.960+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f040b9d00 con 0x7f1f041500b0 2024-05-16T21:32:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.961+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f040737a0 con 0x7f1f041500b0 2024-05-16T21:32:15.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.962+0000 7f1f027fc640 1 -- 172.21.15.5:0/3220517755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ef40127e0 con 0x7f1f041500b0 2024-05-16T21:32:15.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.962+0000 7f1f027fc640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ef00762d0 0x7f1ef00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:15.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.962+0000 7f1f027fc640 1 -- 172.21.15.5:0/3220517755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f1ef40977b0 con 0x7f1f041500b0 2024-05-16T21:32:15.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.962+0000 7f1f09a20640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ef00762d0 0x7f1ef00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:15.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.963+0000 7f1f09a20640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ef00762d0 0x7f1ef00787e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1efc034000 tx=0x7f1efc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:15.967+0000 7f1f027fc640 1 -- 172.21.15.5:0/3220517755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1f040737a0 con 0x7f1f041500b0 2024-05-16T21:32:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.196+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f040bda30 con 0x7f1f041500b0 2024-05-16T21:32:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.197+0000 7f1f027fc640 1 -- 172.21.15.5:0/3220517755 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1386 (secure 0 0 0) 0x7f1f040bda30 con 0x7f1f041500b0 2024-05-16T21:32:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:16.199 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-16T21:32:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ef00762d0 msgr2=0x7f1ef00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ef00762d0 0x7f1ef00787e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1efc034000 tx=0x7f1efc02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f041500b0 msgr2=0x7f1f04143a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f041500b0 0x7f1f04143a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400ca70 tx=0x7f1ef400cf30 comp rx=0 tx=0).stop 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 shutdown_connections 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ef00762d0 0x7f1ef00787e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f041500b0 0x7f1f04143a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f0414cb00 0x7f1f04071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 --2- 172.21.15.5:0/3220517755 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f040be3f0 0x7f1f0414eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 >> 172.21.15.5:0/3220517755 conn(0x7f1f040bd0f0 msgr2=0x7f1f04073090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 shutdown_connections 2024-05-16T21:32:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:16.199+0000 7f1f0bc84640 1 -- 172.21.15.5:0/3220517755 wait complete. 2024-05-16T21:32:18.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:18.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.336+0000 7fd6b066a640 1 Processor -- start 2024-05-16T21:32:18.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.336+0000 7fd6b066a640 1 -- start start 2024-05-16T21:32:18.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.337+0000 7fd6b066a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80bd440 0x7fd6a80bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.337+0000 7fd6b066a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd6a80b8d70 0x7fd6a80b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.337+0000 7fd6b066a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a80bdd90 con 0x7fd6a814e530 2024-05-16T21:32:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.337+0000 7fd6b066a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a80b88e0 con 0x7fd6a80b8d70 2024-05-16T21:32:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.337+0000 7fd6b066a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a814ece0 con 0x7fd6a80bd440 2024-05-16T21:32:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6adc05640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80bd440 0x7fd6a80bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6adc05640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80bd440 0x7fd6a80bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:60822/0 (socket says 172.21.15.5:60822) 2024-05-16T21:32:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6adc05640 1 -- 172.21.15.5:0/824140275 learned_addr learned my addr 172.21.15.5:0/824140275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6aec07640 1 --2- 172.21.15.5:0/824140275 >> v2:172.21.15.157:3300/0 conn(0x7fd6a80b8d70 0x7fd6a80b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6aec07640 1 -- 172.21.15.5:0/824140275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80bd440 msgr2=0x7fd6a80bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:18.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6aec07640 1 --2- 172.21.15.5:0/824140275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80bd440 0x7fd6a80bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6aec07640 1 -- 172.21.15.5:0/824140275 >> v1:172.21.15.157:6789/0 conn(0x7fd6a814e530 legacy=0x7fd6a80ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6ad404640 1 -- 172.21.15.5:0/824140275 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984580903 0 0) 0x7fd6a80bdd90 con 0x7fd6a814e530 2024-05-16T21:32:18.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6aec07640 1 -- 172.21.15.5:0/824140275 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a814efc0 con 0x7fd6a80b8d70 2024-05-16T21:32:18.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.338+0000 7fd6adc05640 1 --2- 172.21.15.5:0/824140275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80bd440 0x7fd6a80bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:18.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.339+0000 7fd6aec07640 1 --2- 172.21.15.5:0/824140275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a80b8d70 0x7fd6a80b9180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00097a0 tx=0x7fd6a002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290f93bbd71a541d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:18.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.339+0000 7fd6ad404640 1 -- 172.21.15.5:0/824140275 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0037070 con 0x7fd6a80b8d70 2024-05-16T21:32:18.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.339+0000 7fd6ad404640 1 -- 172.21.15.5:0/824140275 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a0032440 con 0x7fd6a80b8d70 2024-05-16T21:32:18.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.339+0000 7fd6ad404640 1 -- 172.21.15.5:0/824140275 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0032810 con 0x7fd6a80b8d70 2024-05-16T21:32:18.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.340+0000 7fd6b066a640 1 -- 172.21.15.5:0/824140275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a80b8d70 msgr2=0x7fd6a80b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.340+0000 7fd6b066a640 1 --2- 172.21.15.5:0/824140275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a80b8d70 0x7fd6a80b9180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00097a0 tx=0x7fd6a002a180 comp rx=0 tx=0).stop 2024-05-16T21:32:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.340+0000 7fd6b066a640 1 -- 172.21.15.5:0/824140275 shutdown_connections 2024-05-16T21:32:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.340+0000 7fd6b066a640 1 --2- 172.21.15.5:0/824140275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a80b8d70 0x7fd6a80b9180 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.340+0000 7fd6b066a640 1 --2- 172.21.15.5:0/824140275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80bd440 0x7fd6a80bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.340+0000 7fd6b066a640 1 -- 172.21.15.5:0/824140275 >> 172.21.15.5:0/824140275 conn(0x7fd6a80c0570 msgr2=0x7fd6a80c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.340+0000 7fd6b066a640 1 -- 172.21.15.5:0/824140275 shutdown_connections 2024-05-16T21:32:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.340+0000 7fd6b066a640 1 -- 172.21.15.5:0/824140275 wait complete. 2024-05-16T21:32:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.342+0000 7fd6b066a640 1 Processor -- start 2024-05-16T21:32:18.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.342+0000 7fd6b066a640 1 -- start start 2024-05-16T21:32:18.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6b066a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80b8d70 0x7fd6a81412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6b066a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6a80bd440 0x7fd6a813f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6b066a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a814e530 0x7fd6a8140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6b066a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a80b96c0 con 0x7fd6a80bd440 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6b066a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a80bbb70 con 0x7fd6a814e530 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6b066a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a814e940 con 0x7fd6a80b8d70 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6adc05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6a80bd440 0x7fd6a813f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6adc05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6a80bd440 0x7fd6a813f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47472/0 (socket says 172.21.15.5:47472) 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6adc05640 1 -- 172.21.15.5:0/482819591 learned_addr learned my addr 172.21.15.5:0/482819591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6aec07640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a814e530 0x7fd6a8140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6ae406640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80b8d70 0x7fd6a81412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6adc05640 1 -- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80b8d70 msgr2=0x7fd6a81412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6adc05640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80b8d70 0x7fd6a81412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6adc05640 1 -- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a814e530 msgr2=0x7fd6a8140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6adc05640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a814e530 0x7fd6a8140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.343+0000 7fd6adc05640 1 -- 172.21.15.5:0/482819591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a81417e0 con 0x7fd6a80bd440 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.344+0000 7fd6adc05640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6a80bd440 0x7fd6a813f2e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00e9e0 tx=0x7fd69c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.344+0000 7fd6a6ffd640 1 -- 172.21.15.5:0/482819591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c017070 con 0x7fd6a80bd440 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.344+0000 7fd6a6ffd640 1 -- 172.21.15.5:0/482819591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c00c9d0 con 0x7fd6a80bd440 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.344+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a813f820 con 0x7fd6a80bd440 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.344+0000 7fd6a6ffd640 1 -- 172.21.15.5:0/482819591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00cd80 con 0x7fd6a80bd440 2024-05-16T21:32:18.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.344+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a81409a0 con 0x7fd6a80bd440 2024-05-16T21:32:18.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.345+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a8050940 con 0x7fd6a80bd440 2024-05-16T21:32:18.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.346+0000 7fd6a6ffd640 1 -- 172.21.15.5:0/482819591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd69c01a070 con 0x7fd6a80bd440 2024-05-16T21:32:18.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.346+0000 7fd6a6ffd640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd694076300 0x7fd694078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.347+0000 7fd6a6ffd640 1 -- 172.21.15.5:0/482819591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd69c097140 con 0x7fd6a80bd440 2024-05-16T21:32:18.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.347+0000 7fd6ae406640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd694076300 0x7fd694078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.347+0000 7fd6ae406640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd694076300 0x7fd694078810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd698001cf0 tx=0x7fd698009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:18.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.352+0000 7fd6a6ffd640 1 -- 172.21.15.5:0/482819591 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd6a81417e0 con 0x7fd6a80bd440 2024-05-16T21:32:18.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.581+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6a806d0c0 con 0x7fd6a80bd440 2024-05-16T21:32:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.582+0000 7fd6a6ffd640 1 -- 172.21.15.5:0/482819591 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3031 (secure 0 0 0) 0x7fd69c060de0 con 0x7fd6a80bd440 2024-05-16T21:32:18.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:18.584 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-16T21:32:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-05-16T21:32:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd694076300 msgr2=0x7fd694078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd694076300 0x7fd694078810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd698001cf0 tx=0x7fd698009040 comp rx=0 tx=0).stop 2024-05-16T21:32:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6a80bd440 msgr2=0x7fd6a813f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6a80bd440 0x7fd6a813f2e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00e9e0 tx=0x7fd69c00eea0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 shutdown_connections 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd694076300 0x7fd694078810 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6a814e530 0x7fd6a8140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6a80bd440 0x7fd6a813f2e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 --2- 172.21.15.5:0/482819591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6a80b8d70 0x7fd6a81412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 >> 172.21.15.5:0/482819591 conn(0x7fd6a80c0570 msgr2=0x7fd6a80c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 shutdown_connections 2024-05-16T21:32:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.584+0000 7fd6b066a640 1 -- 172.21.15.5:0/482819591 wait complete. 2024-05-16T21:32:18.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-16T21:32:18.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.706+0000 7f19753ce640 1 Processor -- start 2024-05-16T21:32:18.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.706+0000 7f19753ce640 1 -- start start 2024-05-16T21:32:18.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f19753ce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19700bd6d0 0x7f19700be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f19753ce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19700bee80 0x7f1970158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f19753ce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197006e140 con 0x7f1970151fc0 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f19753ce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f19700c36f0 con 0x7f19700bd6d0 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f19753ce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1970152530 con 0x7f19700bee80 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f1967fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19700bd6d0 0x7f19700be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f196effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1970151fc0 0x7f197006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38580/0 (socket says 172.21.15.5:38580) 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f1967fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19700bd6d0 0x7f19700be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47484/0 (socket says 172.21.15.5:47484) 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f196effd640 1 -- 172.21.15.5:0/2446188684 learned_addr learned my addr 172.21.15.5:0/2446188684 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f196f7fe640 1 --2- 172.21.15.5:0/2446188684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19700bee80 0x7f1970158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.707+0000 7f1967fff640 1 -- 172.21.15.5:0/2446188684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19700bee80 msgr2=0x7f1970158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:18.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.708+0000 7f1967fff640 1 --2- 172.21.15.5:0/2446188684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19700bee80 0x7f1970158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.708+0000 7f1967fff640 1 -- 172.21.15.5:0/2446188684 >> v1:172.21.15.5:6789/0 conn(0x7f1970151fc0 legacy=0x7f197006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.708+0000 7f1967fff640 1 -- 172.21.15.5:0/2446188684 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1970152810 con 0x7f19700bd6d0 2024-05-16T21:32:18.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.708+0000 7f196e7fc640 1 -- 172.21.15.5:0/2446188684 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098484809 0 0) 0x7f1960001110 con 0x7f1970151fc0 2024-05-16T21:32:18.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.708+0000 7f1967fff640 1 --2- 172.21.15.5:0/2446188684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bd6d0 0x7f19700be940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19580097a0 tx=0x7f195802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939a18a50529f1a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:18.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.708+0000 7f196e7fc640 1 -- 172.21.15.5:0/2446188684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958037070 con 0x7f19700bd6d0 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.708+0000 7f196e7fc640 1 -- 172.21.15.5:0/2446188684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1958032440 con 0x7f19700bd6d0 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.708+0000 7f196e7fc640 1 -- 172.21.15.5:0/2446188684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958032810 con 0x7f19700bd6d0 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.709+0000 7f19753ce640 1 -- 172.21.15.5:0/2446188684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bd6d0 msgr2=0x7f19700be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.709+0000 7f19753ce640 1 --2- 172.21.15.5:0/2446188684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bd6d0 0x7f19700be940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19580097a0 tx=0x7f195802a180 comp rx=0 tx=0).stop 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.709+0000 7f19753ce640 1 -- 172.21.15.5:0/2446188684 shutdown_connections 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.709+0000 7f19753ce640 1 --2- 172.21.15.5:0/2446188684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19700bee80 0x7f1970158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.709+0000 7f19753ce640 1 --2- 172.21.15.5:0/2446188684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bd6d0 0x7f19700be940 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.709+0000 7f19753ce640 1 -- 172.21.15.5:0/2446188684 >> 172.21.15.5:0/2446188684 conn(0x7f19700c3d20 msgr2=0x7f19700c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.709+0000 7f19753ce640 1 -- 172.21.15.5:0/2446188684 shutdown_connections 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.709+0000 7f19753ce640 1 -- 172.21.15.5:0/2446188684 wait complete. 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.711+0000 7f19753ce640 1 Processor -- start 2024-05-16T21:32:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.711+0000 7f19753ce640 1 -- start start 2024-05-16T21:32:18.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f19753ce640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19700bd6d0 0x7f19700b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f19753ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bee80 0x7f19700a2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f19753ce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1970151fc0 0x7f197014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f19753ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f19700bdae0 con 0x7f19700bee80 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f19753ce640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f19700c0070 con 0x7f19700bd6d0 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f19753ce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f19700a2ed0 con 0x7f1970151fc0 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bee80 0x7f19700a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bee80 0x7f19700a2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47496/0 (socket says 172.21.15.5:47496) 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 -- 172.21.15.5:0/3032259327 learned_addr learned my addr 172.21.15.5:0/3032259327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f196effd640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19700bd6d0 0x7f19700b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f196f7fe640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1970151fc0 0x7f197014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 -- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1970151fc0 msgr2=0x7f197014b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1970151fc0 0x7f197014b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 -- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19700bd6d0 msgr2=0x7f19700b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19700bd6d0 0x7f19700b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 -- 172.21.15.5:0/3032259327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19700a28a0 con 0x7f19700bee80 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f196f7fe640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1970151fc0 0x7f197014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f196effd640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19700bd6d0 0x7f19700b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.712+0000 7f1967fff640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bee80 0x7f19700a2360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19580097a0 tx=0x7f19580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.713+0000 7f19677fe640 1 -- 172.21.15.5:0/3032259327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958037050 con 0x7f19700bee80 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.713+0000 7f19677fe640 1 -- 172.21.15.5:0/3032259327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1958038040 con 0x7f19700bee80 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.713+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197014f250 con 0x7f19700bee80 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.713+0000 7f19677fe640 1 -- 172.21.15.5:0/3032259327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958004490 con 0x7f19700bee80 2024-05-16T21:32:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.713+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19700ba4d0 con 0x7f19700bee80 2024-05-16T21:32:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.714+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1970050940 con 0x7f19700bee80 2024-05-16T21:32:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.715+0000 7f19677fe640 1 -- 172.21.15.5:0/3032259327 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f195803c6d0 con 0x7f19700bee80 2024-05-16T21:32:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.715+0000 7f19677fe640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f19500762d0 0x7f19500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.715+0000 7f19677fe640 1 -- 172.21.15.5:0/3032259327 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f19580b7cb0 con 0x7f19700bee80 2024-05-16T21:32:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.715+0000 7f196effd640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f19500762d0 0x7f19500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.716+0000 7f196effd640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f19500762d0 0x7f19500787e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1960000f60 tx=0x7f1960007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.720+0000 7f19677fe640 1 -- 172.21.15.5:0/3032259327 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1958081960 con 0x7f19700bee80 2024-05-16T21:32:18.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.912+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f197006eb40 con 0x7f19700bee80 2024-05-16T21:32:18.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.912+0000 7f19677fe640 1 -- 172.21.15.5:0/3032259327 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f1958081260 con 0x7f19700bee80 2024-05-16T21:32:18.914 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:18.914 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-05-16T21:32:18.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:18.915 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-05-16T21:32:18.915 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-05-16T21:32:18.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:18.915 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-05-16T21:32:18.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f19500762d0 msgr2=0x7f19500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f19500762d0 0x7f19500787e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1960000f60 tx=0x7f1960007ca0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bee80 msgr2=0x7f19700a2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bee80 0x7f19700a2360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19580097a0 tx=0x7f19580046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 shutdown_connections 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f19500762d0 0x7f19500787e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1970151fc0 0x7f197014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19700bee80 0x7f19700a2360 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 --2- 172.21.15.5:0/3032259327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19700bd6d0 0x7f19700b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.914+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 >> 172.21.15.5:0/3032259327 conn(0x7f19700c3d20 msgr2=0x7f19700c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.915+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 shutdown_connections 2024-05-16T21:32:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:18.915+0000 7f19753ce640 1 -- 172.21.15.5:0/3032259327 wait complete. 2024-05-16T21:32:18.928 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-16T21:32:18.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-16T21:32:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.042+0000 7f18ca79d640 1 Processor -- start 2024-05-16T21:32:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.042+0000 7f18ca79d640 1 -- start start 2024-05-16T21:32:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.043+0000 7f18ca79d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f18c40be330 0x7f18c408d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.043+0000 7f18ca79d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18c40bd4d0 0x7f18c40c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.043+0000 7f18ca79d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c40bd8e0 con 0x7f18c414e900 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.043+0000 7f18ca79d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f18c414e470 con 0x7f18c40bd4d0 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.043+0000 7f18ca79d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f18c40beed0 con 0x7f18c40be330 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.043+0000 7f18c8f9a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18c40bd4d0 0x7f18c40c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.043+0000 7f18c8f9a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18c40bd4d0 0x7f18c40c07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47504/0 (socket says 172.21.15.5:47504) 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.043+0000 7f18c8f9a640 1 -- 172.21.15.5:0/684214978 learned_addr learned my addr 172.21.15.5:0/684214978 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.044+0000 7f18c979b640 1 --2- 172.21.15.5:0/684214978 >> v2:172.21.15.157:3300/0 conn(0x7f18c40be330 0x7f18c408d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.044+0000 7f18c8f9a640 1 -- 172.21.15.5:0/684214978 >> v2:172.21.15.157:3300/0 conn(0x7f18c40be330 msgr2=0x7f18c408d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.044+0000 7f18c8f9a640 1 --2- 172.21.15.5:0/684214978 >> v2:172.21.15.157:3300/0 conn(0x7f18c40be330 0x7f18c408d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.044+0000 7f18c8f9a640 1 -- 172.21.15.5:0/684214978 >> v1:172.21.15.157:6789/0 conn(0x7f18c414e900 legacy=0x7f18c414ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.044+0000 7f18c8f9a640 1 -- 172.21.15.5:0/684214978 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c40be910 con 0x7f18c40bd4d0 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.044+0000 7f18c8f9a640 1 --2- 172.21.15.5:0/684214978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40bd4d0 0x7f18c40c07a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18c408da80 tx=0x7f18b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee788d241f15ff27 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18c3fff640 1 -- 172.21.15.5:0/684214978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8037070 con 0x7f18c40bd4d0 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18c3fff640 1 -- 172.21.15.5:0/684214978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b8032440 con 0x7f18c40bd4d0 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18c3fff640 1 -- 172.21.15.5:0/684214978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8032810 con 0x7f18c40bd4d0 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18ca79d640 1 -- 172.21.15.5:0/684214978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40bd4d0 msgr2=0x7f18c40c07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18ca79d640 1 --2- 172.21.15.5:0/684214978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40bd4d0 0x7f18c40c07a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18c408da80 tx=0x7f18b802a270 comp rx=0 tx=0).stop 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18ca79d640 1 -- 172.21.15.5:0/684214978 shutdown_connections 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18ca79d640 1 --2- 172.21.15.5:0/684214978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40bd4d0 0x7f18c40c07a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18ca79d640 1 --2- 172.21.15.5:0/684214978 >> v2:172.21.15.157:3300/0 conn(0x7f18c40be330 0x7f18c408d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18ca79d640 1 -- 172.21.15.5:0/684214978 >> 172.21.15.5:0/684214978 conn(0x7f18c40c3c40 msgr2=0x7f18c40c0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18ca79d640 1 -- 172.21.15.5:0/684214978 shutdown_connections 2024-05-16T21:32:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.045+0000 7f18ca79d640 1 -- 172.21.15.5:0/684214978 wait complete. 2024-05-16T21:32:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.047+0000 7f18ca79d640 1 Processor -- start 2024-05-16T21:32:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.047+0000 7f18ca79d640 1 -- start start 2024-05-16T21:32:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18ca79d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18c40bd4d0 0x7f18c414b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18ca79d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40be330 0x7f18c40a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18ca79d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18c414e900 0x7f18c40a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18ca79d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40c0e60 con 0x7f18c40be330 2024-05-16T21:32:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18ca79d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40c0ce0 con 0x7f18c40bd4d0 2024-05-16T21:32:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18ca79d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f18c4158b70 con 0x7f18c414e900 2024-05-16T21:32:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18c8f9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40be330 0x7f18c40a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18c8f9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40be330 0x7f18c40a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47516/0 (socket says 172.21.15.5:47516) 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18c8f9a640 1 -- 172.21.15.5:0/743682937 learned_addr learned my addr 172.21.15.5:0/743682937 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18c979b640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18c40bd4d0 0x7f18c414b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.048+0000 7f18c9f9c640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18c414e900 0x7f18c40a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c8f9a640 1 -- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18c414e900 msgr2=0x7f18c40a8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c8f9a640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18c414e900 0x7f18c40a8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c8f9a640 1 -- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18c40bd4d0 msgr2=0x7f18c414b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c8f9a640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18c40bd4d0 0x7f18c414b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c8f9a640 1 -- 172.21.15.5:0/743682937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c414b6f0 con 0x7f18c40be330 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c9f9c640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18c414e900 0x7f18c40a8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c979b640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18c40bd4d0 0x7f18c414b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c8f9a640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40be330 0x7f18c40a87f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f18b802a2b0 tx=0x7f18b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c1ffb640 1 -- 172.21.15.5:0/743682937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8037040 con 0x7f18c40be330 2024-05-16T21:32:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c1ffb640 1 -- 172.21.15.5:0/743682937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b8042070 con 0x7f18c40be330 2024-05-16T21:32:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18c1ffb640 1 -- 172.21.15.5:0/743682937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8030bb0 con 0x7f18c40be330 2024-05-16T21:32:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c40b7120 con 0x7f18c40be330 2024-05-16T21:32:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.049+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c40b9e40 con 0x7f18c40be330 2024-05-16T21:32:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.050+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c406e1d0 con 0x7f18c40be330 2024-05-16T21:32:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.051+0000 7f18c1ffb640 1 -- 172.21.15.5:0/743682937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18b8047460 con 0x7f18c40be330 2024-05-16T21:32:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.051+0000 7f18c1ffb640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f18b00762d0 0x7f18b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.052+0000 7f18c1ffb640 1 -- 172.21.15.5:0/743682937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f18b80b8070 con 0x7f18c40be330 2024-05-16T21:32:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.052+0000 7f18c979b640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f18b00762d0 0x7f18b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.052+0000 7f18c979b640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f18b00762d0 0x7f18b00787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f18b4007fc0 tx=0x7f18b40075b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:19.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.056+0000 7f18c1ffb640 1 -- 172.21.15.5:0/743682937 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f18c406e1d0 con 0x7f18c40be330 2024-05-16T21:32:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.246+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f18c414c0f0 con 0x7f18c40be330 2024-05-16T21:32:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.936+0000 7f18c1ffb640 1 -- 172.21.15.5:0/743682937 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f18c414c0f0 con 0x7f18c40be330 2024-05-16T21:32:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-05-16T21:32:19.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.940+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f18b00762d0 msgr2=0x7f18b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:19.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.940+0000 7f18ca79d640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f18b00762d0 0x7f18b00787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f18b4007fc0 tx=0x7f18b40075b0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.940+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40be330 msgr2=0x7f18c40a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:19.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.940+0000 7f18ca79d640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40be330 0x7f18c40a87f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f18b802a2b0 tx=0x7f18b80046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.941+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 shutdown_connections 2024-05-16T21:32:19.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.941+0000 7f18ca79d640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f18b00762d0 0x7f18b00787e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.941+0000 7f18ca79d640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18c414e900 0x7f18c40a8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.941+0000 7f18ca79d640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40be330 0x7f18c40a87f0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f18b802a2b0 tx=0x7f18b80046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.941+0000 7f18ca79d640 1 --2- 172.21.15.5:0/743682937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18c40bd4d0 0x7f18c414b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:19.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.941+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 >> 172.21.15.5:0/743682937 conn(0x7f18c40c3c40 msgr2=0x7f18c406dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:19.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.941+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 shutdown_connections 2024-05-16T21:32:19.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:19.941+0000 7f18ca79d640 1 -- 172.21.15.5:0/743682937 wait complete. 2024-05-16T21:32:19.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-16T21:32:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.082+0000 7f1847da8640 1 Processor -- start 2024-05-16T21:32:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.082+0000 7f1847da8640 1 -- start start 2024-05-16T21:32:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.083+0000 7f1847da8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 0x7f18400bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.083+0000 7f1847da8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f184006da30 0x7f18400be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.083+0000 7f1847da8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f184006de40 0x7f18400bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1847da8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f18400bdc10 con 0x7f184006de40 2024-05-16T21:32:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1847da8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f18400c36f0 con 0x7f184006da30 2024-05-16T21:32:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1847da8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1840152530 con 0x7f1840151fc0 2024-05-16T21:32:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1846345640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f184006de40 0x7f18400bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1846345640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f184006de40 0x7f18400bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47524/0 (socket says 172.21.15.5:47524) 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1846345640 1 -- 172.21.15.5:0/4097559780 learned_addr learned my addr 172.21.15.5:0/4097559780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1845b44640 1 --2- 172.21.15.5:0/4097559780 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 0x7f18400bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1845343640 1 --2- 172.21.15.5:0/4097559780 >> v2:172.21.15.157:3300/0 conn(0x7f184006da30 0x7f18400be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1846345640 1 -- 172.21.15.5:0/4097559780 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 msgr2=0x7f18400bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1846345640 1 --2- 172.21.15.5:0/4097559780 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 0x7f18400bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1846345640 1 -- 172.21.15.5:0/4097559780 >> v2:172.21.15.157:3300/0 conn(0x7f184006da30 msgr2=0x7f18400be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1846345640 1 --2- 172.21.15.5:0/4097559780 >> v2:172.21.15.157:3300/0 conn(0x7f184006da30 0x7f18400be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1846345640 1 -- 172.21.15.5:0/4097559780 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1840152810 con 0x7f184006de40 2024-05-16T21:32:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.084+0000 7f1845343640 1 --2- 172.21.15.5:0/4097559780 >> v2:172.21.15.157:3300/0 conn(0x7f184006da30 0x7f18400be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.085+0000 7f1846345640 1 --2- 172.21.15.5:0/4097559780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006de40 0x7f18400bee80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f18400c1440 tx=0x7f183002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fa8681ed42c325 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.085+0000 7f1844b42640 1 -- 172.21.15.5:0/4097559780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830036070 con 0x7f184006de40 2024-05-16T21:32:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.085+0000 7f1844b42640 1 -- 172.21.15.5:0/4097559780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1830031600 con 0x7f184006de40 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.085+0000 7f1844b42640 1 -- 172.21.15.5:0/4097559780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18300319d0 con 0x7f184006de40 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 -- 172.21.15.5:0/4097559780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006de40 msgr2=0x7f18400bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 --2- 172.21.15.5:0/4097559780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006de40 0x7f18400bee80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f18400c1440 tx=0x7f183002a6a0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 -- 172.21.15.5:0/4097559780 shutdown_connections 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 --2- 172.21.15.5:0/4097559780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006de40 0x7f18400bee80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 --2- 172.21.15.5:0/4097559780 >> v2:172.21.15.157:3300/0 conn(0x7f184006da30 0x7f18400be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 --2- 172.21.15.5:0/4097559780 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 0x7f18400bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 -- 172.21.15.5:0/4097559780 >> 172.21.15.5:0/4097559780 conn(0x7f18400c3d20 msgr2=0x7f18400c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 -- 172.21.15.5:0/4097559780 shutdown_connections 2024-05-16T21:32:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.086+0000 7f1847da8640 1 -- 172.21.15.5:0/4097559780 wait complete. 2024-05-16T21:32:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.087+0000 7f1847da8640 1 Processor -- start 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.087+0000 7f1847da8640 1 -- start start 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.088+0000 7f1847da8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006da30 0x7f18400b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.088+0000 7f1847da8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f184006de40 0x7f184014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.088+0000 7f1847da8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 0x7f184014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.088+0000 7f1847da8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18400a3050 con 0x7f184006da30 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.088+0000 7f1847da8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f18400a2ed0 con 0x7f184006de40 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.088+0000 7f1847da8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f184014e570 con 0x7f1840151fc0 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006da30 0x7f18400b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006da30 0x7f18400b8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47534/0 (socket says 172.21.15.5:47534) 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 -- 172.21.15.5:0/1483104419 learned_addr learned my addr 172.21.15.5:0/1483104419 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845343640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f184006de40 0x7f184014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1846345640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 0x7f184014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 -- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 msgr2=0x7f184014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 0x7f184014a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 -- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f184006de40 msgr2=0x7f184014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f184006de40 0x7f184014d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 -- 172.21.15.5:0/1483104419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18400b9c10 con 0x7f184006da30 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1845b44640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006da30 0x7f18400b8cc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f183800e8a0 tx=0x7f183800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f183e7fc640 1 -- 172.21.15.5:0/1483104419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838017070 con 0x7f184006da30 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f183e7fc640 1 -- 172.21.15.5:0/1483104419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183800c940 con 0x7f184006da30 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18400b9ef0 con 0x7f184006da30 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f183e7fc640 1 -- 172.21.15.5:0/1483104419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183800cd30 con 0x7f184006da30 2024-05-16T21:32:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.089+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18400b7b20 con 0x7f184006da30 2024-05-16T21:32:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.090+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18400a6500 con 0x7f184006da30 2024-05-16T21:32:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.091+0000 7f183e7fc640 1 -- 172.21.15.5:0/1483104419 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f183801a070 con 0x7f184006da30 2024-05-16T21:32:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.092+0000 7f183e7fc640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f182c076300 0x7f182c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.092+0000 7f183e7fc640 1 -- 172.21.15.5:0/1483104419 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f1838097680 con 0x7f184006da30 2024-05-16T21:32:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.092+0000 7f1845343640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f182c076300 0x7f182c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.093+0000 7f1845343640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f182c076300 0x7f182c078810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1840151c90 tx=0x7f1834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:20.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.097+0000 7f183e7fc640 1 -- 172.21.15.5:0/1483104419 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1838060ae0 con 0x7f184006da30 2024-05-16T21:32:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.287+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1840050940 con 0x7f184006da30 2024-05-16T21:32:20.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.941+0000 7f183e7fc640 1 -- 172.21.15.5:0/1483104419 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f1838097020 con 0x7f184006da30 2024-05-16T21:32:20.943 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f182c076300 msgr2=0x7f182c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f182c076300 0x7f182c078810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1840151c90 tx=0x7f1834008040 comp rx=0 tx=0).stop 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006da30 msgr2=0x7f18400b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006da30 0x7f18400b8cc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f183800e8a0 tx=0x7f183800eca0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 shutdown_connections 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f182c076300 0x7f182c078810 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1840151fc0 0x7f184014a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f184006de40 0x7f184014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 --2- 172.21.15.5:0/1483104419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f184006da30 0x7f18400b8cc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 >> 172.21.15.5:0/1483104419 conn(0x7f18400c3d20 msgr2=0x7f18400c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.945+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 shutdown_connections 2024-05-16T21:32:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:20.946+0000 7f1847da8640 1 -- 172.21.15.5:0/1483104419 wait complete. 2024-05-16T21:32:20.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-16T21:32:21.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.096+0000 7f433528b640 1 Processor -- start 2024-05-16T21:32:21.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.096+0000 7f433528b640 1 -- start start 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f433528b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f43300bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f433528b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f43300bf050 0x7f4330158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f433528b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43300c36f0 con 0x7f433006da30 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f433528b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f43300bdc10 con 0x7f43300bf050 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f433528b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4330152530 con 0x7f4330151fc0 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f432effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f43300bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f432f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f43300bf050 0x7f4330158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f432f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f43300bf050 0x7f4330158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:57276/0 (socket says 172.21.15.5:57276) 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f4327fff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f433006da30 0x7f43300be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:44728/0 (socket says 172.21.15.5:44728) 2024-05-16T21:32:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f432effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f43300bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:60892/0 (socket says 172.21.15.5:60892) 2024-05-16T21:32:21.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.097+0000 7f432f7fe640 1 -- 172.21.15.5:0/2821578594 learned_addr learned my addr 172.21.15.5:0/2821578594 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:21.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.098+0000 7f432f7fe640 1 -- 172.21.15.5:0/2821578594 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 msgr2=0x7f43300bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:21.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.098+0000 7f432f7fe640 1 --2- 172.21.15.5:0/2821578594 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f43300bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.098+0000 7f432f7fe640 1 -- 172.21.15.5:0/2821578594 >> v1:172.21.15.157:6789/0 conn(0x7f433006da30 legacy=0x7f43300be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:21.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.098+0000 7f432f7fe640 1 -- 172.21.15.5:0/2821578594 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4330152810 con 0x7f43300bf050 2024-05-16T21:32:21.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.098+0000 7f432e7fc640 1 -- 172.21.15.5:0/2821578594 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3053350625 0 0) 0x7f43300c36f0 con 0x7f433006da30 2024-05-16T21:32:21.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f432f7fe640 1 --2- 172.21.15.5:0/2821578594 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43300bf050 0x7f4330158e90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4328009e50 tx=0x7f432802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f642aa974c94a508 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:21.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f432e7fc640 1 -- 172.21.15.5:0/2821578594 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328036070 con 0x7f43300bf050 2024-05-16T21:32:21.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f432e7fc640 1 -- 172.21.15.5:0/2821578594 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4328031600 con 0x7f43300bf050 2024-05-16T21:32:21.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f432e7fc640 1 -- 172.21.15.5:0/2821578594 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43280319d0 con 0x7f43300bf050 2024-05-16T21:32:21.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f433528b640 1 -- 172.21.15.5:0/2821578594 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43300bf050 msgr2=0x7f4330158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:21.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f433528b640 1 --2- 172.21.15.5:0/2821578594 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43300bf050 0x7f4330158e90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4328009e50 tx=0x7f432802a680 comp rx=0 tx=0).stop 2024-05-16T21:32:21.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f433528b640 1 -- 172.21.15.5:0/2821578594 shutdown_connections 2024-05-16T21:32:21.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f433528b640 1 --2- 172.21.15.5:0/2821578594 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43300bf050 0x7f4330158e90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f433528b640 1 --2- 172.21.15.5:0/2821578594 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f43300bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f433528b640 1 -- 172.21.15.5:0/2821578594 >> 172.21.15.5:0/2821578594 conn(0x7f43300c3d20 msgr2=0x7f43300c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:21.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f433528b640 1 -- 172.21.15.5:0/2821578594 shutdown_connections 2024-05-16T21:32:21.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.099+0000 7f433528b640 1 -- 172.21.15.5:0/2821578594 wait complete. 2024-05-16T21:32:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.101+0000 7f433528b640 1 Processor -- start 2024-05-16T21:32:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.101+0000 7f433528b640 1 -- start start 2024-05-16T21:32:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f433528b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f433006da30 0x7f43301d9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f433528b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43300bf050 0x7f43301e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f433528b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f4330148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f433528b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43300a3050 con 0x7f43300bf050 2024-05-16T21:32:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f433528b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f43300a2ed0 con 0x7f433006da30 2024-05-16T21:32:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f433528b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f433006de40 con 0x7f4330151fc0 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f4327fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43300bf050 0x7f43301e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f4327fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43300bf050 0x7f43301e7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47538/0 (socket says 172.21.15.5:47538) 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f4327fff640 1 -- 172.21.15.5:0/2901600205 learned_addr learned my addr 172.21.15.5:0/2901600205 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f432effd640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f433006da30 0x7f43301d9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.102+0000 7f432f7fe640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f4330148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f4327fff640 1 -- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 msgr2=0x7f4330148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f4327fff640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f4330148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f4327fff640 1 -- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f433006da30 msgr2=0x7f43301d9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f4327fff640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f433006da30 0x7f43301d9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f4327fff640 1 -- 172.21.15.5:0/2901600205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43301d9c80 con 0x7f43300bf050 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f432effd640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f433006da30 0x7f43301d9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f4327fff640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43300bf050 0x7f43301e7ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f431800c410 tx=0x7f431800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:21.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f43277fe640 1 -- 172.21.15.5:0/2901600205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43180074e0 con 0x7f43300bf050 2024-05-16T21:32:21.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f43277fe640 1 -- 172.21.15.5:0/2901600205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43180047e0 con 0x7f43300bf050 2024-05-16T21:32:21.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43301e84d0 con 0x7f43300bf050 2024-05-16T21:32:21.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f43277fe640 1 -- 172.21.15.5:0/2901600205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318004bd0 con 0x7f43300bf050 2024-05-16T21:32:21.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.103+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43301d8f40 con 0x7f43300bf050 2024-05-16T21:32:21.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.104+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43300b6880 con 0x7f43300bf050 2024-05-16T21:32:21.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.105+0000 7f43277fe640 1 -- 172.21.15.5:0/2901600205 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4318011070 con 0x7f43300bf050 2024-05-16T21:32:21.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.105+0000 7f43277fe640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43100762d0 0x7f43100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:21.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.105+0000 7f43277fe640 1 -- 172.21.15.5:0/2901600205 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f4318097010 con 0x7f43300bf050 2024-05-16T21:32:21.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.105+0000 7f432effd640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43100762d0 0x7f43100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:21.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.106+0000 7f432effd640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43100762d0 0x7f43100787e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e90 tx=0x7f4320009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:21.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.110+0000 7f43277fe640 1 -- 172.21.15.5:0/2901600205 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4318060410 con 0x7f43300bf050 2024-05-16T21:32:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.340+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f43300a6500 con 0x7f43300bf050 2024-05-16T21:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.943+0000 7f43277fe640 1 -- 172.21.15.5:0/2901600205 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f4318064710 con 0x7f43300bf050 2024-05-16T21:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-05-16T21:32:21.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.949+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43100762d0 msgr2=0x7f43100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:21.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.949+0000 7f433528b640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43100762d0 0x7f43100787e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e90 tx=0x7f4320009190 comp rx=0 tx=0).stop 2024-05-16T21:32:21.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.949+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43300bf050 msgr2=0x7f43301e7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:21.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.949+0000 7f433528b640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43300bf050 0x7f43301e7ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f431800c410 tx=0x7f431800c8d0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.950+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 shutdown_connections 2024-05-16T21:32:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.950+0000 7f433528b640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43100762d0 0x7f43100787e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.950+0000 7f433528b640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4330151fc0 0x7f4330148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.950+0000 7f433528b640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43300bf050 0x7f43301e7ae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.950+0000 7f433528b640 1 --2- 172.21.15.5:0/2901600205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f433006da30 0x7f43301d9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.950+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 >> 172.21.15.5:0/2901600205 conn(0x7f43300c3d20 msgr2=0x7f43300c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.953+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 shutdown_connections 2024-05-16T21:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:21.953+0000 7f433528b640 1 -- 172.21.15.5:0/2901600205 wait complete. 2024-05-16T21:32:21.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.100+0000 7f38e24f9640 1 Processor -- start 2024-05-16T21:32:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.100+0000 7f38e24f9640 1 -- start start 2024-05-16T21:32:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38e24f9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc14ca90 0x7f38dc14cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38e24f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc0be460 con 0x7f38dc154ca0 2024-05-16T21:32:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38e24f9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc0bbb30 con 0x7f38dc06c8c0 2024-05-16T21:32:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38e24f9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f38dc0bb900 con 0x7f38dc14ca90 2024-05-16T21:32:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38e0a96640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f38dc154ca0 0x7f38dc1570c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38594/0 (socket says 172.21.15.5:38594) 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38e0a96640 1 -- 172.21.15.5:0/6432253 learned_addr learned my addr 172.21.15.5:0/6432253 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38db7fe640 1 --2- 172.21.15.5:0/6432253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc14ca90 0x7f38dc14cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38daffd640 1 -- 172.21.15.5:0/6432253 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118420314 0 0) 0x7f38dc0be460 con 0x7f38dc154ca0 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38daffd640 1 -- 172.21.15.5:0/6432253 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38c4003520 con 0x7f38dc154ca0 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38daffd640 1 -- 172.21.15.5:0/6432253 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3436739229 0 0) 0x7f38dc0bbb30 con 0x7f38dc06c8c0 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38daffd640 1 -- 172.21.15.5:0/6432253 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38dc0be460 con 0x7f38dc06c8c0 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38db7fe640 1 -- 172.21.15.5:0/6432253 >> v1:172.21.15.157:6789/0 conn(0x7f38dc06c8c0 legacy=0x7f38dc14f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38db7fe640 1 -- 172.21.15.5:0/6432253 >> v1:172.21.15.5:6789/0 conn(0x7f38dc154ca0 legacy=0x7f38dc1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.101+0000 7f38db7fe640 1 -- 172.21.15.5:0/6432253 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc0bbe10 con 0x7f38dc14ca90 2024-05-16T21:32:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.102+0000 7f38db7fe640 1 --2- 172.21.15.5:0/6432253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc14ca90 0x7f38dc14cea0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f38d00097d0 tx=0x7f38d002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf09c9d7db343f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.102+0000 7f38daffd640 1 -- 172.21.15.5:0/6432253 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0037070 con 0x7f38dc14ca90 2024-05-16T21:32:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.102+0000 7f38daffd640 1 -- 172.21.15.5:0/6432253 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d0032440 con 0x7f38dc14ca90 2024-05-16T21:32:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.102+0000 7f38daffd640 1 -- 172.21.15.5:0/6432253 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d00327f0 con 0x7f38dc14ca90 2024-05-16T21:32:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.103+0000 7f38e24f9640 1 -- 172.21.15.5:0/6432253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc14ca90 msgr2=0x7f38dc14cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.103+0000 7f38e24f9640 1 --2- 172.21.15.5:0/6432253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc14ca90 0x7f38dc14cea0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f38d00097d0 tx=0x7f38d002a210 comp rx=0 tx=0).stop 2024-05-16T21:32:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.103+0000 7f38e24f9640 1 -- 172.21.15.5:0/6432253 shutdown_connections 2024-05-16T21:32:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.103+0000 7f38e24f9640 1 --2- 172.21.15.5:0/6432253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc14ca90 0x7f38dc14cea0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.103+0000 7f38e24f9640 1 -- 172.21.15.5:0/6432253 >> 172.21.15.5:0/6432253 conn(0x7f38dc0bd160 msgr2=0x7f38dc0bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.103+0000 7f38e24f9640 1 -- 172.21.15.5:0/6432253 shutdown_connections 2024-05-16T21:32:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.103+0000 7f38e24f9640 1 -- 172.21.15.5:0/6432253 wait complete. 2024-05-16T21:32:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.105+0000 7f38e24f9640 1 Processor -- start 2024-05-16T21:32:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.105+0000 7f38e24f9640 1 -- start start 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38e24f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc06c8c0 0x7f38dc14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38e24f9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38dc14ca90 0x7f38dc143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38e24f9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc154ca0 0x7f38dc141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38e24f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc0be740 con 0x7f38dc06c8c0 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38e24f9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc0bc180 con 0x7f38dc14ca90 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38e24f9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f38dc06ccd0 con 0x7f38dc154ca0 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc06c8c0 0x7f38dc14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc06c8c0 0x7f38dc14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47548/0 (socket says 172.21.15.5:47548) 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38dbfff640 1 -- 172.21.15.5:0/1669960137 learned_addr learned my addr 172.21.15.5:0/1669960137 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38e0a96640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc154ca0 0x7f38dc141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38db7fe640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38dc14ca90 0x7f38dc143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38dbfff640 1 -- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc154ca0 msgr2=0x7f38dc141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38dbfff640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc154ca0 0x7f38dc141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38dbfff640 1 -- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38dc14ca90 msgr2=0x7f38dc143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38dbfff640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38dc14ca90 0x7f38dc143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.106+0000 7f38dbfff640 1 -- 172.21.15.5:0/1669960137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc144190 con 0x7f38dc06c8c0 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.107+0000 7f38dbfff640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc06c8c0 0x7f38dc14e080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c430 tx=0x7f38cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.107+0000 7f38d8ff9640 1 -- 172.21.15.5:0/1669960137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc017070 con 0x7f38dc06c8c0 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.107+0000 7f38d8ff9640 1 -- 172.21.15.5:0/1669960137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc0052f0 con 0x7f38dc06c8c0 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.107+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38dc142a60 con 0x7f38dc06c8c0 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.107+0000 7f38d8ff9640 1 -- 172.21.15.5:0/1669960137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc003830 con 0x7f38dc06c8c0 2024-05-16T21:32:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.107+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38dc1e2810 con 0x7f38dc06c8c0 2024-05-16T21:32:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.108+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38dc0beb70 con 0x7f38dc06c8c0 2024-05-16T21:32:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.108+0000 7f38d8ff9640 1 -- 172.21.15.5:0/1669960137 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f38cc01a070 con 0x7f38dc06c8c0 2024-05-16T21:32:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.109+0000 7f38d8ff9640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38c80762d0 0x7f38c80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.109+0000 7f38d8ff9640 1 -- 172.21.15.5:0/1669960137 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38cc096990 con 0x7f38dc06c8c0 2024-05-16T21:32:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.109+0000 7f38db7fe640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38c80762d0 0x7f38c80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.110+0000 7f38db7fe640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38c80762d0 0x7f38c80787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38d0034000 tx=0x7f38d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.114+0000 7f38d8ff9640 1 -- 172.21.15.5:0/1669960137 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f38dc0beb70 con 0x7f38dc06c8c0 2024-05-16T21:32:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.304+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38dc069b50 con 0x7f38dc06c8c0 2024-05-16T21:32:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.305+0000 7f38d8ff9640 1 -- 172.21.15.5:0/1669960137 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16570 (secure 0 0 0) 0x7f38cc0602e0 con 0x7f38dc06c8c0 2024-05-16T21:32:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:22.307 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:21.341174+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38c80762d0 msgr2=0x7f38c80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38c80762d0 0x7f38c80787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38d0034000 tx=0x7f38d002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc06c8c0 msgr2=0x7f38dc14e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc06c8c0 0x7f38dc14e080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c430 tx=0x7f38cc00c8f0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 shutdown_connections 2024-05-16T21:32:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38c80762d0 0x7f38c80787e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38dc154ca0 0x7f38dc141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38dc14ca90 0x7f38dc143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 --2- 172.21.15.5:0/1669960137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc06c8c0 0x7f38dc14e080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 >> 172.21.15.5:0/1669960137 conn(0x7f38dc0bd160 msgr2=0x7f38dc06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 shutdown_connections 2024-05-16T21:32:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.307+0000 7f38e24f9640 1 -- 172.21.15.5:0/1669960137 wait complete. 2024-05-16T21:32:22.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.429+0000 7fc21f415640 1 Processor -- start 2024-05-16T21:32:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.429+0000 7fc21f415640 1 -- start start 2024-05-16T21:32:22.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21f415640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc21814e440 0x7fc2180b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21f415640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2180ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21f415640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc2180b8a20 0x7fc2180b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21f415640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc21814e9b0 con 0x7fc21814e440 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21f415640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc21814ec90 con 0x7fc2180b8a20 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21f415640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc21814ef70 con 0x7fc2180bd770 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21d1b1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc21814e440 0x7fc2180b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21d1b1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc21814e440 0x7fc2180b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47550/0 (socket says 172.21.15.5:47550) 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.430+0000 7fc21d1b1640 1 -- 172.21.15.5:0/3487470971 learned_addr learned my addr 172.21.15.5:0/3487470971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21d1b1640 1 -- 172.21.15.5:0/3487470971 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 msgr2=0x7fc2180ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21d9b2640 1 --2- 172.21.15.5:0/3487470971 >> v2:172.21.15.157:3300/0 conn(0x7fc2180b8a20 0x7fc2180b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21c9b0640 1 --2- 172.21.15.5:0/3487470971 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2180ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21d1b1640 1 --2- 172.21.15.5:0/3487470971 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2180ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21d1b1640 1 -- 172.21.15.5:0/3487470971 >> v2:172.21.15.157:3300/0 conn(0x7fc2180b8a20 msgr2=0x7fc2180b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21d1b1640 1 --2- 172.21.15.5:0/3487470971 >> v2:172.21.15.157:3300/0 conn(0x7fc2180b8a20 0x7fc2180b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21d1b1640 1 -- 172.21.15.5:0/3487470971 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21814f250 con 0x7fc21814e440 2024-05-16T21:32:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21d9b2640 1 --2- 172.21.15.5:0/3487470971 >> v2:172.21.15.157:3300/0 conn(0x7fc2180b8a20 0x7fc2180b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21c9b0640 1 --2- 172.21.15.5:0/3487470971 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2180ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc21d1b1640 1 --2- 172.21.15.5:0/3487470971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2180b99c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc218152a50 tx=0x7fc21402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b292a9d0ab557f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.431+0000 7fc20ffff640 1 -- 172.21.15.5:0/3487470971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214037070 con 0x7fc21814e440 2024-05-16T21:32:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc20ffff640 1 -- 172.21.15.5:0/3487470971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc214032440 con 0x7fc21814e440 2024-05-16T21:32:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc20ffff640 1 -- 172.21.15.5:0/3487470971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214032810 con 0x7fc21814e440 2024-05-16T21:32:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 -- 172.21.15.5:0/3487470971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 msgr2=0x7fc2180b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 --2- 172.21.15.5:0/3487470971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2180b99c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc218152a50 tx=0x7fc21402a1e0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 -- 172.21.15.5:0/3487470971 shutdown_connections 2024-05-16T21:32:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 --2- 172.21.15.5:0/3487470971 >> v2:172.21.15.157:3300/0 conn(0x7fc2180b8a20 0x7fc2180b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 --2- 172.21.15.5:0/3487470971 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2180ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 --2- 172.21.15.5:0/3487470971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2180b99c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 -- 172.21.15.5:0/3487470971 >> 172.21.15.5:0/3487470971 conn(0x7fc2180c0390 msgr2=0x7fc2180c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 -- 172.21.15.5:0/3487470971 shutdown_connections 2024-05-16T21:32:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.432+0000 7fc21f415640 1 -- 172.21.15.5:0/3487470971 wait complete. 2024-05-16T21:32:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.434+0000 7fc21f415640 1 Processor -- start 2024-05-16T21:32:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.434+0000 7fc21f415640 1 -- start start 2024-05-16T21:32:22.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21f415640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2180b8a20 0x7fc2181d5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21f415640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2181d7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21f415640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2181d6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21f415640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2180ba780 con 0x7fc21814e440 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21f415640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc21808d720 con 0x7fc2180b8a20 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21f415640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc2180ba900 con 0x7fc2180bd770 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d9b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2181d6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d9b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2181d6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47556/0 (socket says 172.21.15.5:47556) 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d9b2640 1 -- 172.21.15.5:0/283955670 learned_addr learned my addr 172.21.15.5:0/283955670 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d1b1640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2180b8a20 0x7fc2181d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21c9b0640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2181d7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d9b2640 1 -- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 msgr2=0x7fc2181d7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d9b2640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2181d7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d9b2640 1 -- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2180b8a20 msgr2=0x7fc2181d5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d9b2640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2180b8a20 0x7fc2181d5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d9b2640 1 -- 172.21.15.5:0/283955670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc218149de0 con 0x7fc21814e440 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.435+0000 7fc21d1b1640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2180b8a20 0x7fc2181d5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.436+0000 7fc21d9b2640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2181d6630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc21000cc60 tx=0x7fc21000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.436+0000 7fc20dffb640 1 -- 172.21.15.5:0/283955670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21000f680 con 0x7fc21814e440 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.436+0000 7fc20dffb640 1 -- 172.21.15.5:0/283955670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21000f820 con 0x7fc21814e440 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.436+0000 7fc20dffb640 1 -- 172.21.15.5:0/283955670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21000fc10 con 0x7fc21814e440 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.436+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2181d5b40 con 0x7fc21814e440 2024-05-16T21:32:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.436+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2181d4e00 con 0x7fc21814e440 2024-05-16T21:32:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.437+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2181d80c0 con 0x7fc21814e440 2024-05-16T21:32:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.438+0000 7fc20dffb640 1 -- 172.21.15.5:0/283955670 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc2100213f0 con 0x7fc21814e440 2024-05-16T21:32:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.438+0000 7fc20dffb640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1fc076300 0x7fc1fc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.438+0000 7fc20dffb640 1 -- 172.21.15.5:0/283955670 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc210098110 con 0x7fc21814e440 2024-05-16T21:32:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.438+0000 7fc21d1b1640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1fc076300 0x7fc1fc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.439+0000 7fc21d1b1640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1fc076300 0x7fc1fc078810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc214034000 tx=0x7fc21402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.443+0000 7fc20dffb640 1 -- 172.21.15.5:0/283955670 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc210014030 con 0x7fc21814e440 2024-05-16T21:32:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.634+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc218050940 con 0x7fc21814e440 2024-05-16T21:32:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.635+0000 7fc20dffb640 1 -- 172.21.15.5:0/283955670 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16570 (secure 0 0 0) 0x7fc210061b00 con 0x7fc21814e440 2024-05-16T21:32:22.637 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:22.637 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:21.341174+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.637+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1fc076300 msgr2=0x7fc1fc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.637+0000 7fc21f415640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1fc076300 0x7fc1fc078810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc214034000 tx=0x7fc21402e000 comp rx=0 tx=0).stop 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 msgr2=0x7fc2181d6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2181d6630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc21000cc60 tx=0x7fc21000a650 comp rx=0 tx=0).stop 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 shutdown_connections 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1fc076300 0x7fc1fc078810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21814e440 0x7fc2181d6630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2180bd770 0x7fc2181d7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 --2- 172.21.15.5:0/283955670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2180b8a20 0x7fc2181d5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 >> 172.21.15.5:0/283955670 conn(0x7fc2180c0390 msgr2=0x7fc2180bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 shutdown_connections 2024-05-16T21:32:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.638+0000 7fc21f415640 1 -- 172.21.15.5:0/283955670 wait complete. 2024-05-16T21:32:22.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-16T21:32:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.763+0000 7f557044c640 1 Processor -- start 2024-05-16T21:32:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.763+0000 7f557044c640 1 -- start start 2024-05-16T21:32:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.764+0000 7f557044c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55680bd6d0 0x7f55680be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.764+0000 7f557044c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556806e140 con 0x7f5568151fc0 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.764+0000 7f557044c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55680c36f0 con 0x7f55680bee80 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.764+0000 7f557044c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5568152530 con 0x7f55680bd6d0 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.764+0000 7f556e1e8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5568151fc0 0x7f556806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38604/0 (socket says 172.21.15.5:38604) 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.764+0000 7f556e1e8640 1 -- 172.21.15.5:0/199378474 learned_addr learned my addr 172.21.15.5:0/199378474 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.765+0000 7f556d9e7640 1 --2- 172.21.15.5:0/199378474 >> v2:172.21.15.157:3300/0 conn(0x7f55680bd6d0 0x7f55680be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.765+0000 7f556d1e6640 1 -- 172.21.15.5:0/199378474 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042967899 0 0) 0x7f5564001110 con 0x7f5568151fc0 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.765+0000 7f556d1e6640 1 -- 172.21.15.5:0/199378474 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5554003520 con 0x7f5568151fc0 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.765+0000 7f556d9e7640 1 -- 172.21.15.5:0/199378474 >> v1:172.21.15.157:6789/0 conn(0x7f55680bee80 legacy=0x7f5568158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.765+0000 7f556d1e6640 1 -- 172.21.15.5:0/199378474 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209893660 0 0) 0x7f5554003520 con 0x7f5568151fc0 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.765+0000 7f556d9e7640 1 -- 172.21.15.5:0/199378474 >> v1:172.21.15.5:6789/0 conn(0x7f5568151fc0 legacy=0x7f556806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.765+0000 7f556d9e7640 1 -- 172.21.15.5:0/199378474 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5568152810 con 0x7f55680bd6d0 2024-05-16T21:32:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.766+0000 7f556d9e7640 1 --2- 172.21.15.5:0/199378474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bd6d0 0x7f55680be940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f55580097a0 tx=0x7f555802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=844912c7a1bdd767 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.766+0000 7f556d1e6640 1 -- 172.21.15.5:0/199378474 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558037070 con 0x7f55680bd6d0 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.766+0000 7f556d1e6640 1 -- 172.21.15.5:0/199378474 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555802abc0 con 0x7f55680bd6d0 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.766+0000 7f556d1e6640 1 -- 172.21.15.5:0/199378474 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55640018e0 con 0x7f55680bd6d0 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.766+0000 7f557044c640 1 -- 172.21.15.5:0/199378474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bd6d0 msgr2=0x7f55680be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.766+0000 7f557044c640 1 --2- 172.21.15.5:0/199378474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bd6d0 0x7f55680be940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f55580097a0 tx=0x7f555802a130 comp rx=0 tx=0).stop 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.767+0000 7f557044c640 1 -- 172.21.15.5:0/199378474 shutdown_connections 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.767+0000 7f557044c640 1 --2- 172.21.15.5:0/199378474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bd6d0 0x7f55680be940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.767+0000 7f557044c640 1 -- 172.21.15.5:0/199378474 >> 172.21.15.5:0/199378474 conn(0x7f55680c3d20 msgr2=0x7f55680c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.767+0000 7f557044c640 1 -- 172.21.15.5:0/199378474 shutdown_connections 2024-05-16T21:32:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.767+0000 7f557044c640 1 -- 172.21.15.5:0/199378474 wait complete. 2024-05-16T21:32:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.768+0000 7f557044c640 1 Processor -- start 2024-05-16T21:32:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.768+0000 7f557044c640 1 -- start start 2024-05-16T21:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f557044c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55680bd6d0 0x7f556814ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f557044c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bee80 0x7f55680a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f557044c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568151fc0 0x7f55680a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f557044c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f55680bdae0 con 0x7f5568151fc0 2024-05-16T21:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f557044c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f55680c0070 con 0x7f55680bee80 2024-05-16T21:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f557044c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f55680a2ed0 con 0x7f55680bd6d0 2024-05-16T21:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f556e9e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568151fc0 0x7f55680a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f556e9e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568151fc0 0x7f55680a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47568/0 (socket says 172.21.15.5:47568) 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f556e9e9640 1 -- 172.21.15.5:0/3332662961 learned_addr learned my addr 172.21.15.5:0/3332662961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.769+0000 7f556d9e7640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bee80 0x7f55680a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f556e1e8640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55680bd6d0 0x7f556814ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f556e9e9640 1 -- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55680bd6d0 msgr2=0x7f556814ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f556e9e9640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55680bd6d0 0x7f556814ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f556e9e9640 1 -- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bee80 msgr2=0x7f55680a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f556e9e9640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bee80 0x7f55680a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f556e9e9640 1 -- 172.21.15.5:0/3332662961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556814f250 con 0x7f5568151fc0 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f556d9e7640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bee80 0x7f55680a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f556e9e9640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568151fc0 0x7f55680a25d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f556000c730 tx=0x7f556000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f555effd640 1 -- 172.21.15.5:0/3332662961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560003b70 con 0x7f5568151fc0 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f555effd640 1 -- 172.21.15.5:0/3332662961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5560003d10 con 0x7f5568151fc0 2024-05-16T21:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f555effd640 1 -- 172.21.15.5:0/3332662961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556000aa70 con 0x7f5568151fc0 2024-05-16T21:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556809d9d0 con 0x7f5568151fc0 2024-05-16T21:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.770+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55681e8280 con 0x7f5568151fc0 2024-05-16T21:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.771+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f556809d7c0 con 0x7f5568151fc0 2024-05-16T21:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.772+0000 7f555effd640 1 -- 172.21.15.5:0/3332662961 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f556000ac10 con 0x7f5568151fc0 2024-05-16T21:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.772+0000 7f555effd640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f554c076300 0x7f554c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.772+0000 7f555effd640 1 -- 172.21.15.5:0/3332662961 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5560097500 con 0x7f5568151fc0 2024-05-16T21:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.772+0000 7f556e1e8640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f554c076300 0x7f554c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.773+0000 7f556e1e8640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f554c076300 0x7f554c078810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5568152460 tx=0x7f5564001000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:22.777+0000 7f555effd640 1 -- 172.21.15.5:0/3332662961 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5560060dd0 con 0x7f5568151fc0 2024-05-16T21:32:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.009+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5568050940 con 0x7f5568151fc0 2024-05-16T21:32:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.968+0000 7f555effd640 1 -- 172.21.15.5:0/3332662961 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f55600606d0 con 0x7f5568151fc0 2024-05-16T21:32:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f554c076300 msgr2=0x7f554c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f554c076300 0x7f554c078810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5568152460 tx=0x7f5564001000 comp rx=0 tx=0).stop 2024-05-16T21:32:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568151fc0 msgr2=0x7f55680a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568151fc0 0x7f55680a25d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f556000c730 tx=0x7f556000cbf0 comp rx=0 tx=0).stop 2024-05-16T21:32:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 shutdown_connections 2024-05-16T21:32:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f554c076300 0x7f554c078810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568151fc0 0x7f55680a25d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55680bee80 0x7f55680a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 --2- 172.21.15.5:0/3332662961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55680bd6d0 0x7f556814ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 >> 172.21.15.5:0/3332662961 conn(0x7f55680c3d20 msgr2=0x7f55680c17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 shutdown_connections 2024-05-16T21:32:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:23.971+0000 7f557044c640 1 -- 172.21.15.5:0/3332662961 wait complete. 2024-05-16T21:32:23.986 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-16T21:32:23.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-16T21:32:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.110+0000 7f995d2f2640 1 Processor -- start 2024-05-16T21:32:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.110+0000 7f995d2f2640 1 -- start start 2024-05-16T21:32:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.111+0000 7f995d2f2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9958148910 0x7f995814e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.111+0000 7f995d2f2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99580ba800 con 0x7f995814eba0 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.111+0000 7f995d2f2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99580b8a30 con 0x7f99580a9060 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.111+0000 7f995d2f2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f99580b8d10 con 0x7f9958148910 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.111+0000 7f99567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9958148910 0x7f995814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.111+0000 7f99567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9958148910 0x7f995814e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47576/0 (socket says 172.21.15.5:47576) 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.111+0000 7f99567fc640 1 -- 172.21.15.5:0/2842827659 learned_addr learned my addr 172.21.15.5:0/2842827659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.112+0000 7f99567fc640 1 -- 172.21.15.5:0/2842827659 >> v1:172.21.15.157:6789/0 conn(0x7f99580a9060 legacy=0x7f99580ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.112+0000 7f99567fc640 1 -- 172.21.15.5:0/2842827659 >> v1:172.21.15.5:6789/0 conn(0x7f995814eba0 legacy=0x7f9958158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.112+0000 7f99567fc640 1 -- 172.21.15.5:0/2842827659 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99580b8ff0 con 0x7f9958148910 2024-05-16T21:32:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.112+0000 7f9955ffb640 1 -- 172.21.15.5:0/2842827659 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358292626 0 0) 0x7f9950001490 con 0x7f995814eba0 2024-05-16T21:32:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.112+0000 7f99567fc640 1 --2- 172.21.15.5:0/2842827659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f995814e660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f994c009870 tx=0x7f994c02a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb179a14a8af1cc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.112+0000 7f9955ffb640 1 -- 172.21.15.5:0/2842827659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c037070 con 0x7f9958148910 2024-05-16T21:32:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f9955ffb640 1 -- 172.21.15.5:0/2842827659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c032640 con 0x7f9958148910 2024-05-16T21:32:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f9955ffb640 1 -- 172.21.15.5:0/2842827659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c032a10 con 0x7f9958148910 2024-05-16T21:32:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f995d2f2640 1 -- 172.21.15.5:0/2842827659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 msgr2=0x7f995814e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f995d2f2640 1 --2- 172.21.15.5:0/2842827659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f995814e660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f994c009870 tx=0x7f994c02a3c0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f995d2f2640 1 -- 172.21.15.5:0/2842827659 shutdown_connections 2024-05-16T21:32:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f995d2f2640 1 --2- 172.21.15.5:0/2842827659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f995814e660 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f995d2f2640 1 -- 172.21.15.5:0/2842827659 >> 172.21.15.5:0/2842827659 conn(0x7f99580c07c0 msgr2=0x7f99580c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f995d2f2640 1 -- 172.21.15.5:0/2842827659 shutdown_connections 2024-05-16T21:32:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.113+0000 7f995d2f2640 1 -- 172.21.15.5:0/2842827659 wait complete. 2024-05-16T21:32:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.115+0000 7f995d2f2640 1 Processor -- start 2024-05-16T21:32:24.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.115+0000 7f995d2f2640 1 -- start start 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f995d2f2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99580a9060 0x7f99581e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f995d2f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f9958143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f995d2f2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f995814eba0 0x7f99581426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f995d2f2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f995808d400 con 0x7f9958148910 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f995d2f2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f995814efb0 con 0x7f99580a9060 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f995d2f2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f995808d580 con 0x7f995814eba0 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f99567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f9958143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f99567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f9958143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47588/0 (socket says 172.21.15.5:47588) 2024-05-16T21:32:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f99567fc640 1 -- 172.21.15.5:0/4154113405 learned_addr learned my addr 172.21.15.5:0/4154113405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f99567fc640 1 -- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f995814eba0 msgr2=0x7f99581426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f99567fc640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f995814eba0 0x7f99581426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f99567fc640 1 -- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99580a9060 msgr2=0x7f99581e86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f99567fc640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99580a9060 0x7f99581e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.116+0000 7f99567fc640 1 -- 172.21.15.5:0/4154113405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958147020 con 0x7f9958148910 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.117+0000 7f99567fc640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f9958143f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f994c009870 tx=0x7f994c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.117+0000 7f993f7fe640 1 -- 172.21.15.5:0/4154113405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c041020 con 0x7f9958148910 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.117+0000 7f993f7fe640 1 -- 172.21.15.5:0/4154113405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c030990 con 0x7f9958148910 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.117+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9958147b70 con 0x7f9958148910 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.117+0000 7f993f7fe640 1 -- 172.21.15.5:0/4154113405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c037040 con 0x7f9958148910 2024-05-16T21:32:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.117+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99581e81c0 con 0x7f9958148910 2024-05-16T21:32:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.118+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9958050940 con 0x7f9958148910 2024-05-16T21:32:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.119+0000 7f993f7fe640 1 -- 172.21.15.5:0/4154113405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f994c044020 con 0x7f9958148910 2024-05-16T21:32:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.119+0000 7f993f7fe640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99440762d0 0x7f99440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.119+0000 7f993f7fe640 1 -- 172.21.15.5:0/4154113405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f994c0b7d00 con 0x7f9958148910 2024-05-16T21:32:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.119+0000 7f9956ffd640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99440762d0 0x7f99440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.120+0000 7f9956ffd640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99440762d0 0x7f99440787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9948001550 tx=0x7f9948007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:24.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.124+0000 7f993f7fe640 1 -- 172.21.15.5:0/4154113405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f994c04b070 con 0x7f9958148910 2024-05-16T21:32:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.355+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f99581e7ca0 con 0x7f9958148910 2024-05-16T21:32:24.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.973+0000 7f993f7fe640 1 -- 172.21.15.5:0/4154113405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f994c0815d0 con 0x7f9958148910 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99440762d0 msgr2=0x7f99440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99440762d0 0x7f99440787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9948001550 tx=0x7f9948007970 comp rx=0 tx=0).stop 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 msgr2=0x7f9958143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f9958143f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f994c009870 tx=0x7f994c0046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 shutdown_connections 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99440762d0 0x7f99440787e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f995814eba0 0x7f99581426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9958148910 0x7f9958143f20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 --2- 172.21.15.5:0/4154113405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99580a9060 0x7f99581e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.976+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 >> 172.21.15.5:0/4154113405 conn(0x7f99580c07c0 msgr2=0x7f99580c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.977+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 shutdown_connections 2024-05-16T21:32:24.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:24.977+0000 7f995d2f2640 1 -- 172.21.15.5:0/4154113405 wait complete. 2024-05-16T21:32:24.992 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-16T21:32:24.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:25.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.109+0000 7f7cce6d9640 1 Processor -- start 2024-05-16T21:32:25.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.109+0000 7f7cce6d9640 1 -- start start 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.110+0000 7f7cce6d9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7cc80bd6d0 0x7f7cc80be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.110+0000 7f7cce6d9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cc80bee80 0x7f7cc8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.110+0000 7f7cce6d9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc806e140 con 0x7f7cc8151fc0 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.110+0000 7f7cce6d9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc80c36f0 con 0x7f7cc80bee80 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.110+0000 7f7cce6d9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc8152530 con 0x7f7cc80bd6d0 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.110+0000 7f7cccc76640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cc80bee80 0x7f7cc8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.110+0000 7f7cccc76640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cc80bee80 0x7f7cc8158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47590/0 (socket says 172.21.15.5:47590) 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.110+0000 7f7cccc76640 1 -- 172.21.15.5:0/1826309956 learned_addr learned my addr 172.21.15.5:0/1826309956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:25.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.111+0000 7f7cc77fe640 1 --2- 172.21.15.5:0/1826309956 >> v2:172.21.15.157:3300/0 conn(0x7f7cc80bd6d0 0x7f7cc80be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.111+0000 7f7cccc76640 1 -- 172.21.15.5:0/1826309956 >> v2:172.21.15.157:3300/0 conn(0x7f7cc80bd6d0 msgr2=0x7f7cc80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:25.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.111+0000 7f7cccc76640 1 --2- 172.21.15.5:0/1826309956 >> v2:172.21.15.157:3300/0 conn(0x7f7cc80bd6d0 0x7f7cc80be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.111+0000 7f7cccc76640 1 -- 172.21.15.5:0/1826309956 >> v1:172.21.15.157:6789/0 conn(0x7f7cc8151fc0 legacy=0x7f7cc806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:25.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.111+0000 7f7cccc76640 1 -- 172.21.15.5:0/1826309956 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8152810 con 0x7f7cc80bee80 2024-05-16T21:32:25.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.111+0000 7f7cc77fe640 1 --2- 172.21.15.5:0/1826309956 >> v2:172.21.15.157:3300/0 conn(0x7f7cc80bd6d0 0x7f7cc80be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:25.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.111+0000 7f7cccc76640 1 --2- 172.21.15.5:0/1826309956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc80bee80 0x7f7cc8158e90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80bf8f0 tx=0x7f7cc002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e7eff424d5e2b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cc6ffd640 1 -- 172.21.15.5:0/1826309956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0036070 con 0x7f7cc80bee80 2024-05-16T21:32:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cc6ffd640 1 -- 172.21.15.5:0/1826309956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc0031400 con 0x7f7cc80bee80 2024-05-16T21:32:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cc6ffd640 1 -- 172.21.15.5:0/1826309956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00317d0 con 0x7f7cc80bee80 2024-05-16T21:32:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cce6d9640 1 -- 172.21.15.5:0/1826309956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc80bee80 msgr2=0x7f7cc8158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/1826309956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc80bee80 0x7f7cc8158e90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80bf8f0 tx=0x7f7cc002a5d0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cce6d9640 1 -- 172.21.15.5:0/1826309956 shutdown_connections 2024-05-16T21:32:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/1826309956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc80bee80 0x7f7cc8158e90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/1826309956 >> v2:172.21.15.157:3300/0 conn(0x7f7cc80bd6d0 0x7f7cc80be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cce6d9640 1 -- 172.21.15.5:0/1826309956 >> 172.21.15.5:0/1826309956 conn(0x7f7cc80c3d20 msgr2=0x7f7cc80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cce6d9640 1 -- 172.21.15.5:0/1826309956 shutdown_connections 2024-05-16T21:32:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.112+0000 7f7cce6d9640 1 -- 172.21.15.5:0/1826309956 wait complete. 2024-05-16T21:32:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.114+0000 7f7cce6d9640 1 Processor -- start 2024-05-16T21:32:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.114+0000 7f7cce6d9640 1 -- start start 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cce6d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cc80bd6d0 0x7f7cc80b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cce6d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cc80bee80 0x7f7cc81e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cce6d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc8151fc0 0x7f7cc814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cce6d9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc80bdae0 con 0x7f7cc8151fc0 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cce6d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc80c0070 con 0x7f7cc80bd6d0 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cce6d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc80a2ed0 con 0x7f7cc80bee80 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cccc76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc8151fc0 0x7f7cc814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cccc76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc8151fc0 0x7f7cc814b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47602/0 (socket says 172.21.15.5:47602) 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.115+0000 7f7cccc76640 1 -- 172.21.15.5:0/2523988511 learned_addr learned my addr 172.21.15.5:0/2523988511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cc7fff640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cc80bd6d0 0x7f7cc80b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cc77fe640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cc80bee80 0x7f7cc81e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cccc76640 1 -- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cc80bee80 msgr2=0x7f7cc81e4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cccc76640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cc80bee80 0x7f7cc81e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cccc76640 1 -- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cc80bd6d0 msgr2=0x7f7cc80b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cccc76640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cc80bd6d0 0x7f7cc80b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cccc76640 1 -- 172.21.15.5:0/2523988511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc80b9f90 con 0x7f7cc8151fc0 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cc7fff640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cc80bd6d0 0x7f7cc80b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cccc76640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc8151fc0 0x7f7cc814b610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009f10 tx=0x7f7cc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cc4ff9640 1 -- 172.21.15.5:0/2523988511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0041020 con 0x7f7cc8151fc0 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cc4ff9640 1 -- 172.21.15.5:0/2523988511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc003c470 con 0x7f7cc8151fc0 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cc4ff9640 1 -- 172.21.15.5:0/2523988511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0036040 con 0x7f7cc8151fc0 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc80b7b50 con 0x7f7cc8151fc0 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.116+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc81e50a0 con 0x7f7cc8151fc0 2024-05-16T21:32:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.117+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc81e47a0 con 0x7f7cc8151fc0 2024-05-16T21:32:25.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.118+0000 7f7cc4ff9640 1 -- 172.21.15.5:0/2523988511 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7cc0044020 con 0x7f7cc8151fc0 2024-05-16T21:32:25.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.118+0000 7f7cc4ff9640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7cb40762d0 0x7f7cb40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.118+0000 7f7cc4ff9640 1 -- 172.21.15.5:0/2523988511 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7cc00b82e0 con 0x7f7cc8151fc0 2024-05-16T21:32:25.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.118+0000 7f7cc7fff640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7cb40762d0 0x7f7cb40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.119+0000 7f7cc7fff640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7cb40762d0 0x7f7cb40787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800a830 tx=0x7f7cb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.123+0000 7f7cc4ff9640 1 -- 172.21.15.5:0/2523988511 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7cc004b030 con 0x7f7cc8151fc0 2024-05-16T21:32:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.351+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cc806eb40 con 0x7f7cc8151fc0 2024-05-16T21:32:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.352+0000 7f7cc4ff9640 1 -- 172.21.15.5:0/2523988511 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4342 (secure 0 0 0) 0x7f7cc806e140 con 0x7f7cc8151fc0 2024-05-16T21:32:25.354 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:25.354 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:21.341129+0000","modified":"2024-05-16T21:32:24.356428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-16T21:32:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-05-16T21:32:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7cb40762d0 msgr2=0x7f7cb40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7cb40762d0 0x7f7cb40787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800a830 tx=0x7f7cb8008040 comp rx=0 tx=0).stop 2024-05-16T21:32:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc8151fc0 msgr2=0x7f7cc814b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc8151fc0 0x7f7cc814b610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009f10 tx=0x7f7cc0004a40 comp rx=0 tx=0).stop 2024-05-16T21:32:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 shutdown_connections 2024-05-16T21:32:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7cb40762d0 0x7f7cb40787e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc8151fc0 0x7f7cc814b610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cc80bee80 0x7f7cc81e4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 --2- 172.21.15.5:0/2523988511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cc80bd6d0 0x7f7cc80b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 >> 172.21.15.5:0/2523988511 conn(0x7f7cc80c3d20 msgr2=0x7f7cc80c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 shutdown_connections 2024-05-16T21:32:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.354+0000 7f7cce6d9640 1 -- 172.21.15.5:0/2523988511 wait complete. 2024-05-16T21:32:25.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.477+0000 7fe3fb3b7640 1 Processor -- start 2024-05-16T21:32:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.477+0000 7fe3fb3b7640 1 -- start start 2024-05-16T21:32:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3fb3b7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3f40bf050 0x7fe3f4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3fb3b7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f406e140 con 0x7fe3f4151fc0 2024-05-16T21:32:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3fb3b7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f40c36f0 con 0x7fe3f40bd6d0 2024-05-16T21:32:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3fb3b7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f4152530 con 0x7fe3f40bf050 2024-05-16T21:32:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3f9153640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe3f4151fc0 0x7fe3f406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38608/0 (socket says 172.21.15.5:38608) 2024-05-16T21:32:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3f9153640 1 -- 172.21.15.5:0/620296466 learned_addr learned my addr 172.21.15.5:0/620296466 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858853819 0 0) 0x7fe3f0001110 con 0x7fe3f4151fc0 2024-05-16T21:32:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3f9954640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3f40bf050 0x7fe3f4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.478+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3e0003520 con 0x7fe3f4151fc0 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1341937755 0 0) 0x7fe3e0003520 con 0x7fe3f4151fc0 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3f40bf050 msgr2=0x7fe3f4159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3f40bf050 0x7fe3f4159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 >> v1:172.21.15.157:6789/0 conn(0x7fe3f40bd6d0 legacy=0x7fe3f40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f4152810 con 0x7fe3f4151fc0 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fe3f00018c0 con 0x7fe3f4151fc0 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 >> v1:172.21.15.5:6789/0 conn(0x7fe3f4151fc0 legacy=0x7fe3f406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e00039e0 0x7fe3e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3f40bf050 0x7fe3e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3e0004d40 0x7fe3e0005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4152530 con 0x7fe3e00039e0 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e000bba0 con 0x7fe3e0004d40 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e000bda0 con 0x7fe3f40bf050 2024-05-16T21:32:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3f9153640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e00039e0 0x7fe3e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3f9954640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3e0004d40 0x7fe3e0005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3f8952640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3f40bf050 0x7fe3e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3f9153640 1 -- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3f40bf050 msgr2=0x7fe3e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3f9153640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3f40bf050 0x7fe3e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3f9153640 1 -- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3e0004d40 msgr2=0x7fe3e0005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3f9153640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3e0004d40 0x7fe3e0005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.479+0000 7fe3f9153640 1 -- 172.21.15.5:0/620296466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e0003520 con 0x7fe3e00039e0 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.480+0000 7fe3f9153640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e00039e0 0x7fe3e0003e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c4c0 tx=0x7fe3e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24e26c4e87075f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.480+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000c0e0 con 0x7fe3e00039e0 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.480+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f0034070 con 0x7fe3e00039e0 2024-05-16T21:32:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.480+0000 7fe3ebfff640 1 -- 172.21.15.5:0/620296466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0005d10 con 0x7fe3e00039e0 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.481+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/620296466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e00039e0 msgr2=0x7fe3e0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.481+0000 7fe3fb3b7640 1 --2- 172.21.15.5:0/620296466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e00039e0 0x7fe3e0003e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c4c0 tx=0x7fe3e0005830 comp rx=0 tx=0).stop 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.481+0000 7fe3f9954640 1 -- 172.21.15.5:0/620296466 reap_dead start 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.481+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/620296466 shutdown_connections 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.481+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/620296466 >> 172.21.15.5:0/620296466 conn(0x7fe3f40c3d20 msgr2=0x7fe3f40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.481+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/620296466 shutdown_connections 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.481+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/620296466 wait complete. 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.482+0000 7fe3fb3b7640 1 Processor -- start 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.482+0000 7fe3fb3b7640 1 -- start start 2024-05-16T21:32:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.483+0000 7fe3fb3b7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3e00039e0 0x7fe3f41e7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.483+0000 7fe3fb3b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f41e61a0 0x7fe3f41e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.483+0000 7fe3fb3b7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f41e74b0 0x7fe3f40b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.483+0000 7fe3fb3b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f40a2ed0 con 0x7fe3f41e61a0 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.483+0000 7fe3fb3b7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f40bdae0 con 0x7fe3f41e74b0 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3fb3b7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f40a3050 con 0x7fe3e00039e0 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f41e61a0 0x7fe3f41e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f41e61a0 0x7fe3f41e6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47608/0 (socket says 172.21.15.5:47608) 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 -- 172.21.15.5:0/796175553 learned_addr learned my addr 172.21.15.5:0/796175553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f9153640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3e00039e0 0x7fe3f41e7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f9954640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f41e74b0 0x7fe3f40b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 -- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3e00039e0 msgr2=0x7fe3f41e7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3e00039e0 0x7fe3f41e7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 -- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f41e74b0 msgr2=0x7fe3f40b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f41e74b0 0x7fe3f40b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 -- 172.21.15.5:0/796175553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f41e8250 con 0x7fe3f41e61a0 2024-05-16T21:32:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3f8952640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f41e61a0 0x7fe3f41e6f70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400f850 tx=0x7fe3e400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3e9ffb640 1 -- 172.21.15.5:0/796175553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e400fe40 con 0x7fe3f41e61a0 2024-05-16T21:32:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3e9ffb640 1 -- 172.21.15.5:0/796175553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e4018070 con 0x7fe3f41e61a0 2024-05-16T21:32:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f41e78c0 con 0x7fe3f41e61a0 2024-05-16T21:32:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3e9ffb640 1 -- 172.21.15.5:0/796175553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e400d730 con 0x7fe3f41e61a0 2024-05-16T21:32:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.484+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f40b87e0 con 0x7fe3f41e61a0 2024-05-16T21:32:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.486+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f4050940 con 0x7fe3f41e61a0 2024-05-16T21:32:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.486+0000 7fe3e9ffb640 1 -- 172.21.15.5:0/796175553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe3e400d8d0 con 0x7fe3f41e61a0 2024-05-16T21:32:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.487+0000 7fe3e9ffb640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3d80762d0 0x7fe3d80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.487+0000 7fe3e9ffb640 1 -- 172.21.15.5:0/796175553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe3e40974c0 con 0x7fe3f41e61a0 2024-05-16T21:32:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.487+0000 7fe3f9153640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3d80762d0 0x7fe3d80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.488+0000 7fe3f9153640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3d80762d0 0x7fe3d80787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c490 tx=0x7fe3f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.492+0000 7fe3e9ffb640 1 -- 172.21.15.5:0/796175553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe3e4060e10 con 0x7fe3f41e61a0 2024-05-16T21:32:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.682+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3f406eb40 con 0x7fe3f41e61a0 2024-05-16T21:32:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.683+0000 7fe3e9ffb640 1 -- 172.21.15.5:0/796175553 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7fe3e4060710 con 0x7fe3f41e61a0 2024-05-16T21:32:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:25.686 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:22.944103+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3d80762d0 msgr2=0x7fe3d80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3d80762d0 0x7fe3d80787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c490 tx=0x7fe3f002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f41e61a0 msgr2=0x7fe3f41e6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f41e61a0 0x7fe3f41e6f70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400f850 tx=0x7fe3e400fd10 comp rx=0 tx=0).stop 2024-05-16T21:32:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 shutdown_connections 2024-05-16T21:32:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3d80762d0 0x7fe3d80787e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f41e74b0 0x7fe3f40b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f41e61a0 0x7fe3f41e6f70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.685+0000 7fe3fb3b7640 1 --2- 172.21.15.5:0/796175553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3e00039e0 0x7fe3f41e7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.686+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 >> 172.21.15.5:0/796175553 conn(0x7fe3f40c3d20 msgr2=0x7fe3f40a4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.686+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 shutdown_connections 2024-05-16T21:32:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.686+0000 7fe3fb3b7640 1 -- 172.21.15.5:0/796175553 wait complete. 2024-05-16T21:32:25.699 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T21:32:25.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T21:32:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.808+0000 7fe187b72640 1 Processor -- start 2024-05-16T21:32:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.808+0000 7fe187b72640 1 -- start start 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.809+0000 7fe187b72640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe180151fc0 0x7fe1800bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.809+0000 7fe187b72640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1800bf050 0x7fe180158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.809+0000 7fe187b72640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1800c36f0 con 0x7fe18006da30 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.809+0000 7fe187b72640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe1800bdc10 con 0x7fe180151fc0 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.809+0000 7fe187b72640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe180152530 con 0x7fe1800bf050 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.810+0000 7fe18590e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe180151fc0 0x7fe1800bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.810+0000 7fe18590e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe180151fc0 0x7fe1800bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47620/0 (socket says 172.21.15.5:47620) 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.810+0000 7fe18590e640 1 -- 172.21.15.5:0/2425215198 learned_addr learned my addr 172.21.15.5:0/2425215198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.810+0000 7fe18610f640 1 --2- 172.21.15.5:0/2425215198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1800bf050 0x7fe180158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.810+0000 7fe18590e640 1 -- 172.21.15.5:0/2425215198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1800bf050 msgr2=0x7fe180158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.810+0000 7fe18590e640 1 --2- 172.21.15.5:0/2425215198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1800bf050 0x7fe180158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.810+0000 7fe18590e640 1 -- 172.21.15.5:0/2425215198 >> v1:172.21.15.157:6789/0 conn(0x7fe18006da30 legacy=0x7fe1800be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.810+0000 7fe18590e640 1 -- 172.21.15.5:0/2425215198 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe180152810 con 0x7fe180151fc0 2024-05-16T21:32:25.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.811+0000 7fe18590e640 1 --2- 172.21.15.5:0/2425215198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe1800bd6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe178009870 tx=0x7fe17802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e3a604bfc49a8d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.811+0000 7fe18490c640 1 -- 172.21.15.5:0/2425215198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178037070 con 0x7fe180151fc0 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.811+0000 7fe18490c640 1 -- 172.21.15.5:0/2425215198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178032440 con 0x7fe180151fc0 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.811+0000 7fe18490c640 1 -- 172.21.15.5:0/2425215198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178032810 con 0x7fe180151fc0 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.811+0000 7fe187b72640 1 -- 172.21.15.5:0/2425215198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 msgr2=0x7fe1800bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.811+0000 7fe187b72640 1 --2- 172.21.15.5:0/2425215198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe1800bd6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe178009870 tx=0x7fe17802a1c0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.812+0000 7fe187b72640 1 -- 172.21.15.5:0/2425215198 shutdown_connections 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.812+0000 7fe187b72640 1 --2- 172.21.15.5:0/2425215198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1800bf050 0x7fe180158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.812+0000 7fe187b72640 1 --2- 172.21.15.5:0/2425215198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe1800bd6d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.812+0000 7fe187b72640 1 -- 172.21.15.5:0/2425215198 >> 172.21.15.5:0/2425215198 conn(0x7fe1800c3d20 msgr2=0x7fe1800c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.812+0000 7fe187b72640 1 -- 172.21.15.5:0/2425215198 shutdown_connections 2024-05-16T21:32:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.812+0000 7fe187b72640 1 -- 172.21.15.5:0/2425215198 wait complete. 2024-05-16T21:32:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.813+0000 7fe187b72640 1 Processor -- start 2024-05-16T21:32:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.813+0000 7fe187b72640 1 -- start start 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe187b72640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe18006da30 0x7fe1800a2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe187b72640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1800bf050 0x7fe1800b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe187b72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe18014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe187b72640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe1800a3050 con 0x7fe180151fc0 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe187b72640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe1800a2ed0 con 0x7fe1800bf050 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe187b72640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe18006de40 con 0x7fe18006da30 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe18610f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe18014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe18610f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe18014b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47632/0 (socket says 172.21.15.5:47632) 2024-05-16T21:32:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe18610f640 1 -- 172.21.15.5:0/69232148 learned_addr learned my addr 172.21.15.5:0/69232148 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe18590e640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe18006da30 0x7fe1800a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.814+0000 7fe18510d640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1800bf050 0x7fe1800b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe18610f640 1 -- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe18006da30 msgr2=0x7fe1800a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe18610f640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe18006da30 0x7fe1800a2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe18610f640 1 -- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1800bf050 msgr2=0x7fe1800b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe18610f640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1800bf050 0x7fe1800b8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe18610f640 1 -- 172.21.15.5:0/69232148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1800b8b80 con 0x7fe180151fc0 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe18510d640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1800bf050 0x7fe1800b8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe18610f640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe18014b480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe17c007e60 tx=0x7fe17c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe1767fc640 1 -- 172.21.15.5:0/69232148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c014420 con 0x7fe180151fc0 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe1767fc640 1 -- 172.21.15.5:0/69232148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17c019070 con 0x7fe180151fc0 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18014f1c0 con 0x7fe180151fc0 2024-05-16T21:32:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe1767fc640 1 -- 172.21.15.5:0/69232148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c014820 con 0x7fe180151fc0 2024-05-16T21:32:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.815+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1800ba410 con 0x7fe180151fc0 2024-05-16T21:32:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.816+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe180050940 con 0x7fe180151fc0 2024-05-16T21:32:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.817+0000 7fe1767fc640 1 -- 172.21.15.5:0/69232148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe17c0149c0 con 0x7fe180151fc0 2024-05-16T21:32:25.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.817+0000 7fe1767fc640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1640762d0 0x7fe1640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:25.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.817+0000 7fe1767fc640 1 -- 172.21.15.5:0/69232148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe17c097d90 con 0x7fe180151fc0 2024-05-16T21:32:25.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.818+0000 7fe18590e640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1640762d0 0x7fe1640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:25.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.818+0000 7fe18590e640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1640762d0 0x7fe1640787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe178034000 tx=0x7fe17802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:25.822+0000 7fe1767fc640 1 -- 172.21.15.5:0/69232148 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe17c0616f0 con 0x7fe180151fc0 2024-05-16T21:32:25.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:32:25.868 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:32:25.872 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:32:26.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.010+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1800b79f0 con 0x7fe1640762d0 2024-05-16T21:32:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.017+0000 7fe1767fc640 1 -- 172.21.15.5:0/69232148 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237066 (secure 0 0 0) 0x7fe1800b79f0 con 0x7fe1640762d0 2024-05-16T21:32:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T21:32:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.019+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1640762d0 msgr2=0x7fe1640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.019+0000 7fe187b72640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1640762d0 0x7fe1640787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe178034000 tx=0x7fe17802e000 comp rx=0 tx=0).stop 2024-05-16T21:32:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.019+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 msgr2=0x7fe18014b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.019+0000 7fe187b72640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe18014b480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe17c007e60 tx=0x7fe17c00e4b0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.019+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 shutdown_connections 2024-05-16T21:32:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.020+0000 7fe187b72640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1640762d0 0x7fe1640787e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.020+0000 7fe187b72640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180151fc0 0x7fe18014b480 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.020+0000 7fe187b72640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1800bf050 0x7fe1800b8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.020+0000 7fe187b72640 1 --2- 172.21.15.5:0/69232148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe18006da30 0x7fe1800a2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.020+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 >> 172.21.15.5:0/69232148 conn(0x7fe1800c3d20 msgr2=0x7fe1800be840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.020+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 shutdown_connections 2024-05-16T21:32:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.020+0000 7fe187b72640 1 -- 172.21.15.5:0/69232148 wait complete. 2024-05-16T21:32:26.032 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-16T21:32:24.363319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":248292,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726428,"statfs":{"total":773094113280,"available":772839862272,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425867"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":102,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-16T21:32:13.141459+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T21:32:13.141459+0000","last_peered":"2024-05-16T21:32:13.141459+0000","last_clean":"2024-05-16T21:32:13.141459+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T21:32:13.141459+0000","last_undegraded":"2024-05-16T21:32:13.141459+0000","last_fullsized":"2024-05-16T21:32:13.141459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:20.937065+0000","last_change":"2024-05-16T21:32:20.937065+0000","last_active":"2024-05-16T21:32:20.937065+0000","last_peered":"2024-05-16T21:32:20.937065+0000","last_clean":"2024-05-16T21:32:20.937065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:20.937065+0000","last_undegraded":"2024-05-16T21:32:20.937065+0000","last_fullsized":"2024-05-16T21:32:20.937065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T21:32:19.931239+0000","last_change":"2024-05-16T21:32:19.931239+0000","last_active":"2024-05-16T21:32:19.931239+0000","last_peered":"2024-05-16T21:32:19.931239+0000","last_clean":"2024-05-16T21:32:19.931239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T21:32:19.931239+0000","last_undegraded":"2024-05-16T21:32:19.931239+0000","last_fullsized":"2024-05-16T21:32:19.931239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31356,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31348,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31356,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T21:32:26.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T21:32:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.182+0000 7f111efc7640 1 Processor -- start 2024-05-16T21:32:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.182+0000 7f111efc7640 1 -- start start 2024-05-16T21:32:26.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.183+0000 7f111efc7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180bf050 0x7f1118159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.183+0000 7f111efc7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111806e140 con 0x7f11180bd6d0 2024-05-16T21:32:26.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.183+0000 7f111efc7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11180c36f0 con 0x7f1118151fc0 2024-05-16T21:32:26.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.183+0000 7f111efc7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1118152530 con 0x7f11180bf050 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f1117fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f11180bd6d0 0x7f11180be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38622/0 (socket says 172.21.15.5:38622) 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f1117fff640 1 -- 172.21.15.5:0/1864513221 learned_addr learned my addr 172.21.15.5:0/1864513221 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f111d564640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180bf050 0x7f1118159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861753865 0 0) 0x7f1108001490 con 0x7f11180bd6d0 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1104003520 con 0x7f11180bd6d0 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596918849 0 0) 0x7f11180c36f0 con 0x7f1118151fc0 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1108001490 con 0x7f1118151fc0 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1689513576 0 0) 0x7f1104003520 con 0x7f11180bd6d0 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180bf050 msgr2=0x7f1118159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180bf050 0x7f1118159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 >> v1:172.21.15.157:6789/0 conn(0x7f1118151fc0 legacy=0x7f111806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1118152810 con 0x7f11180bd6d0 2024-05-16T21:32:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f1108001bc0 con 0x7f11180bd6d0 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 >> v1:172.21.15.5:6789/0 conn(0x7f11180bd6d0 legacy=0x7f11180be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180bf050 0x7f1104003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004210 0x7f1104004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1104004db0 0x7f1104005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1118152530 con 0x7f1104004db0 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f110400bd10 con 0x7f1104004210 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f110400bf10 con 0x7f11180bf050 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f111d564640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1104004db0 0x7f1104005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f111cd63640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180bf050 0x7f1104003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.184+0000 7f1117fff640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004210 0x7f1104004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.185+0000 7f111d564640 1 -- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180bf050 msgr2=0x7f1104003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.185+0000 7f111d564640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180bf050 0x7f1104003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.185+0000 7f111d564640 1 -- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004210 msgr2=0x7f1104004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.185+0000 7f111d564640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004210 0x7f1104004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.185+0000 7f111d564640 1 -- 172.21.15.5:0/1864513221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1104003520 con 0x7f1104004db0 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.185+0000 7f111d564640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1104004db0 0x7f1104005280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1100009ac0 tx=0x7f1104005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4254947af46ee58b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100036070 con 0x7f1104004db0 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1100031400 con 0x7f1104004db0 2024-05-16T21:32:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f11177fe640 1 -- 172.21.15.5:0/1864513221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100009690 con 0x7f1104004db0 2024-05-16T21:32:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f111efc7640 1 -- 172.21.15.5:0/1864513221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1104004db0 msgr2=0x7f1104005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f111efc7640 1 --2- 172.21.15.5:0/1864513221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1104004db0 0x7f1104005280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1100009ac0 tx=0x7f1104005830 comp rx=0 tx=0).stop 2024-05-16T21:32:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f111d564640 1 -- 172.21.15.5:0/1864513221 reap_dead start 2024-05-16T21:32:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f111efc7640 1 -- 172.21.15.5:0/1864513221 shutdown_connections 2024-05-16T21:32:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f111efc7640 1 -- 172.21.15.5:0/1864513221 >> 172.21.15.5:0/1864513221 conn(0x7f11180c3d20 msgr2=0x7f11180c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f111efc7640 1 -- 172.21.15.5:0/1864513221 shutdown_connections 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.186+0000 7f111efc7640 1 -- 172.21.15.5:0/1864513221 wait complete. 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.188+0000 7f111efc7640 1 Processor -- start 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.188+0000 7f111efc7640 1 -- start start 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f111efc7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004db0 0x7f111814c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f111efc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f111814d2d0 0x7f11180b9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f111efc7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180b9d50 0x7f11181e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f111efc7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11180a2ed0 con 0x7f111814d2d0 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f111efc7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f11180bdae0 con 0x7f1104004db0 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f111efc7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f11180a3050 con 0x7f11180b9d50 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f1117fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f111814d2d0 0x7f11180b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f1117fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f111814d2d0 0x7f11180b9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47646/0 (socket says 172.21.15.5:47646) 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f1117fff640 1 -- 172.21.15.5:0/3032019315 learned_addr learned my addr 172.21.15.5:0/3032019315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f111d564640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180b9d50 0x7f11181e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.189+0000 7f111cd63640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004db0 0x7f111814c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f1117fff640 1 -- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180b9d50 msgr2=0x7f11181e7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f1117fff640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180b9d50 0x7f11181e7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f1117fff640 1 -- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004db0 msgr2=0x7f111814c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f1117fff640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004db0 0x7f111814c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f1117fff640 1 -- 172.21.15.5:0/3032019315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111814c8d0 con 0x7f111814d2d0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f1117fff640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f111814d2d0 0x7f11180b9810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f11080077c0 tx=0x7f110800a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f11157fa640 1 -- 172.21.15.5:0/3032019315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1108017020 con 0x7f111814d2d0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f11157fa640 1 -- 172.21.15.5:0/3032019315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1108007ac0 con 0x7f111814d2d0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11181e4d40 con 0x7f111814d2d0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f11157fa640 1 -- 172.21.15.5:0/3032019315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1108013630 con 0x7f111814d2d0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.190+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11181e5300 con 0x7f111814d2d0 2024-05-16T21:32:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.191+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11180c2620 con 0x7f111814d2d0 2024-05-16T21:32:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.192+0000 7f11157fa640 1 -- 172.21.15.5:0/3032019315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f110801a020 con 0x7f111814d2d0 2024-05-16T21:32:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.192+0000 7f11157fa640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10f80762d0 0x7f10f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.192+0000 7f11157fa640 1 -- 172.21.15.5:0/3032019315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f11080980f0 con 0x7f111814d2d0 2024-05-16T21:32:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.193+0000 7f111cd63640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10f80762d0 0x7f10f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.193+0000 7f111cd63640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10f80762d0 0x7f10f80787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11100055f0 tx=0x7f1110009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.197+0000 7f11157fa640 1 -- 172.21.15.5:0/3032019315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1108021020 con 0x7f111814d2d0 2024-05-16T21:32:26.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.384+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1118050940 con 0x7f10f80762d0 2024-05-16T21:32:26.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.391+0000 7f11157fa640 1 -- 172.21.15.5:0/3032019315 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251931 (secure 0 0 0) 0x7f1118050940 con 0x7f10f80762d0 2024-05-16T21:32:26.396 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:26.397 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T21:32:26.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10f80762d0 msgr2=0x7f10f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10f80762d0 0x7f10f80787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11100055f0 tx=0x7f1110009040 comp rx=0 tx=0).stop 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f111814d2d0 msgr2=0x7f11180b9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f111814d2d0 0x7f11180b9810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f11080077c0 tx=0x7f110800a760 comp rx=0 tx=0).stop 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 shutdown_connections 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10f80762d0 0x7f10f80787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11180b9d50 0x7f11181e7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f111814d2d0 0x7f11180b9810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 --2- 172.21.15.5:0/3032019315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1104004db0 0x7f111814c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 >> 172.21.15.5:0/3032019315 conn(0x7f11180c3d20 msgr2=0x7f11180a46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 shutdown_connections 2024-05-16T21:32:26.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.394+0000 7f111efc7640 1 -- 172.21.15.5:0/3032019315 wait complete. 2024-05-16T21:32:26.407 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-16T21:32:26.363800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248200,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726520,"statfs":{"total":773094113280,"available":772839956480,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001498"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950058+0000","last_change":"2024-05-16T21:32:21.976132+0000","last_active":"2024-05-16T21:32:22.950058+0000","last_peered":"2024-05-16T21:32:22.950058+0000","last_clean":"2024-05-16T21:32:22.950058+0000","last_became_active":"2024-05-16T21:32:21.975800+0000","last_became_peered":"2024-05-16T21:32:21.975800+0000","last_unstale":"2024-05-16T21:32:22.950058+0000","last_undegraded":"2024-05-16T21:32:22.950058+0000","last_fullsized":"2024-05-16T21:32:22.950058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:02:17.009863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947415+0000","last_change":"2024-05-16T21:32:21.978779+0000","last_active":"2024-05-16T21:32:22.947415+0000","last_peered":"2024-05-16T21:32:22.947415+0000","last_clean":"2024-05-16T21:32:22.947415+0000","last_became_active":"2024-05-16T21:32:21.978388+0000","last_became_peered":"2024-05-16T21:32:21.978388+0000","last_unstale":"2024-05-16T21:32:22.947415+0000","last_undegraded":"2024-05-16T21:32:22.947415+0000","last_fullsized":"2024-05-16T21:32:22.947415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205298+0000","last_change":"2024-05-16T21:32:21.956609+0000","last_active":"2024-05-16T21:32:23.205298+0000","last_peered":"2024-05-16T21:32:23.205298+0000","last_clean":"2024-05-16T21:32:23.205298+0000","last_became_active":"2024-05-16T21:32:21.954753+0000","last_became_peered":"2024-05-16T21:32:21.954753+0000","last_unstale":"2024-05-16T21:32:23.205298+0000","last_undegraded":"2024-05-16T21:32:23.205298+0000","last_fullsized":"2024-05-16T21:32:23.205298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204851+0000","last_change":"2024-05-16T21:32:21.974803+0000","last_active":"2024-05-16T21:32:23.204851+0000","last_peered":"2024-05-16T21:32:23.204851+0000","last_clean":"2024-05-16T21:32:23.204851+0000","last_became_active":"2024-05-16T21:32:21.974451+0000","last_became_peered":"2024-05-16T21:32:21.974451+0000","last_unstale":"2024-05-16T21:32:23.204851+0000","last_undegraded":"2024-05-16T21:32:23.204851+0000","last_fullsized":"2024-05-16T21:32:23.204851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948861+0000","last_change":"2024-05-16T21:32:21.963654+0000","last_active":"2024-05-16T21:32:22.948861+0000","last_peered":"2024-05-16T21:32:22.948861+0000","last_clean":"2024-05-16T21:32:22.948861+0000","last_became_active":"2024-05-16T21:32:21.963003+0000","last_became_peered":"2024-05-16T21:32:21.963003+0000","last_unstale":"2024-05-16T21:32:22.948861+0000","last_undegraded":"2024-05-16T21:32:22.948861+0000","last_fullsized":"2024-05-16T21:32:22.948861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:40:56.776802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204660+0000","last_change":"2024-05-16T21:32:21.978787+0000","last_active":"2024-05-16T21:32:23.204660+0000","last_peered":"2024-05-16T21:32:23.204660+0000","last_clean":"2024-05-16T21:32:23.204660+0000","last_became_active":"2024-05-16T21:32:21.978449+0000","last_became_peered":"2024-05-16T21:32:21.978449+0000","last_unstale":"2024-05-16T21:32:23.204660+0000","last_undegraded":"2024-05-16T21:32:23.204660+0000","last_fullsized":"2024-05-16T21:32:23.204660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948247+0000","last_change":"2024-05-16T21:32:21.967075+0000","last_active":"2024-05-16T21:32:22.948247+0000","last_peered":"2024-05-16T21:32:22.948247+0000","last_clean":"2024-05-16T21:32:22.948247+0000","last_became_active":"2024-05-16T21:32:21.966751+0000","last_became_peered":"2024-05-16T21:32:21.966751+0000","last_unstale":"2024-05-16T21:32:22.948247+0000","last_undegraded":"2024-05-16T21:32:22.948247+0000","last_fullsized":"2024-05-16T21:32:22.948247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204828+0000","last_change":"2024-05-16T21:32:21.967791+0000","last_active":"2024-05-16T21:32:23.204828+0000","last_peered":"2024-05-16T21:32:23.204828+0000","last_clean":"2024-05-16T21:32:23.204828+0000","last_became_active":"2024-05-16T21:32:21.966100+0000","last_became_peered":"2024-05-16T21:32:21.966100+0000","last_unstale":"2024-05-16T21:32:23.204828+0000","last_undegraded":"2024-05-16T21:32:23.204828+0000","last_fullsized":"2024-05-16T21:32:23.204828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950085+0000","last_change":"2024-05-16T21:32:21.969686+0000","last_active":"2024-05-16T21:32:22.950085+0000","last_peered":"2024-05-16T21:32:22.950085+0000","last_clean":"2024-05-16T21:32:22.950085+0000","last_became_active":"2024-05-16T21:32:21.967835+0000","last_became_peered":"2024-05-16T21:32:21.967835+0000","last_unstale":"2024-05-16T21:32:22.950085+0000","last_undegraded":"2024-05-16T21:32:22.950085+0000","last_fullsized":"2024-05-16T21:32:22.950085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:36:53.325809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952569+0000","last_change":"2024-05-16T21:32:21.979053+0000","last_active":"2024-05-16T21:32:22.952569+0000","last_peered":"2024-05-16T21:32:22.952569+0000","last_clean":"2024-05-16T21:32:22.952569+0000","last_became_active":"2024-05-16T21:32:21.978745+0000","last_became_peered":"2024-05-16T21:32:21.978745+0000","last_unstale":"2024-05-16T21:32:22.952569+0000","last_undegraded":"2024-05-16T21:32:22.952569+0000","last_fullsized":"2024-05-16T21:32:22.952569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952450+0000","last_change":"2024-05-16T21:32:21.978837+0000","last_active":"2024-05-16T21:32:22.952450+0000","last_peered":"2024-05-16T21:32:22.952450+0000","last_clean":"2024-05-16T21:32:22.952450+0000","last_became_active":"2024-05-16T21:32:21.978500+0000","last_became_peered":"2024-05-16T21:32:21.978500+0000","last_unstale":"2024-05-16T21:32:22.952450+0000","last_undegraded":"2024-05-16T21:32:22.952450+0000","last_fullsized":"2024-05-16T21:32:22.952450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949482+0000","last_change":"2024-05-16T21:32:21.976349+0000","last_active":"2024-05-16T21:32:22.949482+0000","last_peered":"2024-05-16T21:32:22.949482+0000","last_clean":"2024-05-16T21:32:22.949482+0000","last_became_active":"2024-05-16T21:32:21.976005+0000","last_became_peered":"2024-05-16T21:32:21.976005+0000","last_unstale":"2024-05-16T21:32:22.949482+0000","last_undegraded":"2024-05-16T21:32:22.949482+0000","last_fullsized":"2024-05-16T21:32:22.949482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:01.168602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205372+0000","last_change":"2024-05-16T21:32:21.963536+0000","last_active":"2024-05-16T21:32:23.205372+0000","last_peered":"2024-05-16T21:32:23.205372+0000","last_clean":"2024-05-16T21:32:23.205372+0000","last_became_active":"2024-05-16T21:32:21.963178+0000","last_became_peered":"2024-05-16T21:32:21.963178+0000","last_unstale":"2024-05-16T21:32:23.205372+0000","last_undegraded":"2024-05-16T21:32:23.205372+0000","last_fullsized":"2024-05-16T21:32:23.205372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204803+0000","last_change":"2024-05-16T21:32:21.964277+0000","last_active":"2024-05-16T21:32:23.204803+0000","last_peered":"2024-05-16T21:32:23.204803+0000","last_clean":"2024-05-16T21:32:23.204803+0000","last_became_active":"2024-05-16T21:32:21.963961+0000","last_became_peered":"2024-05-16T21:32:21.963961+0000","last_unstale":"2024-05-16T21:32:23.204803+0000","last_undegraded":"2024-05-16T21:32:23.204803+0000","last_fullsized":"2024-05-16T21:32:23.204803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:42:42.960425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947030+0000","last_change":"2024-05-16T21:32:21.972498+0000","last_active":"2024-05-16T21:32:22.947030+0000","last_peered":"2024-05-16T21:32:22.947030+0000","last_clean":"2024-05-16T21:32:22.947030+0000","last_became_active":"2024-05-16T21:32:21.972162+0000","last_became_peered":"2024-05-16T21:32:21.972162+0000","last_unstale":"2024-05-16T21:32:22.947030+0000","last_undegraded":"2024-05-16T21:32:22.947030+0000","last_fullsized":"2024-05-16T21:32:22.947030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204551+0000","last_change":"2024-05-16T21:32:21.978680+0000","last_active":"2024-05-16T21:32:23.204551+0000","last_peered":"2024-05-16T21:32:23.204551+0000","last_clean":"2024-05-16T21:32:23.204551+0000","last_became_active":"2024-05-16T21:32:21.978074+0000","last_became_peered":"2024-05-16T21:32:21.978074+0000","last_unstale":"2024-05-16T21:32:23.204551+0000","last_undegraded":"2024-05-16T21:32:23.204551+0000","last_fullsized":"2024-05-16T21:32:23.204551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205355+0000","last_change":"2024-05-16T21:32:21.964040+0000","last_active":"2024-05-16T21:32:23.205355+0000","last_peered":"2024-05-16T21:32:23.205355+0000","last_clean":"2024-05-16T21:32:23.205355+0000","last_became_active":"2024-05-16T21:32:21.963704+0000","last_became_peered":"2024-05-16T21:32:21.963704+0000","last_unstale":"2024-05-16T21:32:23.205355+0000","last_undegraded":"2024-05-16T21:32:23.205355+0000","last_fullsized":"2024-05-16T21:32:23.205355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:46:18.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204455+0000","last_change":"2024-05-16T21:32:21.963298+0000","last_active":"2024-05-16T21:32:23.204455+0000","last_peered":"2024-05-16T21:32:23.204455+0000","last_clean":"2024-05-16T21:32:23.204455+0000","last_became_active":"2024-05-16T21:32:21.962963+0000","last_became_peered":"2024-05-16T21:32:21.962963+0000","last_unstale":"2024-05-16T21:32:23.204455+0000","last_undegraded":"2024-05-16T21:32:23.204455+0000","last_fullsized":"2024-05-16T21:32:23.204455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:48.226628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949999+0000","last_change":"2024-05-16T21:32:21.972160+0000","last_active":"2024-05-16T21:32:22.949999+0000","last_peered":"2024-05-16T21:32:22.949999+0000","last_clean":"2024-05-16T21:32:22.949999+0000","last_became_active":"2024-05-16T21:32:21.971811+0000","last_became_peered":"2024-05-16T21:32:21.971811+0000","last_unstale":"2024-05-16T21:32:22.949999+0000","last_undegraded":"2024-05-16T21:32:22.949999+0000","last_fullsized":"2024-05-16T21:32:22.949999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:46:18.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952546+0000","last_change":"2024-05-16T21:32:21.972168+0000","last_active":"2024-05-16T21:32:22.952546+0000","last_peered":"2024-05-16T21:32:22.952546+0000","last_clean":"2024-05-16T21:32:22.952546+0000","last_became_active":"2024-05-16T21:32:21.971862+0000","last_became_peered":"2024-05-16T21:32:21.971862+0000","last_unstale":"2024-05-16T21:32:22.952546+0000","last_undegraded":"2024-05-16T21:32:22.952546+0000","last_fullsized":"2024-05-16T21:32:22.952546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205399+0000","last_change":"2024-05-16T21:32:21.974084+0000","last_active":"2024-05-16T21:32:23.205399+0000","last_peered":"2024-05-16T21:32:23.205399+0000","last_clean":"2024-05-16T21:32:23.205399+0000","last_became_active":"2024-05-16T21:32:21.973726+0000","last_became_peered":"2024-05-16T21:32:21.973726+0000","last_unstale":"2024-05-16T21:32:23.205399+0000","last_undegraded":"2024-05-16T21:32:23.205399+0000","last_fullsized":"2024-05-16T21:32:23.205399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204801+0000","last_change":"2024-05-16T21:32:21.978211+0000","last_active":"2024-05-16T21:32:23.204801+0000","last_peered":"2024-05-16T21:32:23.204801+0000","last_clean":"2024-05-16T21:32:23.204801+0000","last_became_active":"2024-05-16T21:32:21.977793+0000","last_became_peered":"2024-05-16T21:32:21.977793+0000","last_unstale":"2024-05-16T21:32:23.204801+0000","last_undegraded":"2024-05-16T21:32:23.204801+0000","last_fullsized":"2024-05-16T21:32:23.204801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:22:33.919329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204974+0000","last_change":"2024-05-16T21:32:21.963842+0000","last_active":"2024-05-16T21:32:23.204974+0000","last_peered":"2024-05-16T21:32:23.204974+0000","last_clean":"2024-05-16T21:32:23.204974+0000","last_became_active":"2024-05-16T21:32:21.963470+0000","last_became_peered":"2024-05-16T21:32:21.963470+0000","last_unstale":"2024-05-16T21:32:23.204974+0000","last_undegraded":"2024-05-16T21:32:23.204974+0000","last_fullsized":"2024-05-16T21:32:23.204974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204836+0000","last_change":"2024-05-16T21:32:21.976067+0000","last_active":"2024-05-16T21:32:23.204836+0000","last_peered":"2024-05-16T21:32:23.204836+0000","last_clean":"2024-05-16T21:32:23.204836+0000","last_became_active":"2024-05-16T21:32:21.975725+0000","last_became_peered":"2024-05-16T21:32:21.975725+0000","last_unstale":"2024-05-16T21:32:23.204836+0000","last_undegraded":"2024-05-16T21:32:23.204836+0000","last_fullsized":"2024-05-16T21:32:23.204836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:01:44.861353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205481+0000","last_change":"2024-05-16T21:32:21.961173+0000","last_active":"2024-05-16T21:32:23.205481+0000","last_peered":"2024-05-16T21:32:23.205481+0000","last_clean":"2024-05-16T21:32:23.205481+0000","last_became_active":"2024-05-16T21:32:21.960245+0000","last_became_peered":"2024-05-16T21:32:21.960245+0000","last_unstale":"2024-05-16T21:32:23.205481+0000","last_undegraded":"2024-05-16T21:32:23.205481+0000","last_fullsized":"2024-05-16T21:32:23.205481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952682+0000","last_change":"2024-05-16T21:32:21.978891+0000","last_active":"2024-05-16T21:32:22.952682+0000","last_peered":"2024-05-16T21:32:22.952682+0000","last_clean":"2024-05-16T21:32:22.952682+0000","last_became_active":"2024-05-16T21:32:21.978606+0000","last_became_peered":"2024-05-16T21:32:21.978606+0000","last_unstale":"2024-05-16T21:32:22.952682+0000","last_undegraded":"2024-05-16T21:32:22.952682+0000","last_fullsized":"2024-05-16T21:32:22.952682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947136+0000","last_change":"2024-05-16T21:32:21.970674+0000","last_active":"2024-05-16T21:32:22.947136+0000","last_peered":"2024-05-16T21:32:22.947136+0000","last_clean":"2024-05-16T21:32:22.947136+0000","last_became_active":"2024-05-16T21:32:21.970326+0000","last_became_peered":"2024-05-16T21:32:21.970326+0000","last_unstale":"2024-05-16T21:32:22.947136+0000","last_undegraded":"2024-05-16T21:32:22.947136+0000","last_fullsized":"2024-05-16T21:32:22.947136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205856+0000","last_change":"2024-05-16T21:32:21.967452+0000","last_active":"2024-05-16T21:32:23.205856+0000","last_peered":"2024-05-16T21:32:23.205856+0000","last_clean":"2024-05-16T21:32:23.205856+0000","last_became_active":"2024-05-16T21:32:21.966389+0000","last_became_peered":"2024-05-16T21:32:21.966389+0000","last_unstale":"2024-05-16T21:32:23.205856+0000","last_undegraded":"2024-05-16T21:32:23.205856+0000","last_fullsized":"2024-05-16T21:32:23.205856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205455+0000","last_change":"2024-05-16T21:32:21.957783+0000","last_active":"2024-05-16T21:32:23.205455+0000","last_peered":"2024-05-16T21:32:23.205455+0000","last_clean":"2024-05-16T21:32:23.205455+0000","last_became_active":"2024-05-16T21:32:21.957300+0000","last_became_peered":"2024-05-16T21:32:21.957300+0000","last_unstale":"2024-05-16T21:32:23.205455+0000","last_undegraded":"2024-05-16T21:32:23.205455+0000","last_fullsized":"2024-05-16T21:32:23.205455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204948+0000","last_change":"2024-05-16T21:32:21.975799+0000","last_active":"2024-05-16T21:32:23.204948+0000","last_peered":"2024-05-16T21:32:23.204948+0000","last_clean":"2024-05-16T21:32:23.204948+0000","last_became_active":"2024-05-16T21:32:21.975482+0000","last_became_peered":"2024-05-16T21:32:21.975482+0000","last_unstale":"2024-05-16T21:32:23.204948+0000","last_undegraded":"2024-05-16T21:32:23.204948+0000","last_fullsized":"2024-05-16T21:32:23.204948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204342+0000","last_change":"2024-05-16T21:32:21.964267+0000","last_active":"2024-05-16T21:32:23.204342+0000","last_peered":"2024-05-16T21:32:23.204342+0000","last_clean":"2024-05-16T21:32:23.204342+0000","last_became_active":"2024-05-16T21:32:21.963928+0000","last_became_peered":"2024-05-16T21:32:21.963928+0000","last_unstale":"2024-05-16T21:32:23.204342+0000","last_undegraded":"2024-05-16T21:32:23.204342+0000","last_fullsized":"2024-05-16T21:32:23.204342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:01.168602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952245+0000","last_change":"2024-05-16T21:32:21.970847+0000","last_active":"2024-05-16T21:32:22.952245+0000","last_peered":"2024-05-16T21:32:22.952245+0000","last_clean":"2024-05-16T21:32:22.952245+0000","last_became_active":"2024-05-16T21:32:21.970260+0000","last_became_peered":"2024-05-16T21:32:21.970260+0000","last_unstale":"2024-05-16T21:32:22.952245+0000","last_undegraded":"2024-05-16T21:32:22.952245+0000","last_fullsized":"2024-05-16T21:32:22.952245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948708+0000","last_change":"2024-05-16T21:32:21.968173+0000","last_active":"2024-05-16T21:32:22.948708+0000","last_peered":"2024-05-16T21:32:22.948708+0000","last_clean":"2024-05-16T21:32:22.948708+0000","last_became_active":"2024-05-16T21:32:21.967815+0000","last_became_peered":"2024-05-16T21:32:21.967815+0000","last_unstale":"2024-05-16T21:32:22.948708+0000","last_undegraded":"2024-05-16T21:32:22.948708+0000","last_fullsized":"2024-05-16T21:32:22.948708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:19.038761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205694+0000","last_change":"2024-05-16T21:32:20.969468+0000","last_active":"2024-05-16T21:32:23.205694+0000","last_peered":"2024-05-16T21:32:23.205694+0000","last_clean":"2024-05-16T21:32:23.205694+0000","last_became_active":"2024-05-16T21:32:20.969070+0000","last_became_peered":"2024-05-16T21:32:20.969070+0000","last_unstale":"2024-05-16T21:32:23.205694+0000","last_undegraded":"2024-05-16T21:32:23.205694+0000","last_fullsized":"2024-05-16T21:32:23.205694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205572+0000","last_change":"2024-05-16T21:32:21.962562+0000","last_active":"2024-05-16T21:32:23.205572+0000","last_peered":"2024-05-16T21:32:23.205572+0000","last_clean":"2024-05-16T21:32:23.205572+0000","last_became_active":"2024-05-16T21:32:21.960939+0000","last_became_peered":"2024-05-16T21:32:21.960939+0000","last_unstale":"2024-05-16T21:32:23.205572+0000","last_undegraded":"2024-05-16T21:32:23.205572+0000","last_fullsized":"2024-05-16T21:32:23.205572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952228+0000","last_change":"2024-05-16T21:32:20.963331+0000","last_active":"2024-05-16T21:32:22.952228+0000","last_peered":"2024-05-16T21:32:22.952228+0000","last_clean":"2024-05-16T21:32:22.952228+0000","last_became_active":"2024-05-16T21:32:20.963022+0000","last_became_peered":"2024-05-16T21:32:20.963022+0000","last_unstale":"2024-05-16T21:32:22.952228+0000","last_undegraded":"2024-05-16T21:32:22.952228+0000","last_fullsized":"2024-05-16T21:32:22.952228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205155+0000","last_change":"2024-05-16T21:32:20.963234+0000","last_active":"2024-05-16T21:32:23.205155+0000","last_peered":"2024-05-16T21:32:23.205155+0000","last_clean":"2024-05-16T21:32:23.205155+0000","last_became_active":"2024-05-16T21:32:20.962909+0000","last_became_peered":"2024-05-16T21:32:20.962909+0000","last_unstale":"2024-05-16T21:32:23.205155+0000","last_undegraded":"2024-05-16T21:32:23.205155+0000","last_fullsized":"2024-05-16T21:32:23.205155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:53:28.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205007+0000","last_change":"2024-05-16T21:32:21.958029+0000","last_active":"2024-05-16T21:32:23.205007+0000","last_peered":"2024-05-16T21:32:23.205007+0000","last_clean":"2024-05-16T21:32:23.205007+0000","last_became_active":"2024-05-16T21:32:21.957650+0000","last_became_peered":"2024-05-16T21:32:21.957650+0000","last_unstale":"2024-05-16T21:32:23.205007+0000","last_undegraded":"2024-05-16T21:32:23.205007+0000","last_fullsized":"2024-05-16T21:32:23.205007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204693+0000","last_change":"2024-05-16T21:32:20.963432+0000","last_active":"2024-05-16T21:32:23.204693+0000","last_peered":"2024-05-16T21:32:23.204693+0000","last_clean":"2024-05-16T21:32:23.204693+0000","last_became_active":"2024-05-16T21:32:20.963062+0000","last_became_peered":"2024-05-16T21:32:20.963062+0000","last_unstale":"2024-05-16T21:32:23.204693+0000","last_undegraded":"2024-05-16T21:32:23.204693+0000","last_fullsized":"2024-05-16T21:32:23.204693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947016+0000","last_change":"2024-05-16T21:32:21.971148+0000","last_active":"2024-05-16T21:32:22.947016+0000","last_peered":"2024-05-16T21:32:22.947016+0000","last_clean":"2024-05-16T21:32:22.947016+0000","last_became_active":"2024-05-16T21:32:21.970842+0000","last_became_peered":"2024-05-16T21:32:21.970842+0000","last_unstale":"2024-05-16T21:32:22.947016+0000","last_undegraded":"2024-05-16T21:32:22.947016+0000","last_fullsized":"2024-05-16T21:32:22.947016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952504+0000","last_change":"2024-05-16T21:32:20.966317+0000","last_active":"2024-05-16T21:32:22.952504+0000","last_peered":"2024-05-16T21:32:22.952504+0000","last_clean":"2024-05-16T21:32:22.952504+0000","last_became_active":"2024-05-16T21:32:20.966009+0000","last_became_peered":"2024-05-16T21:32:20.966009+0000","last_unstale":"2024-05-16T21:32:22.952504+0000","last_undegraded":"2024-05-16T21:32:22.952504+0000","last_fullsized":"2024-05-16T21:32:22.952504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204973+0000","last_change":"2024-05-16T21:32:21.977643+0000","last_active":"2024-05-16T21:32:23.204973+0000","last_peered":"2024-05-16T21:32:23.204973+0000","last_clean":"2024-05-16T21:32:23.204973+0000","last_became_active":"2024-05-16T21:32:21.977335+0000","last_became_peered":"2024-05-16T21:32:21.977335+0000","last_unstale":"2024-05-16T21:32:23.204973+0000","last_undegraded":"2024-05-16T21:32:23.204973+0000","last_fullsized":"2024-05-16T21:32:23.204973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205222+0000","last_change":"2024-05-16T21:32:20.965401+0000","last_active":"2024-05-16T21:32:23.205222+0000","last_peered":"2024-05-16T21:32:23.205222+0000","last_clean":"2024-05-16T21:32:23.205222+0000","last_became_active":"2024-05-16T21:32:20.964989+0000","last_became_peered":"2024-05-16T21:32:20.964989+0000","last_unstale":"2024-05-16T21:32:23.205222+0000","last_undegraded":"2024-05-16T21:32:23.205222+0000","last_fullsized":"2024-05-16T21:32:23.205222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205076+0000","last_change":"2024-05-16T21:32:21.968344+0000","last_active":"2024-05-16T21:32:23.205076+0000","last_peered":"2024-05-16T21:32:23.205076+0000","last_clean":"2024-05-16T21:32:23.205076+0000","last_became_active":"2024-05-16T21:32:21.966870+0000","last_became_peered":"2024-05-16T21:32:21.966870+0000","last_unstale":"2024-05-16T21:32:23.205076+0000","last_undegraded":"2024-05-16T21:32:23.205076+0000","last_fullsized":"2024-05-16T21:32:23.205076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947126+0000","last_change":"2024-05-16T21:32:20.964832+0000","last_active":"2024-05-16T21:32:22.947126+0000","last_peered":"2024-05-16T21:32:22.947126+0000","last_clean":"2024-05-16T21:32:22.947126+0000","last_became_active":"2024-05-16T21:32:20.964458+0000","last_became_peered":"2024-05-16T21:32:20.964458+0000","last_unstale":"2024-05-16T21:32:22.947126+0000","last_undegraded":"2024-05-16T21:32:22.947126+0000","last_fullsized":"2024-05-16T21:32:22.947126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949526+0000","last_change":"2024-05-16T21:32:21.974914+0000","last_active":"2024-05-16T21:32:22.949526+0000","last_peered":"2024-05-16T21:32:22.949526+0000","last_clean":"2024-05-16T21:32:22.949526+0000","last_became_active":"2024-05-16T21:32:21.974607+0000","last_became_peered":"2024-05-16T21:32:21.974607+0000","last_unstale":"2024-05-16T21:32:22.949526+0000","last_undegraded":"2024-05-16T21:32:22.949526+0000","last_fullsized":"2024-05-16T21:32:22.949526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:48.226628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952564+0000","last_change":"2024-05-16T21:32:20.966220+0000","last_active":"2024-05-16T21:32:22.952564+0000","last_peered":"2024-05-16T21:32:22.952564+0000","last_clean":"2024-05-16T21:32:22.952564+0000","last_became_active":"2024-05-16T21:32:20.965498+0000","last_became_peered":"2024-05-16T21:32:20.965498+0000","last_unstale":"2024-05-16T21:32:22.952564+0000","last_undegraded":"2024-05-16T21:32:22.952564+0000","last_fullsized":"2024-05-16T21:32:22.952564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948771+0000","last_change":"2024-05-16T21:32:21.973995+0000","last_active":"2024-05-16T21:32:22.948771+0000","last_peered":"2024-05-16T21:32:22.948771+0000","last_clean":"2024-05-16T21:32:22.948771+0000","last_became_active":"2024-05-16T21:32:21.972703+0000","last_became_peered":"2024-05-16T21:32:21.972703+0000","last_unstale":"2024-05-16T21:32:22.948771+0000","last_undegraded":"2024-05-16T21:32:22.948771+0000","last_fullsized":"2024-05-16T21:32:22.948771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:15.421446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205568+0000","last_change":"2024-05-16T21:32:20.953536+0000","last_active":"2024-05-16T21:32:23.205568+0000","last_peered":"2024-05-16T21:32:23.205568+0000","last_clean":"2024-05-16T21:32:23.205568+0000","last_became_active":"2024-05-16T21:32:20.953195+0000","last_became_peered":"2024-05-16T21:32:20.953195+0000","last_unstale":"2024-05-16T21:32:23.205568+0000","last_undegraded":"2024-05-16T21:32:23.205568+0000","last_fullsized":"2024-05-16T21:32:23.205568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:37:41.623319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205056+0000","last_change":"2024-05-16T21:32:21.962049+0000","last_active":"2024-05-16T21:32:23.205056+0000","last_peered":"2024-05-16T21:32:23.205056+0000","last_clean":"2024-05-16T21:32:23.205056+0000","last_became_active":"2024-05-16T21:32:21.961632+0000","last_became_peered":"2024-05-16T21:32:21.961632+0000","last_unstale":"2024-05-16T21:32:23.205056+0000","last_undegraded":"2024-05-16T21:32:23.205056+0000","last_fullsized":"2024-05-16T21:32:23.205056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:16.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204985+0000","last_change":"2024-05-16T21:32:20.968243+0000","last_active":"2024-05-16T21:32:23.204985+0000","last_peered":"2024-05-16T21:32:23.204985+0000","last_clean":"2024-05-16T21:32:23.204985+0000","last_became_active":"2024-05-16T21:32:20.967901+0000","last_became_peered":"2024-05-16T21:32:20.967901+0000","last_unstale":"2024-05-16T21:32:23.204985+0000","last_undegraded":"2024-05-16T21:32:23.204985+0000","last_fullsized":"2024-05-16T21:32:23.204985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948912+0000","last_change":"2024-05-16T21:32:21.963926+0000","last_active":"2024-05-16T21:32:22.948912+0000","last_peered":"2024-05-16T21:32:22.948912+0000","last_clean":"2024-05-16T21:32:22.948912+0000","last_became_active":"2024-05-16T21:32:21.963333+0000","last_became_peered":"2024-05-16T21:32:21.963333+0000","last_unstale":"2024-05-16T21:32:22.948912+0000","last_undegraded":"2024-05-16T21:32:22.948912+0000","last_fullsized":"2024-05-16T21:32:22.948912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:26.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952200+0000","last_change":"2024-05-16T21:32:20.960218+0000","last_active":"2024-05-16T21:32:22.952200+0000","last_peered":"2024-05-16T21:32:22.952200+0000","last_clean":"2024-05-16T21:32:22.952200+0000","last_became_active":"2024-05-16T21:32:20.959870+0000","last_became_peered":"2024-05-16T21:32:20.959870+0000","last_unstale":"2024-05-16T21:32:22.952200+0000","last_undegraded":"2024-05-16T21:32:22.952200+0000","last_fullsized":"2024-05-16T21:32:22.952200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952216+0000","last_change":"2024-05-16T21:32:21.970587+0000","last_active":"2024-05-16T21:32:22.952216+0000","last_peered":"2024-05-16T21:32:22.952216+0000","last_clean":"2024-05-16T21:32:22.952216+0000","last_became_active":"2024-05-16T21:32:21.969859+0000","last_became_peered":"2024-05-16T21:32:21.969859+0000","last_unstale":"2024-05-16T21:32:22.952216+0000","last_undegraded":"2024-05-16T21:32:22.952216+0000","last_fullsized":"2024-05-16T21:32:22.952216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:19:22.267338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205276+0000","last_change":"2024-05-16T21:32:20.955486+0000","last_active":"2024-05-16T21:32:23.205276+0000","last_peered":"2024-05-16T21:32:23.205276+0000","last_clean":"2024-05-16T21:32:23.205276+0000","last_became_active":"2024-05-16T21:32:20.955104+0000","last_became_peered":"2024-05-16T21:32:20.955104+0000","last_unstale":"2024-05-16T21:32:23.205276+0000","last_undegraded":"2024-05-16T21:32:23.205276+0000","last_fullsized":"2024-05-16T21:32:23.205276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:53:28.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948444+0000","last_change":"2024-05-16T21:32:21.975286+0000","last_active":"2024-05-16T21:32:22.948444+0000","last_peered":"2024-05-16T21:32:22.948444+0000","last_clean":"2024-05-16T21:32:22.948444+0000","last_became_active":"2024-05-16T21:32:21.974919+0000","last_became_peered":"2024-05-16T21:32:21.974919+0000","last_unstale":"2024-05-16T21:32:22.948444+0000","last_undegraded":"2024-05-16T21:32:22.948444+0000","last_fullsized":"2024-05-16T21:32:22.948444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948892+0000","last_change":"2024-05-16T21:32:20.958267+0000","last_active":"2024-05-16T21:32:22.948892+0000","last_peered":"2024-05-16T21:32:22.948892+0000","last_clean":"2024-05-16T21:32:22.948892+0000","last_became_active":"2024-05-16T21:32:20.957945+0000","last_became_peered":"2024-05-16T21:32:20.957945+0000","last_unstale":"2024-05-16T21:32:22.948892+0000","last_undegraded":"2024-05-16T21:32:22.948892+0000","last_fullsized":"2024-05-16T21:32:22.948892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:12.938490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950015+0000","last_change":"2024-05-16T21:32:21.964539+0000","last_active":"2024-05-16T21:32:22.950015+0000","last_peered":"2024-05-16T21:32:22.950015+0000","last_clean":"2024-05-16T21:32:22.950015+0000","last_became_active":"2024-05-16T21:32:21.962499+0000","last_became_peered":"2024-05-16T21:32:21.962499+0000","last_unstale":"2024-05-16T21:32:22.950015+0000","last_undegraded":"2024-05-16T21:32:22.950015+0000","last_fullsized":"2024-05-16T21:32:22.950015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:08:57.226640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204577+0000","last_change":"2024-05-16T21:32:20.966720+0000","last_active":"2024-05-16T21:32:23.204577+0000","last_peered":"2024-05-16T21:32:23.204577+0000","last_clean":"2024-05-16T21:32:23.204577+0000","last_became_active":"2024-05-16T21:32:20.966403+0000","last_became_peered":"2024-05-16T21:32:20.966403+0000","last_unstale":"2024-05-16T21:32:23.204577+0000","last_undegraded":"2024-05-16T21:32:23.204577+0000","last_fullsized":"2024-05-16T21:32:23.204577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950173+0000","last_change":"2024-05-16T21:32:21.966883+0000","last_active":"2024-05-16T21:32:22.950173+0000","last_peered":"2024-05-16T21:32:22.950173+0000","last_clean":"2024-05-16T21:32:22.950173+0000","last_became_active":"2024-05-16T21:32:21.966493+0000","last_became_peered":"2024-05-16T21:32:21.966493+0000","last_unstale":"2024-05-16T21:32:22.950173+0000","last_undegraded":"2024-05-16T21:32:22.950173+0000","last_fullsized":"2024-05-16T21:32:22.950173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:51.561288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947243+0000","last_change":"2024-05-16T21:32:20.953581+0000","last_active":"2024-05-16T21:32:22.947243+0000","last_peered":"2024-05-16T21:32:22.947243+0000","last_clean":"2024-05-16T21:32:22.947243+0000","last_became_active":"2024-05-16T21:32:20.953237+0000","last_became_peered":"2024-05-16T21:32:20.953237+0000","last_unstale":"2024-05-16T21:32:22.947243+0000","last_undegraded":"2024-05-16T21:32:22.947243+0000","last_fullsized":"2024-05-16T21:32:22.947243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205106+0000","last_change":"2024-05-16T21:32:21.975314+0000","last_active":"2024-05-16T21:32:23.205106+0000","last_peered":"2024-05-16T21:32:23.205106+0000","last_clean":"2024-05-16T21:32:23.205106+0000","last_became_active":"2024-05-16T21:32:21.975001+0000","last_became_peered":"2024-05-16T21:32:21.975001+0000","last_unstale":"2024-05-16T21:32:23.205106+0000","last_undegraded":"2024-05-16T21:32:23.205106+0000","last_fullsized":"2024-05-16T21:32:23.205106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:40:56.776802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204320+0000","last_change":"2024-05-16T21:32:20.966198+0000","last_active":"2024-05-16T21:32:23.204320+0000","last_peered":"2024-05-16T21:32:23.204320+0000","last_clean":"2024-05-16T21:32:23.204320+0000","last_became_active":"2024-05-16T21:32:20.965864+0000","last_became_peered":"2024-05-16T21:32:20.965864+0000","last_unstale":"2024-05-16T21:32:23.204320+0000","last_undegraded":"2024-05-16T21:32:23.204320+0000","last_fullsized":"2024-05-16T21:32:23.204320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948960+0000","last_change":"2024-05-16T21:32:21.968642+0000","last_active":"2024-05-16T21:32:22.948960+0000","last_peered":"2024-05-16T21:32:22.948960+0000","last_clean":"2024-05-16T21:32:22.948960+0000","last_became_active":"2024-05-16T21:32:21.968084+0000","last_became_peered":"2024-05-16T21:32:21.968084+0000","last_unstale":"2024-05-16T21:32:22.948960+0000","last_undegraded":"2024-05-16T21:32:22.948960+0000","last_fullsized":"2024-05-16T21:32:22.948960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:41:08.428677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948023+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T21:32:22.948023+0000","last_peered":"2024-05-16T21:32:22.948023+0000","last_clean":"2024-05-16T21:32:22.948023+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T21:32:22.948023+0000","last_undegraded":"2024-05-16T21:32:22.948023+0000","last_fullsized":"2024-05-16T21:32:22.948023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204626+0000","last_change":"2024-05-16T21:32:20.964695+0000","last_active":"2024-05-16T21:32:23.204626+0000","last_peered":"2024-05-16T21:32:23.204626+0000","last_clean":"2024-05-16T21:32:23.204626+0000","last_became_active":"2024-05-16T21:32:20.963727+0000","last_became_peered":"2024-05-16T21:32:20.963727+0000","last_unstale":"2024-05-16T21:32:23.204626+0000","last_undegraded":"2024-05-16T21:32:23.204626+0000","last_fullsized":"2024-05-16T21:32:23.204626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205555+0000","last_change":"2024-05-16T21:32:21.967136+0000","last_active":"2024-05-16T21:32:23.205555+0000","last_peered":"2024-05-16T21:32:23.205555+0000","last_clean":"2024-05-16T21:32:23.205555+0000","last_became_active":"2024-05-16T21:32:21.966780+0000","last_became_peered":"2024-05-16T21:32:21.966780+0000","last_unstale":"2024-05-16T21:32:23.205555+0000","last_undegraded":"2024-05-16T21:32:23.205555+0000","last_fullsized":"2024-05-16T21:32:23.205555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949105+0000","last_change":"2024-05-16T21:32:20.958213+0000","last_active":"2024-05-16T21:32:22.949105+0000","last_peered":"2024-05-16T21:32:22.949105+0000","last_clean":"2024-05-16T21:32:22.949105+0000","last_became_active":"2024-05-16T21:32:20.957898+0000","last_became_peered":"2024-05-16T21:32:20.957898+0000","last_unstale":"2024-05-16T21:32:22.949105+0000","last_undegraded":"2024-05-16T21:32:22.949105+0000","last_fullsized":"2024-05-16T21:32:22.949105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:47.220802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204489+0000","last_change":"2024-05-16T21:32:21.968841+0000","last_active":"2024-05-16T21:32:23.204489+0000","last_peered":"2024-05-16T21:32:23.204489+0000","last_clean":"2024-05-16T21:32:23.204489+0000","last_became_active":"2024-05-16T21:32:21.968322+0000","last_became_peered":"2024-05-16T21:32:21.968322+0000","last_unstale":"2024-05-16T21:32:23.204489+0000","last_undegraded":"2024-05-16T21:32:23.204489+0000","last_fullsized":"2024-05-16T21:32:23.204489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:05.477666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204469+0000","last_change":"2024-05-16T21:32:20.967828+0000","last_active":"2024-05-16T21:32:23.204469+0000","last_peered":"2024-05-16T21:32:23.204469+0000","last_clean":"2024-05-16T21:32:23.204469+0000","last_became_active":"2024-05-16T21:32:20.967418+0000","last_became_peered":"2024-05-16T21:32:20.967418+0000","last_unstale":"2024-05-16T21:32:23.204469+0000","last_undegraded":"2024-05-16T21:32:23.204469+0000","last_fullsized":"2024-05-16T21:32:23.204469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947214+0000","last_change":"2024-05-16T21:32:21.961302+0000","last_active":"2024-05-16T21:32:22.947214+0000","last_peered":"2024-05-16T21:32:22.947214+0000","last_clean":"2024-05-16T21:32:22.947214+0000","last_became_active":"2024-05-16T21:32:21.960763+0000","last_became_peered":"2024-05-16T21:32:21.960763+0000","last_unstale":"2024-05-16T21:32:22.947214+0000","last_undegraded":"2024-05-16T21:32:22.947214+0000","last_fullsized":"2024-05-16T21:32:22.947214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205119+0000","last_change":"2024-05-16T21:32:20.964419+0000","last_active":"2024-05-16T21:32:23.205119+0000","last_peered":"2024-05-16T21:32:23.205119+0000","last_clean":"2024-05-16T21:32:23.205119+0000","last_became_active":"2024-05-16T21:32:20.964093+0000","last_became_peered":"2024-05-16T21:32:20.964093+0000","last_unstale":"2024-05-16T21:32:23.205119+0000","last_undegraded":"2024-05-16T21:32:23.205119+0000","last_fullsized":"2024-05-16T21:32:23.205119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948592+0000","last_change":"2024-05-16T21:32:21.958086+0000","last_active":"2024-05-16T21:32:22.948592+0000","last_peered":"2024-05-16T21:32:22.948592+0000","last_clean":"2024-05-16T21:32:22.948592+0000","last_became_active":"2024-05-16T21:32:21.957701+0000","last_became_peered":"2024-05-16T21:32:21.957701+0000","last_unstale":"2024-05-16T21:32:22.948592+0000","last_undegraded":"2024-05-16T21:32:22.948592+0000","last_fullsized":"2024-05-16T21:32:22.948592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:01.206393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947265+0000","last_change":"2024-05-16T21:32:20.959456+0000","last_active":"2024-05-16T21:32:22.947265+0000","last_peered":"2024-05-16T21:32:22.947265+0000","last_clean":"2024-05-16T21:32:22.947265+0000","last_became_active":"2024-05-16T21:32:20.959154+0000","last_became_peered":"2024-05-16T21:32:20.959154+0000","last_unstale":"2024-05-16T21:32:22.947265+0000","last_undegraded":"2024-05-16T21:32:22.947265+0000","last_fullsized":"2024-05-16T21:32:22.947265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205258+0000","last_change":"2024-05-16T21:32:21.974993+0000","last_active":"2024-05-16T21:32:23.205258+0000","last_peered":"2024-05-16T21:32:23.205258+0000","last_clean":"2024-05-16T21:32:23.205258+0000","last_became_active":"2024-05-16T21:32:21.974284+0000","last_became_peered":"2024-05-16T21:32:21.974284+0000","last_unstale":"2024-05-16T21:32:23.205258+0000","last_undegraded":"2024-05-16T21:32:23.205258+0000","last_fullsized":"2024-05-16T21:32:23.205258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:26.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950079+0000","last_change":"2024-05-16T21:32:20.960943+0000","last_active":"2024-05-16T21:32:22.950079+0000","last_peered":"2024-05-16T21:32:22.950079+0000","last_clean":"2024-05-16T21:32:22.950079+0000","last_became_active":"2024-05-16T21:32:20.960501+0000","last_became_peered":"2024-05-16T21:32:20.960501+0000","last_unstale":"2024-05-16T21:32:22.950079+0000","last_undegraded":"2024-05-16T21:32:22.950079+0000","last_fullsized":"2024-05-16T21:32:22.950079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:04.471840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947201+0000","last_change":"2024-05-16T21:32:21.966653+0000","last_active":"2024-05-16T21:32:22.947201+0000","last_peered":"2024-05-16T21:32:22.947201+0000","last_clean":"2024-05-16T21:32:22.947201+0000","last_became_active":"2024-05-16T21:32:21.966311+0000","last_became_peered":"2024-05-16T21:32:21.966311+0000","last_unstale":"2024-05-16T21:32:22.947201+0000","last_undegraded":"2024-05-16T21:32:22.947201+0000","last_fullsized":"2024-05-16T21:32:22.947201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.951673+0000","last_change":"2024-05-16T21:32:20.965931+0000","last_active":"2024-05-16T21:32:22.951673+0000","last_peered":"2024-05-16T21:32:22.951673+0000","last_clean":"2024-05-16T21:32:22.951673+0000","last_became_active":"2024-05-16T21:32:20.965603+0000","last_became_peered":"2024-05-16T21:32:20.965603+0000","last_unstale":"2024-05-16T21:32:22.951673+0000","last_undegraded":"2024-05-16T21:32:22.951673+0000","last_fullsized":"2024-05-16T21:32:22.951673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205566+0000","last_change":"2024-05-16T21:32:21.958052+0000","last_active":"2024-05-16T21:32:23.205566+0000","last_peered":"2024-05-16T21:32:23.205566+0000","last_clean":"2024-05-16T21:32:23.205566+0000","last_became_active":"2024-05-16T21:32:21.957690+0000","last_became_peered":"2024-05-16T21:32:21.957690+0000","last_unstale":"2024-05-16T21:32:23.205566+0000","last_undegraded":"2024-05-16T21:32:23.205566+0000","last_fullsized":"2024-05-16T21:32:23.205566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:22:33.919329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952599+0000","last_change":"2024-05-16T21:32:20.967895+0000","last_active":"2024-05-16T21:32:22.952599+0000","last_peered":"2024-05-16T21:32:22.952599+0000","last_clean":"2024-05-16T21:32:22.952599+0000","last_became_active":"2024-05-16T21:32:20.967450+0000","last_became_peered":"2024-05-16T21:32:20.967450+0000","last_unstale":"2024-05-16T21:32:22.952599+0000","last_undegraded":"2024-05-16T21:32:22.952599+0000","last_fullsized":"2024-05-16T21:32:22.952599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205220+0000","last_change":"2024-05-16T21:32:21.963459+0000","last_active":"2024-05-16T21:32:23.205220+0000","last_peered":"2024-05-16T21:32:23.205220+0000","last_clean":"2024-05-16T21:32:23.205220+0000","last_became_active":"2024-05-16T21:32:21.963137+0000","last_became_peered":"2024-05-16T21:32:21.963137+0000","last_unstale":"2024-05-16T21:32:23.205220+0000","last_undegraded":"2024-05-16T21:32:23.205220+0000","last_fullsized":"2024-05-16T21:32:23.205220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947954+0000","last_change":"2024-05-16T21:32:20.962252+0000","last_active":"2024-05-16T21:32:22.947954+0000","last_peered":"2024-05-16T21:32:22.947954+0000","last_clean":"2024-05-16T21:32:22.947954+0000","last_became_active":"2024-05-16T21:32:20.960720+0000","last_became_peered":"2024-05-16T21:32:20.960720+0000","last_unstale":"2024-05-16T21:32:22.947954+0000","last_undegraded":"2024-05-16T21:32:22.947954+0000","last_fullsized":"2024-05-16T21:32:22.947954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:00.162776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949215+0000","last_change":"2024-05-16T21:32:21.962732+0000","last_active":"2024-05-16T21:32:22.949215+0000","last_peered":"2024-05-16T21:32:22.949215+0000","last_clean":"2024-05-16T21:32:22.949215+0000","last_became_active":"2024-05-16T21:32:21.961668+0000","last_became_peered":"2024-05-16T21:32:21.961668+0000","last_unstale":"2024-05-16T21:32:22.949215+0000","last_undegraded":"2024-05-16T21:32:22.949215+0000","last_fullsized":"2024-05-16T21:32:22.949215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:10.289046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947142+0000","last_change":"2024-05-16T21:32:20.961726+0000","last_active":"2024-05-16T21:32:22.947142+0000","last_peered":"2024-05-16T21:32:22.947142+0000","last_clean":"2024-05-16T21:32:22.947142+0000","last_became_active":"2024-05-16T21:32:20.961210+0000","last_became_peered":"2024-05-16T21:32:20.961210+0000","last_unstale":"2024-05-16T21:32:22.947142+0000","last_undegraded":"2024-05-16T21:32:22.947142+0000","last_fullsized":"2024-05-16T21:32:22.947142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:00.162776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205183+0000","last_change":"2024-05-16T21:32:21.969756+0000","last_active":"2024-05-16T21:32:23.205183+0000","last_peered":"2024-05-16T21:32:23.205183+0000","last_clean":"2024-05-16T21:32:23.205183+0000","last_became_active":"2024-05-16T21:32:21.969427+0000","last_became_peered":"2024-05-16T21:32:21.969427+0000","last_unstale":"2024-05-16T21:32:23.205183+0000","last_undegraded":"2024-05-16T21:32:23.205183+0000","last_fullsized":"2024-05-16T21:32:23.205183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947319+0000","last_change":"2024-05-16T21:32:20.963280+0000","last_active":"2024-05-16T21:32:22.947319+0000","last_peered":"2024-05-16T21:32:22.947319+0000","last_clean":"2024-05-16T21:32:22.947319+0000","last_became_active":"2024-05-16T21:32:20.962938+0000","last_became_peered":"2024-05-16T21:32:20.962938+0000","last_unstale":"2024-05-16T21:32:22.947319+0000","last_undegraded":"2024-05-16T21:32:22.947319+0000","last_fullsized":"2024-05-16T21:32:22.947319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:47.220802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205655+0000","last_change":"2024-05-16T21:32:21.956288+0000","last_active":"2024-05-16T21:32:23.205655+0000","last_peered":"2024-05-16T21:32:23.205655+0000","last_clean":"2024-05-16T21:32:23.205655+0000","last_became_active":"2024-05-16T21:32:21.955765+0000","last_became_peered":"2024-05-16T21:32:21.955765+0000","last_unstale":"2024-05-16T21:32:23.205655+0000","last_undegraded":"2024-05-16T21:32:23.205655+0000","last_fullsized":"2024-05-16T21:32:23.205655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:01:44.861353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949002+0000","last_change":"2024-05-16T21:32:20.959535+0000","last_active":"2024-05-16T21:32:22.949002+0000","last_peered":"2024-05-16T21:32:22.949002+0000","last_clean":"2024-05-16T21:32:22.949002+0000","last_became_active":"2024-05-16T21:32:20.959011+0000","last_became_peered":"2024-05-16T21:32:20.959011+0000","last_unstale":"2024-05-16T21:32:22.949002+0000","last_undegraded":"2024-05-16T21:32:22.949002+0000","last_fullsized":"2024-05-16T21:32:22.949002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:42:41.954599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952283+0000","last_change":"2024-05-16T21:32:21.970736+0000","last_active":"2024-05-16T21:32:22.952283+0000","last_peered":"2024-05-16T21:32:22.952283+0000","last_clean":"2024-05-16T21:32:22.952283+0000","last_became_active":"2024-05-16T21:32:21.970296+0000","last_became_peered":"2024-05-16T21:32:21.970296+0000","last_unstale":"2024-05-16T21:32:22.952283+0000","last_undegraded":"2024-05-16T21:32:22.952283+0000","last_fullsized":"2024-05-16T21:32:22.952283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205253+0000","last_change":"2024-05-16T21:32:21.975252+0000","last_active":"2024-05-16T21:32:23.205253+0000","last_peered":"2024-05-16T21:32:23.205253+0000","last_clean":"2024-05-16T21:32:23.205253+0000","last_became_active":"2024-05-16T21:32:21.974676+0000","last_became_peered":"2024-05-16T21:32:21.974676+0000","last_unstale":"2024-05-16T21:32:23.205253+0000","last_undegraded":"2024-05-16T21:32:23.205253+0000","last_fullsized":"2024-05-16T21:32:23.205253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:41:08.428677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949848+0000","last_change":"2024-05-16T21:32:20.962780+0000","last_active":"2024-05-16T21:32:22.949848+0000","last_peered":"2024-05-16T21:32:22.949848+0000","last_clean":"2024-05-16T21:32:22.949848+0000","last_became_active":"2024-05-16T21:32:20.962322+0000","last_became_peered":"2024-05-16T21:32:20.962322+0000","last_unstale":"2024-05-16T21:32:22.949848+0000","last_undegraded":"2024-05-16T21:32:22.949848+0000","last_fullsized":"2024-05-16T21:32:22.949848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:53:43.525691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204971+0000","last_change":"2024-05-16T21:32:21.980984+0000","last_active":"2024-05-16T21:32:23.204971+0000","last_peered":"2024-05-16T21:32:23.204971+0000","last_clean":"2024-05-16T21:32:23.204971+0000","last_became_active":"2024-05-16T21:32:21.980660+0000","last_became_peered":"2024-05-16T21:32:21.980660+0000","last_unstale":"2024-05-16T21:32:23.204971+0000","last_undegraded":"2024-05-16T21:32:23.204971+0000","last_fullsized":"2024-05-16T21:32:23.204971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:15.421446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949920+0000","last_change":"2024-05-16T21:32:20.961620+0000","last_active":"2024-05-16T21:32:22.949920+0000","last_peered":"2024-05-16T21:32:22.949920+0000","last_clean":"2024-05-16T21:32:22.949920+0000","last_became_active":"2024-05-16T21:32:20.960591+0000","last_became_peered":"2024-05-16T21:32:20.960591+0000","last_unstale":"2024-05-16T21:32:22.949920+0000","last_undegraded":"2024-05-16T21:32:22.949920+0000","last_fullsized":"2024-05-16T21:32:22.949920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:05:47.168701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205068+0000","last_change":"2024-05-16T21:32:21.967631+0000","last_active":"2024-05-16T21:32:23.205068+0000","last_peered":"2024-05-16T21:32:23.205068+0000","last_clean":"2024-05-16T21:32:23.205068+0000","last_became_active":"2024-05-16T21:32:21.967230+0000","last_became_peered":"2024-05-16T21:32:21.967230+0000","last_unstale":"2024-05-16T21:32:23.205068+0000","last_undegraded":"2024-05-16T21:32:23.205068+0000","last_fullsized":"2024-05-16T21:32:23.205068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:19:22.267338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205795+0000","last_change":"2024-05-16T21:32:20.968463+0000","last_active":"2024-05-16T21:32:23.205795+0000","last_peered":"2024-05-16T21:32:23.205795+0000","last_clean":"2024-05-16T21:32:23.205795+0000","last_became_active":"2024-05-16T21:32:20.967280+0000","last_became_peered":"2024-05-16T21:32:20.967280+0000","last_unstale":"2024-05-16T21:32:23.205795+0000","last_undegraded":"2024-05-16T21:32:23.205795+0000","last_fullsized":"2024-05-16T21:32:23.205795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205674+0000","last_change":"2024-05-16T21:32:21.963511+0000","last_active":"2024-05-16T21:32:23.205674+0000","last_peered":"2024-05-16T21:32:23.205674+0000","last_clean":"2024-05-16T21:32:23.205674+0000","last_became_active":"2024-05-16T21:32:21.963215+0000","last_became_peered":"2024-05-16T21:32:21.963215+0000","last_unstale":"2024-05-16T21:32:23.205674+0000","last_undegraded":"2024-05-16T21:32:23.205674+0000","last_fullsized":"2024-05-16T21:32:23.205674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205197+0000","last_change":"2024-05-16T21:32:20.954854+0000","last_active":"2024-05-16T21:32:23.205197+0000","last_peered":"2024-05-16T21:32:23.205197+0000","last_clean":"2024-05-16T21:32:23.205197+0000","last_became_active":"2024-05-16T21:32:20.954461+0000","last_became_peered":"2024-05-16T21:32:20.954461+0000","last_unstale":"2024-05-16T21:32:23.205197+0000","last_undegraded":"2024-05-16T21:32:23.205197+0000","last_fullsized":"2024-05-16T21:32:23.205197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:17:50.700469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T21:32:26.411 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T21:32:26.411 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-16T21:32:26.411 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-16T21:32:26.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-16T21:32:26.412 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-16T21:32:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.556+0000 7f1ec8794640 1 Processor -- start 2024-05-16T21:32:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.556+0000 7f1ec8794640 1 -- start start 2024-05-16T21:32:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.557+0000 7f1ec8794640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1ec0151fc0 0x7f1ec00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.557+0000 7f1ec8794640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec006da30 0x7f1ec00be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec8794640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec00c36f0 con 0x7f1ec006de40 2024-05-16T21:32:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec8794640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec00bdc10 con 0x7f1ec0151fc0 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec8794640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec0152530 con 0x7f1ec006da30 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec6d31640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ec006de40 0x7f1ec014e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38628/0 (socket says 172.21.15.5:38628) 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec6d31640 1 -- 172.21.15.5:0/937253252 learned_addr learned my addr 172.21.15.5:0/937253252 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec6530640 1 --2- 172.21.15.5:0/937253252 >> v2:172.21.15.157:3300/0 conn(0x7f1ec0151fc0 0x7f1ec00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230608131 0 0) 0x7f1ec00c36f0 con 0x7f1ec006de40 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec5d2f640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec006da30 0x7f1ec00be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ea8003520 con 0x7f1ec006de40 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 44790395 0 0) 0x7f1ea8003520 con 0x7f1ec006de40 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec006da30 msgr2=0x7f1ec00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec006da30 0x7f1ec00be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 >> v2:172.21.15.157:3300/0 conn(0x7f1ec0151fc0 msgr2=0x7f1ec00bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 --2- 172.21.15.5:0/937253252 >> v2:172.21.15.157:3300/0 conn(0x7f1ec0151fc0 0x7f1ec00bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec0152810 con 0x7f1ec006de40 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f1eb80016f0 con 0x7f1ec006de40 2024-05-16T21:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 >> v1:172.21.15.5:6789/0 conn(0x7f1ec006de40 legacy=0x7f1ec014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea8003a00 0x7f1ea8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8004800 0x7f1ea8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec006da30 0x7f1ea8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec00bdc10 con 0x7f1ea8003a00 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0152530 con 0x7f1ea8004800 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea800baa0 con 0x7f1ec006da30 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.558+0000 7f1ec6530640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea8003a00 0x7f1ea8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.559+0000 7f1ec5d2f640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8004800 0x7f1ea8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.559+0000 7f1ec6d31640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec006da30 0x7f1ea8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.559+0000 7f1ec6530640 1 -- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec006da30 msgr2=0x7f1ea8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.559+0000 7f1ec6530640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec006da30 0x7f1ea8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.559+0000 7f1ec6530640 1 -- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8004800 msgr2=0x7f1ea8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.559+0000 7f1ec6530640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8004800 0x7f1ea8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.559+0000 7f1ec6530640 1 -- 172.21.15.5:0/937253252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea8003520 con 0x7f1ea8003a00 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.559+0000 7f1ec6530640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea8003a00 0x7f1ea8003e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009fc0 tx=0x7f1ea8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ef3178bb76aa36 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0009c10 con 0x7f1ea8003a00 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb0036070 con 0x7f1ea8003a00 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec552e640 1 -- 172.21.15.5:0/937253252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb002d070 con 0x7f1ea8003a00 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec8794640 1 -- 172.21.15.5:0/937253252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea8003a00 msgr2=0x7f1ea8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec8794640 1 --2- 172.21.15.5:0/937253252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea8003a00 0x7f1ea8003e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009fc0 tx=0x7f1ea8005830 comp rx=0 tx=0).stop 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec6d31640 1 -- 172.21.15.5:0/937253252 reap_dead start 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec8794640 1 -- 172.21.15.5:0/937253252 shutdown_connections 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec8794640 1 -- 172.21.15.5:0/937253252 >> 172.21.15.5:0/937253252 conn(0x7f1ec00c3d20 msgr2=0x7f1ec00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec8794640 1 -- 172.21.15.5:0/937253252 shutdown_connections 2024-05-16T21:32:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.560+0000 7f1ec8794640 1 -- 172.21.15.5:0/937253252 wait complete. 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.562+0000 7f1ec8794640 1 Processor -- start 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.562+0000 7f1ec8794640 1 -- start start 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec8794640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8003a00 0x7f1ec00b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec8794640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec01e7de0 0x7f1ec00b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec8794640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec014b4d0 0x7f1ec014b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec8794640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec00a3050 con 0x7f1ec01e7de0 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec8794640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec00a2ed0 con 0x7f1ea8003a00 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec8794640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec014ec80 con 0x7f1ec014b4d0 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec5d2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec01e7de0 0x7f1ec00b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec5d2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec01e7de0 0x7f1ec00b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47658/0 (socket says 172.21.15.5:47658) 2024-05-16T21:32:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec5d2f640 1 -- 172.21.15.5:0/309547155 learned_addr learned my addr 172.21.15.5:0/309547155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec5d2f640 1 -- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec014b4d0 msgr2=0x7f1ec014b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec6d31640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec014b4d0 0x7f1ec014b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec6530640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8003a00 0x7f1ec00b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec5d2f640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec014b4d0 0x7f1ec014b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec5d2f640 1 -- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8003a00 msgr2=0x7f1ec00b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec5d2f640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8003a00 0x7f1ec00b8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.563+0000 7f1ec5d2f640 1 -- 172.21.15.5:0/309547155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec00b8ad0 con 0x7f1ec01e7de0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.564+0000 7f1ec5d2f640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec01e7de0 0x7f1ec00b9260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40119a0 tx=0x7f1eb4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.564+0000 7f1ebeffd640 1 -- 172.21.15.5:0/309547155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400faf0 con 0x7f1ec01e7de0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.564+0000 7f1ebeffd640 1 -- 172.21.15.5:0/309547155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb400fc90 con 0x7f1ec01e7de0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.564+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec00b97a0 con 0x7f1ec01e7de0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.564+0000 7f1ebeffd640 1 -- 172.21.15.5:0/309547155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4014440 con 0x7f1ec01e7de0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.564+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec01d9eb0 con 0x7f1ec01e7de0 2024-05-16T21:32:26.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.565+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec01d91e0 con 0x7f1ec01e7de0 2024-05-16T21:32:26.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.566+0000 7f1ebeffd640 1 -- 172.21.15.5:0/309547155 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1eb4012040 con 0x7f1ec01e7de0 2024-05-16T21:32:26.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.566+0000 7f1ebeffd640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eac0762d0 0x7f1eac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.566+0000 7f1ebeffd640 1 -- 172.21.15.5:0/309547155 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1eb4097c10 con 0x7f1ec01e7de0 2024-05-16T21:32:26.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.567+0000 7f1ec6530640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eac0762d0 0x7f1eac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.567+0000 7f1ec6530640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eac0762d0 0x7f1eac0787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0035000 tx=0x7f1eb002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.571+0000 7f1ebeffd640 1 -- 172.21.15.5:0/309547155 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1eb4019030 con 0x7f1ec01e7de0 2024-05-16T21:32:26.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.811+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1ec0050940 con 0x7f1ec01e7de0 2024-05-16T21:32:26.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.814+0000 7f1ebeffd640 1 -- 172.21.15.5:0/309547155 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189522 (secure 0 0 0) 0x7f1eb4061600 con 0x7f1ec01e7de0 2024-05-16T21:32:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eac0762d0 msgr2=0x7f1eac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eac0762d0 0x7f1eac0787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0035000 tx=0x7f1eb002f000 comp rx=0 tx=0).stop 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec01e7de0 msgr2=0x7f1ec00b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec01e7de0 0x7f1ec00b9260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40119a0 tx=0x7f1eb4011e60 comp rx=0 tx=0).stop 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 shutdown_connections 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eac0762d0 0x7f1eac0787e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ec014b4d0 0x7f1ec014b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec01e7de0 0x7f1ec00b9260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 --2- 172.21.15.5:0/309547155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ea8003a00 0x7f1ec00b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 >> 172.21.15.5:0/309547155 conn(0x7f1ec00c3d20 msgr2=0x7f1ec00a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:26.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 shutdown_connections 2024-05-16T21:32:26.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.817+0000 7f1ec8794640 1 -- 172.21.15.5:0/309547155 wait complete. 2024-05-16T21:32:26.830 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":37216281},{"type":"v1","addr":"172.21.15.157:6833","nonce":37216281}]},"active_addr":"172.21.15.157:6833/37216281","active_change":"2024-05-16T21:32:02.353285+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":1622385589}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":2508259188}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":2815370065}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":2921597904}]}]} 2024-05-16T21:32:26.833 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-16T21:32:26.833 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-16T21:32:26.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:26.933 INFO:tasks.ceph.mds.b.smithi157.stderr:2024-05-16T21:32:26.932+0000 7f9867278640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T21:32:26.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.942+0000 7f28a4abd640 1 Processor -- start 2024-05-16T21:32:26.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.942+0000 7f28a4abd640 1 -- start start 2024-05-16T21:32:26.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.943+0000 7f28a4abd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f28a0151fc0 0x7f28a00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f28a4abd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28a006da30 0x7f28a00be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f28a4abd640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a00c36f0 con 0x7f28a006de40 2024-05-16T21:32:26.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f28a4abd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f28a00bdc10 con 0x7f28a006da30 2024-05-16T21:32:26.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f28a4abd640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f28a0152530 con 0x7f28a0151fc0 2024-05-16T21:32:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f289dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28a006da30 0x7f28a00be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f289dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28a006da30 0x7f28a00be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57406/0 (socket says 172.21.15.5:57406) 2024-05-16T21:32:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f289dd9b640 1 -- 172.21.15.5:0/2059618963 learned_addr learned my addr 172.21.15.5:0/2059618963 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f289e59c640 1 --2- 172.21.15.5:0/2059618963 >> v2:172.21.15.157:3300/0 conn(0x7f28a0151fc0 0x7f28a00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f289dd9b640 1 -- 172.21.15.5:0/2059618963 >> v2:172.21.15.157:3300/0 conn(0x7f28a0151fc0 msgr2=0x7f28a00bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f289dd9b640 1 --2- 172.21.15.5:0/2059618963 >> v2:172.21.15.157:3300/0 conn(0x7f28a0151fc0 0x7f28a00bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f289dd9b640 1 -- 172.21.15.5:0/2059618963 >> v1:172.21.15.157:6789/0 conn(0x7f28a006de40 legacy=0x7f28a014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.944+0000 7f289dd9b640 1 -- 172.21.15.5:0/2059618963 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a0152810 con 0x7f28a006da30 2024-05-16T21:32:26.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.945+0000 7f289dd9b640 1 --2- 172.21.15.5:0/2059618963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006da30 0x7f28a00be940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28a008d300 tx=0x7f288802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b02a260a805821 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.945+0000 7f289d59a640 1 -- 172.21.15.5:0/2059618963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888037070 con 0x7f28a006da30 2024-05-16T21:32:26.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.945+0000 7f289d59a640 1 -- 172.21.15.5:0/2059618963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2888032440 con 0x7f28a006da30 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.945+0000 7f289d59a640 1 -- 172.21.15.5:0/2059618963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888032810 con 0x7f28a006da30 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.946+0000 7f28a4abd640 1 -- 172.21.15.5:0/2059618963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006da30 msgr2=0x7f28a00be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.946+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2059618963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006da30 0x7f28a00be940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28a008d300 tx=0x7f288802a1e0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.946+0000 7f28a4abd640 1 -- 172.21.15.5:0/2059618963 shutdown_connections 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.946+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2059618963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006da30 0x7f28a00be940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.946+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2059618963 >> v2:172.21.15.157:3300/0 conn(0x7f28a0151fc0 0x7f28a00bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.946+0000 7f28a4abd640 1 -- 172.21.15.5:0/2059618963 >> 172.21.15.5:0/2059618963 conn(0x7f28a00c3d20 msgr2=0x7f28a00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.946+0000 7f28a4abd640 1 -- 172.21.15.5:0/2059618963 shutdown_connections 2024-05-16T21:32:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.946+0000 7f28a4abd640 1 -- 172.21.15.5:0/2059618963 wait complete. 2024-05-16T21:32:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.947+0000 7f28a4abd640 1 Processor -- start 2024-05-16T21:32:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.948+0000 7f28a4abd640 1 -- start start 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f28a4abd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28a006da30 0x7f28a00b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f28a4abd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006de40 0x7f28a01e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f28a4abd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28a0151fc0 0x7f28a01506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f28a4abd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f28a00a3050 con 0x7f28a006de40 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f28a4abd640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f28a00a2ed0 con 0x7f28a0151fc0 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f28a4abd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f28a00bee80 con 0x7f28a006da30 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006de40 0x7f28a01e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006de40 0x7f28a01e4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57420/0 (socket says 172.21.15.5:57420) 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 -- 172.21.15.5:0/2963839261 learned_addr learned my addr 172.21.15.5:0/2963839261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289ed9d640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28a0151fc0 0x7f28a01506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289e59c640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28a006da30 0x7f28a00b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 -- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28a006da30 msgr2=0x7f28a00b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28a006da30 0x7f28a00b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 -- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28a0151fc0 msgr2=0x7f28a01506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28a0151fc0 0x7f28a01506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 -- 172.21.15.5:0/2963839261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a00b9390 con 0x7f28a006de40 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f289dd9b640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006de40 0x7f28a01e4620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f288802a220 tx=0x7f28880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f2896ffd640 1 -- 172.21.15.5:0/2963839261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888041020 con 0x7f28a006de40 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f2896ffd640 1 -- 172.21.15.5:0/2963839261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28880306c0 con 0x7f28a006de40 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a01e4b60 con 0x7f28a006de40 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f2896ffd640 1 -- 172.21.15.5:0/2963839261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888037040 con 0x7f28a006de40 2024-05-16T21:32:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.949+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a00b7770 con 0x7f28a006de40 2024-05-16T21:32:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.951+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a00b85b0 con 0x7f28a006de40 2024-05-16T21:32:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.951+0000 7f2896ffd640 1 -- 172.21.15.5:0/2963839261 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2888044020 con 0x7f28a006de40 2024-05-16T21:32:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.952+0000 7f2896ffd640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f28800762d0 0x7f28800787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.952+0000 7f2896ffd640 1 -- 172.21.15.5:0/2963839261 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f28880b7f40 con 0x7f28a006de40 2024-05-16T21:32:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.952+0000 7f289e59c640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f28800762d0 0x7f28800787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:26.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.953+0000 7f289e59c640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f28800762d0 0x7f28800787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2898006fd0 tx=0x7f2898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:26.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:26.956+0000 7f2896ffd640 1 -- 172.21.15.5:0/2963839261 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f28a00b85b0 con 0x7f28a006de40 2024-05-16T21:32:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.147+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28a006eb40 con 0x7f28a006de40 2024-05-16T21:32:27.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.148+0000 7f2896ffd640 1 -- 172.21.15.5:0/2963839261 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f288804b030 con 0x7f28a006de40 2024-05-16T21:32:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:27.150 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:22.944103+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f28800762d0 msgr2=0x7f28800787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f28800762d0 0x7f28800787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2898006fd0 tx=0x7f2898008040 comp rx=0 tx=0).stop 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006de40 msgr2=0x7f28a01e4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006de40 0x7f28a01e4620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f288802a220 tx=0x7f28880046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 shutdown_connections 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f28800762d0 0x7f28800787e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28a0151fc0 0x7f28a01506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a006de40 0x7f28a01e4620 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 --2- 172.21.15.5:0/2963839261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28a006da30 0x7f28a00b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 >> 172.21.15.5:0/2963839261 conn(0x7f28a00c3d20 msgr2=0x7f28a00a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 shutdown_connections 2024-05-16T21:32:27.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.150+0000 7f28a4abd640 1 -- 172.21.15.5:0/2963839261 wait complete. 2024-05-16T21:32:27.165 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-16T21:32:27.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:27.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.275+0000 7f688f627640 1 Processor -- start 2024-05-16T21:32:27.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.275+0000 7f688f627640 1 -- start start 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.276+0000 7f688f627640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6888151fc0 0x7f68880bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.276+0000 7f688f627640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68880c36f0 con 0x7f68880bf050 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.276+0000 7f688f627640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6888152530 con 0x7f688806da30 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.276+0000 7f688f627640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f68880bdc10 con 0x7f6888151fc0 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.277+0000 7f688d3c3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6888151fc0 0x7f68880bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.277+0000 7f688d3c3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6888151fc0 0x7f68880bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57434/0 (socket says 172.21.15.5:57434) 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.277+0000 7f688dbc4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68880bf050 0x7f6888158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34884/0 (socket says 172.21.15.5:34884) 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.277+0000 7f688d3c3640 1 -- 172.21.15.5:0/3004277767 learned_addr learned my addr 172.21.15.5:0/3004277767 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.277+0000 7f688d3c3640 1 -- 172.21.15.5:0/3004277767 >> v1:172.21.15.157:6789/0 conn(0x7f688806da30 legacy=0x7f68880be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.277+0000 7f688d3c3640 1 -- 172.21.15.5:0/3004277767 >> v1:172.21.15.5:6789/0 conn(0x7f68880bf050 legacy=0x7f6888158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.277+0000 7f688d3c3640 1 -- 172.21.15.5:0/3004277767 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888152810 con 0x7f6888151fc0 2024-05-16T21:32:27.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.277+0000 7f6887fff640 1 -- 172.21.15.5:0/3004277767 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605390677 0 0) 0x7f68880c36f0 con 0x7f68880bf050 2024-05-16T21:32:27.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f688d3c3640 1 --2- 172.21.15.5:0/3004277767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6888151fc0 0x7f68880bd6d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6880009870 tx=0x7f688002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8a7932e80f81fd server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f6887fff640 1 -- 172.21.15.5:0/3004277767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880037070 con 0x7f6888151fc0 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f6887fff640 1 -- 172.21.15.5:0/3004277767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6880032440 con 0x7f6888151fc0 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f6887fff640 1 -- 172.21.15.5:0/3004277767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880032810 con 0x7f6888151fc0 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f688f627640 1 -- 172.21.15.5:0/3004277767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6888151fc0 msgr2=0x7f68880bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f688f627640 1 --2- 172.21.15.5:0/3004277767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6888151fc0 0x7f68880bd6d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6880009870 tx=0x7f688002a270 comp rx=0 tx=0).stop 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f688f627640 1 -- 172.21.15.5:0/3004277767 shutdown_connections 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f688f627640 1 --2- 172.21.15.5:0/3004277767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6888151fc0 0x7f68880bd6d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.278+0000 7f688f627640 1 -- 172.21.15.5:0/3004277767 >> 172.21.15.5:0/3004277767 conn(0x7f68880c3d20 msgr2=0x7f68880c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.279+0000 7f688f627640 1 -- 172.21.15.5:0/3004277767 shutdown_connections 2024-05-16T21:32:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.279+0000 7f688f627640 1 -- 172.21.15.5:0/3004277767 wait complete. 2024-05-16T21:32:27.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.280+0000 7f688f627640 1 Processor -- start 2024-05-16T21:32:27.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.280+0000 7f688f627640 1 -- start start 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688f627640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688806da30 0x7f68881e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688f627640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880bf050 0x7f68880b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688f627640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6888151fc0 0x7f688814b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688f627640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f68880a3050 con 0x7f68880bf050 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688f627640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f68880a2ed0 con 0x7f688806da30 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688f627640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f688806de40 con 0x7f6888151fc0 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688cbc2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880bf050 0x7f68880b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688cbc2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880bf050 0x7f68880b86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57444/0 (socket says 172.21.15.5:57444) 2024-05-16T21:32:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688cbc2640 1 -- 172.21.15.5:0/3834871978 learned_addr learned my addr 172.21.15.5:0/3834871978 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688d3c3640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688806da30 0x7f68881e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.281+0000 7f688dbc4640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6888151fc0 0x7f688814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688cbc2640 1 -- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6888151fc0 msgr2=0x7f688814b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688cbc2640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6888151fc0 0x7f688814b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688cbc2640 1 -- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688806da30 msgr2=0x7f68881e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688cbc2640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688806da30 0x7f68881e7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688cbc2640 1 -- 172.21.15.5:0/3834871978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68880b8bf0 con 0x7f68880bf050 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688d3c3640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688806da30 0x7f68881e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688dbc4640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6888151fc0 0x7f688814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688cbc2640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880bf050 0x7f68880b86b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f687c00b3e0 tx=0x7f687c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f6885ffb640 1 -- 172.21.15.5:0/3834871978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c015020 con 0x7f68880bf050 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f6885ffb640 1 -- 172.21.15.5:0/3834871978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c011830 con 0x7f68880bf050 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f6885ffb640 1 -- 172.21.15.5:0/3834871978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c011c20 con 0x7f68880bf050 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68880ba2b0 con 0x7f68880bf050 2024-05-16T21:32:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.282+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68880b9b50 con 0x7f68880bf050 2024-05-16T21:32:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.283+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68880c10e0 con 0x7f68880bf050 2024-05-16T21:32:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.284+0000 7f6885ffb640 1 -- 172.21.15.5:0/3834871978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f687c018020 con 0x7f68880bf050 2024-05-16T21:32:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.284+0000 7f6885ffb640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f68740762d0 0x7f68740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.284+0000 7f6885ffb640 1 -- 172.21.15.5:0/3834871978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f687c0974f0 con 0x7f68880bf050 2024-05-16T21:32:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.284+0000 7f688d3c3640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f68740762d0 0x7f68740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.285+0000 7f688d3c3640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f68740762d0 0x7f68740787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6880034000 tx=0x7f688002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.289+0000 7f6885ffb640 1 -- 172.21.15.5:0/3834871978 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f68880c10e0 con 0x7f68880bf050 2024-05-16T21:32:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.482+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6888050940 con 0x7f68880bf050 2024-05-16T21:32:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.483+0000 7f6885ffb640 1 -- 172.21.15.5:0/3834871978 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f687c01f020 con 0x7f68880bf050 2024-05-16T21:32:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:27.485 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:22.944103+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f68740762d0 msgr2=0x7f68740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f68740762d0 0x7f68740787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6880034000 tx=0x7f688002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880bf050 msgr2=0x7f68880b86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880bf050 0x7f68880b86b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f687c00b3e0 tx=0x7f687c00b8a0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 shutdown_connections 2024-05-16T21:32:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f68740762d0 0x7f68740787e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6888151fc0 0x7f688814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880bf050 0x7f68880b86b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 --2- 172.21.15.5:0/3834871978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688806da30 0x7f68881e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 >> 172.21.15.5:0/3834871978 conn(0x7f68880c3d20 msgr2=0x7f68880c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 shutdown_connections 2024-05-16T21:32:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.485+0000 7f688f627640 1 -- 172.21.15.5:0/3834871978 wait complete. 2024-05-16T21:32:27.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-16T21:32:27.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-16T21:32:27.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-16T21:32:27.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-16T21:32:27.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-16T21:32:27.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-16T21:32:27.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-16T21:32:27.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-16T21:32:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.726+0000 7ffa1da64640 1 Processor -- start 2024-05-16T21:32:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.726+0000 7fe4772e5640 1 Processor -- start 2024-05-16T21:32:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.726+0000 7fe4772e5640 1 -- start start 2024-05-16T21:32:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.726+0000 7f2107173640 1 Processor -- start 2024-05-16T21:32:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.726+0000 7f42cf046640 1 Processor -- start 2024-05-16T21:32:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7fb13ad9d640 1 Processor -- start 2024-05-16T21:32:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.726+0000 7ffa1da64640 1 -- start start 2024-05-16T21:32:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7fb13ad9d640 1 -- start start 2024-05-16T21:32:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7f2107173640 1 -- start start 2024-05-16T21:32:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.726+0000 7f0935db4640 1 Processor -- start 2024-05-16T21:32:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7f0935db4640 1 -- start start 2024-05-16T21:32:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7f8940933640 1 Processor -- start 2024-05-16T21:32:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7f8940933640 1 -- start start 2024-05-16T21:32:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fb13ad9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb134007080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fb13ad9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb1340d52c0 0x7fb1340d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fb13a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb134007080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.728+0000 7f0935db4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0930070300 0x7f0930147a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f092f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0930070300 0x7f0930147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f092f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0930070300 0x7f0930147a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57458/0 (socket says 172.21.15.5:57458) 2024-05-16T21:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f092f7fe640 1 -- 172.21.15.5:0/36133103 learned_addr learned my addr 172.21.15.5:0/36133103 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f0935db4640 1 --2- 172.21.15.5:0/36133103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300bb6f0 0x7f09300ba710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7f42cf046640 1 -- start start 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f42cf046640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42c003abe0 0x7f42c00d90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f42cf046640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c003cb30 0x7f42c003a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.728+0000 7ffa1da64640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa1003ea10 0x7ffa100d65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.728+0000 7ffa1da64640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffa1003cf50 0x7ffa100cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.728+0000 7ffa1da64640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1003c600 con 0x7ffa1003adb0 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.728+0000 7ffa1da64640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ffa100d01d0 con 0x7ffa1003ea10 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.728+0000 7ffa1da64640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ffa100d6110 con 0x7ffa1003cf50 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa1d263640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ffa1003adb0 0x7ffa1003b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:40944/0 (socket says 172.21.15.5:40944) 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa1d263640 1 -- 172.21.15.5:0/3590569148 learned_addr learned my addr 172.21.15.5:0/3590569148 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa17fff640 1 --2- 172.21.15.5:0/3590569148 >> v2:172.21.15.157:3300/0 conn(0x7ffa1003cf50 0x7ffa100cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa17fff640 1 -- 172.21.15.5:0/3590569148 >> v2:172.21.15.5:3300/0 conn(0x7ffa1003ea10 msgr2=0x7ffa100d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa177fe640 1 -- 172.21.15.5:0/3590569148 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578077030 0 0) 0x7ffa1003c600 con 0x7ffa1003adb0 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.728+0000 7fe4772e5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe468008ba0 0x7fe468041a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fe475ae2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe468008ba0 0x7fe468041a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fe4762e3640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe468008490 0x7fe4680d5b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:40958/0 (socket says 172.21.15.5:40958) 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fe475ae2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe468008ba0 0x7fe468041a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40766/0 (socket says 172.21.15.5:40766) 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fe4762e3640 1 -- 172.21.15.5:0/3997849538 learned_addr learned my addr 172.21.15.5:0/3997849538 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fe4772e5640 1 -- 172.21.15.5:0/3997849538 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe468009580 con 0x7fe4680cf8c0 2024-05-16T21:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fe4772e5640 1 -- 172.21.15.5:0/3997849538 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe468009860 con 0x7fe468008490 2024-05-16T21:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f2107173640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f210009eb80 0x7f21000b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f2107173640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21000b4380 0x7f2100074290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f2107173640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210006fda0 con 0x7f21001527c0 2024-05-16T21:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f2107173640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f21000b57c0 con 0x7f21000b4380 2024-05-16T21:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f2107173640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f21000b5200 con 0x7f210009eb80 2024-05-16T21:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7fb99ac34640 1 Processor -- start 2024-05-16T21:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fb139d9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb1340d52c0 0x7fb1340d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fb139d9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb1340d52c0 0x7fb1340d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40774/0 (socket says 172.21.15.5:40774) 2024-05-16T21:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f092effd640 1 --2- 172.21.15.5:0/36133103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300bb6f0 0x7f09300ba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa1ca62640 1 --2- 172.21.15.5:0/3590569148 >> v2:172.21.15.5:3300/0 conn(0x7ffa1003ea10 0x7ffa100d65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f8940933640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f893403c820 0x7f8934040bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fe4772e5640 1 -- 172.21.15.5:0/3997849538 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe468008fb0 con 0x7fe468008ba0 2024-05-16T21:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fb13a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb134007080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:50992/0 (socket says 172.21.15.5:50992) 2024-05-16T21:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f0935db4640 1 -- 172.21.15.5:0/36133103 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09300b5c60 con 0x7f09300a0dc0 2024-05-16T21:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f0935db4640 1 -- 172.21.15.5:0/36133103 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f09300bce00 con 0x7f0930070300 2024-05-16T21:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f0935db4640 1 -- 172.21.15.5:0/36133103 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f09300b62b0 con 0x7f09300bb6f0 2024-05-16T21:32:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fb139d9b640 1 -- 172.21.15.5:0/4082496061 learned_addr learned my addr 172.21.15.5:0/4082496061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7fb13ad9d640 1 -- 172.21.15.5:0/4082496061 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1340d4b00 con 0x7fb1340d2250 2024-05-16T21:32:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f8940933640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f89340cf680 0x7f89340cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb13ad9d640 1 -- 172.21.15.5:0/4082496061 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb1340075c0 con 0x7fb1340d52c0 2024-05-16T21:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f893ad9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f893403c820 0x7f8934040bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb13ad9d640 1 -- 172.21.15.5:0/4082496061 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb134007860 con 0x7fb13403b650 2024-05-16T21:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.727+0000 7fb99ac34640 1 -- start start 2024-05-16T21:32:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f893ad9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f893403c820 0x7f8934040bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:50996/0 (socket says 172.21.15.5:50996) 2024-05-16T21:32:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb99ac34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb99409eb80 0x7fb9940b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb99ac34640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9940b4380 0x7fb994074290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f893ad9d640 1 -- 172.21.15.5:0/1112622381 learned_addr learned my addr 172.21.15.5:0/1112622381 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fe475ae2640 1 -- 172.21.15.5:0/3997849538 >> v1:172.21.15.157:6789/0 conn(0x7fe468008490 legacy=0x7fe4680d5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fe475ae2640 1 -- 172.21.15.5:0/3997849538 >> v1:172.21.15.5:6789/0 conn(0x7fe4680cf8c0 legacy=0x7fe4680e0460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T21:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f8940933640 1 -- 172.21.15.5:0/1112622381 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893403d240 con 0x7f8934041ca0 2024-05-16T21:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f8940933640 1 -- 172.21.15.5:0/1112622381 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f893403cff0 con 0x7f89340cf680 2024-05-16T21:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f8940933640 1 -- 172.21.15.5:0/1112622381 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f893403e760 con 0x7f893403c820 2024-05-16T21:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f2106972640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f21001527c0 0x7f210006f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:40968/0 (socket says 172.21.15.5:40968) 2024-05-16T21:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f2106972640 1 -- 172.21.15.5:0/1748028983 learned_addr learned my addr 172.21.15.5:0/1748028983 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7f2105970640 1 --2- 172.21.15.5:0/1748028983 >> v2:172.21.15.5:3300/0 conn(0x7f21000b4380 0x7f2100074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb99ac34640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99406fda0 con 0x7fb9941527c0 2024-05-16T21:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb99ac34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb9940b57c0 con 0x7fb99409eb80 2024-05-16T21:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb99ac34640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb9940b5200 con 0x7fb9940b4380 2024-05-16T21:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb999c32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb99409eb80 0x7fb9940b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb999c32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb99409eb80 0x7fb9940b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57502/0 (socket says 172.21.15.5:57502) 2024-05-16T21:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb999c32640 1 -- 172.21.15.5:0/3371521445 learned_addr learned my addr 172.21.15.5:0/3371521445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb999431640 1 --2- 172.21.15.5:0/3371521445 >> v2:172.21.15.157:3300/0 conn(0x7fb9940b4380 0x7fb994074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb139d9b640 1 -- 172.21.15.5:0/4082496061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 msgr2=0x7fb134007080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f893b59e640 1 --2- 172.21.15.5:0/1112622381 >> v2:172.21.15.157:3300/0 conn(0x7f89340cf680 0x7f89340cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb139d9b640 1 --2- 172.21.15.5:0/4082496061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb134007080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb139d9b640 1 -- 172.21.15.5:0/4082496061 >> v1:172.21.15.5:6789/0 conn(0x7fb1340d2250 legacy=0x7fb13403e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa17fff640 1 --2- 172.21.15.5:0/3590569148 >> v2:172.21.15.5:3300/0 conn(0x7ffa1003ea10 0x7ffa100d65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fb139d9b640 1 -- 172.21.15.5:0/4082496061 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb134007b40 con 0x7fb1340d52c0 2024-05-16T21:32:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f092f7fe640 1 -- 172.21.15.5:0/36133103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300bb6f0 msgr2=0x7f09300ba710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f092f7fe640 1 --2- 172.21.15.5:0/36133103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300bb6f0 0x7f09300ba710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f092f7fe640 1 -- 172.21.15.5:0/36133103 >> v1:172.21.15.157:6789/0 conn(0x7f09300a0dc0 legacy=0x7f09300bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f092f7fe640 1 -- 172.21.15.5:0/36133103 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09300b45a0 con 0x7f0930070300 2024-05-16T21:32:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f42cd843640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c003cb30 0x7f42c003a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f42cd843640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c003cb30 0x7f42c003a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51024/0 (socket says 172.21.15.5:51024) 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f42ce845640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f42c00072f0 0x7f42c00cfa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:40988/0 (socket says 172.21.15.5:40988) 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f42cd843640 1 -- 172.21.15.5:0/636721096 learned_addr learned my addr 172.21.15.5:0/636721096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f42cf046640 1 -- 172.21.15.5:0/636721096 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c0039750 con 0x7f42c00072f0 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f42cf046640 1 -- 172.21.15.5:0/636721096 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f42c003b860 con 0x7f42c003abe0 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f42cf046640 1 -- 172.21.15.5:0/636721096 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f42c0039ec0 con 0x7f42c003cb30 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f42ce044640 1 --2- 172.21.15.5:0/636721096 >> v2:172.21.15.5:3300/0 conn(0x7f42c003abe0 0x7f42c00d90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa17fff640 1 -- 172.21.15.5:0/3590569148 >> v1:172.21.15.157:6789/0 conn(0x7ffa1003adb0 legacy=0x7ffa1003b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.729+0000 7ffa17fff640 1 -- 172.21.15.5:0/3590569148 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1003d360 con 0x7ffa1003cf50 2024-05-16T21:32:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7ffa17fff640 1 --2- 172.21.15.5:0/3590569148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa1003cf50 0x7ffa100cfc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa1003cb40 tx=0x7ffa0c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80cd84e8666d72b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7ffa1ca62640 1 --2- 172.21.15.5:0/3590569148 >> v2:172.21.15.5:3300/0 conn(0x7ffa1003ea10 0x7ffa100d65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f893ad9d640 1 -- 172.21.15.5:0/1112622381 >> v2:172.21.15.157:3300/0 conn(0x7f89340cf680 msgr2=0x7f89340cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f893ad9d640 1 --2- 172.21.15.5:0/1112622381 >> v2:172.21.15.157:3300/0 conn(0x7f89340cf680 0x7f89340cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f893ad9d640 1 -- 172.21.15.5:0/1112622381 >> v1:172.21.15.5:6789/0 conn(0x7f8934041ca0 legacy=0x7f89340c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f893ad9d640 1 -- 172.21.15.5:0/1112622381 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893403d520 con 0x7f893403c820 2024-05-16T21:32:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7fe475ae2640 1 -- 172.21.15.5:0/3997849538 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe468007f70 con 0x7fe468008ba0 2024-05-16T21:32:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807462997 0 0) 0x7f20fc001110 con 0x7f21001527c0 2024-05-16T21:32:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.730+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20ec003520 con 0x7f21001527c0 2024-05-16T21:32:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7fb999c32640 1 -- 172.21.15.5:0/3371521445 >> v2:172.21.15.157:3300/0 conn(0x7fb9940b4380 msgr2=0x7fb994074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7fb999c32640 1 --2- 172.21.15.5:0/3371521445 >> v2:172.21.15.157:3300/0 conn(0x7fb9940b4380 0x7fb994074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7fb999c32640 1 -- 172.21.15.5:0/3371521445 >> v1:172.21.15.157:6789/0 conn(0x7fb9941527c0 legacy=0x7fb99406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7fb999c32640 1 -- 172.21.15.5:0/3371521445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9940b54e0 con 0x7fb99409eb80 2024-05-16T21:32:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f2106171640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f210009eb80 0x7f21000b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f092f7fe640 1 --2- 172.21.15.5:0/36133103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0930070300 0x7f0930147a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0920009870 tx=0x7f092002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9078bc1f8b2cdf57 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7fe475ae2640 1 --2- 172.21.15.5:0/3997849538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008ba0 0x7fe468041a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009720 tx=0x7fe46c029f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeb63d1441f1a42e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7fe4752e1640 1 -- 172.21.15.5:0/3997849538 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c037070 con 0x7fe468008ba0 2024-05-16T21:32:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f092e7fc640 1 -- 172.21.15.5:0/36133103 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920037070 con 0x7f0930070300 2024-05-16T21:32:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f092e7fc640 1 -- 172.21.15.5:0/36133103 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0920032440 con 0x7f0930070300 2024-05-16T21:32:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f092e7fc640 1 -- 172.21.15.5:0/36133103 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09200327f0 con 0x7f0930070300 2024-05-16T21:32:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 15628901 0 0) 0x7f20ec003520 con 0x7f21001527c0 2024-05-16T21:32:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f210009eb80 msgr2=0x7f21000b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f210009eb80 0x7f21000b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 >> v2:172.21.15.5:3300/0 conn(0x7f21000b4380 msgr2=0x7f2100074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 --2- 172.21.15.5:0/1748028983 >> v2:172.21.15.5:3300/0 conn(0x7f21000b4380 0x7f2100074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21000b54e0 con 0x7f21001527c0 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f20fc0018a0 con 0x7f21001527c0 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 >> v1:172.21.15.157:6789/0 conn(0x7f21001527c0 legacy=0x7f210006f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ec003a10 0x7f20ec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec004800 0x7f20ec004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20ec005350 0x7f20ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f21000b57c0 con 0x7f20ec003a10 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f21000b5200 con 0x7f20ec005350 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f20ec00c2d0 con 0x7f20ec004800 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f2106171640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f210009eb80 0x7f21000b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2106972640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20ec005350 0x7f20ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7fe4752e1640 1 -- 172.21.15.5:0/3997849538 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46c02ac90 con 0x7fe468008ba0 2024-05-16T21:32:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7fe4752e1640 1 -- 172.21.15.5:0/3997849538 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c032660 con 0x7fe468008ba0 2024-05-16T21:32:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2106171640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ec003a10 0x7f20ec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7fb999c32640 1 --2- 172.21.15.5:0/3371521445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb99409eb80 0x7fb9940b5fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9940718c0 tx=0x7fb99002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e1b1fa33521e59 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2105970640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec004800 0x7f20ec004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f42ce044640 1 -- 172.21.15.5:0/636721096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c003cb30 msgr2=0x7f42c003a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f42ce044640 1 --2- 172.21.15.5:0/636721096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c003cb30 0x7f42c003a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f42ce044640 1 -- 172.21.15.5:0/636721096 >> v1:172.21.15.157:6789/0 conn(0x7f42c00072f0 legacy=0x7f42c00cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.731+0000 7f42ce044640 1 -- 172.21.15.5:0/636721096 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c0007700 con 0x7f42c003abe0 2024-05-16T21:32:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7fb998c30640 1 -- 172.21.15.5:0/3371521445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990037070 con 0x7fb99409eb80 2024-05-16T21:32:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f0935db4640 1 -- 172.21.15.5:0/36133103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0930070300 msgr2=0x7f0930147a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f0935db4640 1 --2- 172.21.15.5:0/36133103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0930070300 0x7f0930147a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0920009870 tx=0x7f092002a270 comp rx=0 tx=0).stop 2024-05-16T21:32:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7fe4772e5640 1 -- 172.21.15.5:0/3997849538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008ba0 msgr2=0x7fe468041a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7fe4772e5640 1 --2- 172.21.15.5:0/3997849538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008ba0 0x7fe468041a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009720 tx=0x7fe46c029f80 comp rx=0 tx=0).stop 2024-05-16T21:32:27.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7fb139d9b640 1 --2- 172.21.15.5:0/4082496061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d52c0 0x7fb1340d1d10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb134043970 tx=0x7fb12402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da6eaf3947ac83ab server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f42ce044640 1 --2- 172.21.15.5:0/636721096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003abe0 0x7f42c00d90c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42c40097a0 tx=0x7f42c402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ad51469eb1e0f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7fb998c30640 1 -- 172.21.15.5:0/3371521445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990032440 con 0x7fb99409eb80 2024-05-16T21:32:27.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f0935db4640 1 -- 172.21.15.5:0/36133103 shutdown_connections 2024-05-16T21:32:27.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f0935db4640 1 --2- 172.21.15.5:0/36133103 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300bb6f0 0x7f09300ba710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f0935db4640 1 --2- 172.21.15.5:0/36133103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0930070300 0x7f0930147a40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7ffa177fe640 1 -- 172.21.15.5:0/3590569148 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c037070 con 0x7ffa1003cf50 2024-05-16T21:32:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f0935db4640 1 -- 172.21.15.5:0/36133103 >> 172.21.15.5:0/36133103 conn(0x7f09300a1ac0 msgr2=0x7f09300bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2106972640 1 -- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec004800 msgr2=0x7f20ec004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2106972640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec004800 0x7f20ec004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2106972640 1 -- 172.21.15.5:0/1748028983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ec003a10 msgr2=0x7f20ec003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2106972640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ec003a10 0x7f20ec003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2106972640 1 -- 172.21.15.5:0/1748028983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21000b54e0 con 0x7f20ec005350 2024-05-16T21:32:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.732+0000 7f2105970640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec004800 0x7f20ec004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7ffa177fe640 1 -- 172.21.15.5:0/3590569148 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c032440 con 0x7ffa1003cf50 2024-05-16T21:32:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7ffa177fe640 1 -- 172.21.15.5:0/3590569148 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0327f0 con 0x7ffa1003cf50 2024-05-16T21:32:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fe4772e5640 1 -- 172.21.15.5:0/3997849538 shutdown_connections 2024-05-16T21:32:27.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fe4772e5640 1 --2- 172.21.15.5:0/3997849538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008ba0 0x7fe468041a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fe4772e5640 1 -- 172.21.15.5:0/3997849538 >> 172.21.15.5:0/3997849538 conn(0x7fe4680450f0 msgr2=0x7fe4680412f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fb13959a640 1 -- 172.21.15.5:0/4082496061 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124037070 con 0x7fb1340d52c0 2024-05-16T21:32:27.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fb13959a640 1 -- 172.21.15.5:0/4082496061 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb124032440 con 0x7fb1340d52c0 2024-05-16T21:32:27.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fb13959a640 1 -- 172.21.15.5:0/4082496061 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124032810 con 0x7fb1340d52c0 2024-05-16T21:32:27.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f0935db4640 1 -- 172.21.15.5:0/36133103 shutdown_connections 2024-05-16T21:32:27.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f0935db4640 1 -- 172.21.15.5:0/36133103 wait complete. 2024-05-16T21:32:27.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f42cd042640 1 -- 172.21.15.5:0/636721096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4037070 con 0x7f42c003abe0 2024-05-16T21:32:27.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f42cd042640 1 -- 172.21.15.5:0/636721096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c4032440 con 0x7f42c003abe0 2024-05-16T21:32:27.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f42cd042640 1 -- 172.21.15.5:0/636721096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c40327f0 con 0x7f42c003abe0 2024-05-16T21:32:27.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f893ad9d640 1 --2- 172.21.15.5:0/1112622381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f893403c820 0x7f8934040bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8930009870 tx=0x7f893002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa5dea986e5ca72 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f8939d9b640 1 -- 172.21.15.5:0/1112622381 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930037070 con 0x7f893403c820 2024-05-16T21:32:27.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f8939d9b640 1 -- 172.21.15.5:0/1112622381 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8930032440 con 0x7f893403c820 2024-05-16T21:32:27.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f8939d9b640 1 -- 172.21.15.5:0/1112622381 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930032810 con 0x7f893403c820 2024-05-16T21:32:27.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fe4772e5640 1 -- 172.21.15.5:0/3997849538 shutdown_connections 2024-05-16T21:32:27.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f2106972640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20ec005350 0x7f20ec00b9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c490 tx=0x7f20ec005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af6adff2658094b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fb998c30640 1 -- 172.21.15.5:0/3371521445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990032810 con 0x7fb99409eb80 2024-05-16T21:32:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc032020 con 0x7f20ec005350 2024-05-16T21:32:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20fc005ad0 con 0x7f20ec005350 2024-05-16T21:32:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7f210516f640 1 -- 172.21.15.5:0/1748028983 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc032020 con 0x7f20ec005350 2024-05-16T21:32:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7fb99ac34640 1 -- 172.21.15.5:0/3371521445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb99409eb80 msgr2=0x7fb9940b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7fb99ac34640 1 --2- 172.21.15.5:0/3371521445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb99409eb80 0x7fb9940b5fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9940718c0 tx=0x7fb99002a160 comp rx=0 tx=0).stop 2024-05-16T21:32:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7ffa1da64640 1 -- 172.21.15.5:0/3590569148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa1003cf50 msgr2=0x7ffa100cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7ffa1da64640 1 --2- 172.21.15.5:0/3590569148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa1003cf50 0x7ffa100cfc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa1003cb40 tx=0x7ffa0c02a270 comp rx=0 tx=0).stop 2024-05-16T21:32:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7fb99ac34640 1 -- 172.21.15.5:0/3371521445 shutdown_connections 2024-05-16T21:32:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7fb99ac34640 1 --2- 172.21.15.5:0/3371521445 >> v2:172.21.15.157:3300/0 conn(0x7fb9940b4380 0x7fb994074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7fb99ac34640 1 --2- 172.21.15.5:0/3371521445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb99409eb80 0x7fb9940b5fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7fb99ac34640 1 -- 172.21.15.5:0/3371521445 >> 172.21.15.5:0/3371521445 conn(0x7fb99406c8c0 msgr2=0x7fb99406ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7ffa1da64640 1 -- 172.21.15.5:0/3590569148 shutdown_connections 2024-05-16T21:32:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7ffa1da64640 1 --2- 172.21.15.5:0/3590569148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa1003cf50 0x7ffa100cfc90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7ffa1da64640 1 --2- 172.21.15.5:0/3590569148 >> v2:172.21.15.5:3300/0 conn(0x7ffa1003ea10 0x7ffa100d65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7ffa1da64640 1 -- 172.21.15.5:0/3590569148 >> 172.21.15.5:0/3590569148 conn(0x7ffa1003f680 msgr2=0x7ffa100060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7ffa1da64640 1 -- 172.21.15.5:0/3590569148 shutdown_connections 2024-05-16T21:32:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7fb99ac34640 1 -- 172.21.15.5:0/3371521445 shutdown_connections 2024-05-16T21:32:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7fb99ac34640 1 -- 172.21.15.5:0/3371521445 wait complete. 2024-05-16T21:32:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7f42cf046640 1 -- 172.21.15.5:0/636721096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003abe0 msgr2=0x7f42c00d90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7f42cf046640 1 --2- 172.21.15.5:0/636721096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003abe0 0x7f42c00d90c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42c40097a0 tx=0x7f42c402a1c0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f2107173640 1 -- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20ec005350 msgr2=0x7f20ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f2107173640 1 --2- 172.21.15.5:0/1748028983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20ec005350 0x7f20ec00b9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c490 tx=0x7f20ec005830 comp rx=0 tx=0).stop 2024-05-16T21:32:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f2106972640 1 -- 172.21.15.5:0/1748028983 reap_dead start 2024-05-16T21:32:27.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.734+0000 7ffa1da64640 1 -- 172.21.15.5:0/3590569148 wait complete. 2024-05-16T21:32:27.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f2107173640 1 -- 172.21.15.5:0/1748028983 shutdown_connections 2024-05-16T21:32:27.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f2107173640 1 -- 172.21.15.5:0/1748028983 >> 172.21.15.5:0/1748028983 conn(0x7f210006c8c0 msgr2=0x7f210006ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f8940933640 1 -- 172.21.15.5:0/1112622381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f893403c820 msgr2=0x7f8934040bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f2107173640 1 -- 172.21.15.5:0/1748028983 shutdown_connections 2024-05-16T21:32:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.733+0000 7fe4772e5640 1 -- 172.21.15.5:0/3997849538 wait complete. 2024-05-16T21:32:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7fe4772e5640 1 Processor -- start 2024-05-16T21:32:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f0935db4640 1 Processor -- start 2024-05-16T21:32:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7fe4772e5640 1 -- start start 2024-05-16T21:32:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f8940933640 1 --2- 172.21.15.5:0/1112622381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f893403c820 0x7f8934040bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8930009870 tx=0x7f893002a1c0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f8940933640 1 -- 172.21.15.5:0/1112622381 shutdown_connections 2024-05-16T21:32:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f8940933640 1 --2- 172.21.15.5:0/1112622381 >> v2:172.21.15.157:3300/0 conn(0x7f89340cf680 0x7f89340cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f8940933640 1 --2- 172.21.15.5:0/1112622381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f893403c820 0x7f8934040bf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f8940933640 1 -- 172.21.15.5:0/1112622381 >> 172.21.15.5:0/1112622381 conn(0x7f89340450f0 msgr2=0x7f89340412f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.735+0000 7f2107173640 1 -- 172.21.15.5:0/1748028983 wait complete. 2024-05-16T21:32:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f0935db4640 1 -- start start 2024-05-16T21:32:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7fb13ad9d640 1 -- 172.21.15.5:0/4082496061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d52c0 msgr2=0x7fb1340d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7fb13ad9d640 1 --2- 172.21.15.5:0/4082496061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d52c0 0x7fb1340d1d10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb134043970 tx=0x7fb12402a1a0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f8940933640 1 -- 172.21.15.5:0/1112622381 shutdown_connections 2024-05-16T21:32:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f42cf046640 1 -- 172.21.15.5:0/636721096 shutdown_connections 2024-05-16T21:32:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f42cf046640 1 --2- 172.21.15.5:0/636721096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c003cb30 0x7f42c003a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f42cf046640 1 --2- 172.21.15.5:0/636721096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003abe0 0x7f42c00d90c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f42cf046640 1 -- 172.21.15.5:0/636721096 >> 172.21.15.5:0/636721096 conn(0x7f42c0006530 msgr2=0x7f42c0006940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f42cf046640 1 -- 172.21.15.5:0/636721096 shutdown_connections 2024-05-16T21:32:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f42cf046640 1 -- 172.21.15.5:0/636721096 wait complete. 2024-05-16T21:32:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7ffa1da64640 1 Processor -- start 2024-05-16T21:32:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7f8940933640 1 -- 172.21.15.5:0/1112622381 wait complete. 2024-05-16T21:32:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.736+0000 7ffa1da64640 1 -- start start 2024-05-16T21:32:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.737+0000 7fb99ac34640 1 Processor -- start 2024-05-16T21:32:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.737+0000 7fb99ac34640 1 -- start start 2024-05-16T21:32:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.737+0000 7fb13ad9d640 1 -- 172.21.15.5:0/4082496061 shutdown_connections 2024-05-16T21:32:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.737+0000 7fb13ad9d640 1 --2- 172.21.15.5:0/4082496061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d52c0 0x7fb1340d1d10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.737+0000 7fb13ad9d640 1 --2- 172.21.15.5:0/4082496061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb134007080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.737+0000 7fb13ad9d640 1 -- 172.21.15.5:0/4082496061 >> 172.21.15.5:0/4082496061 conn(0x7fb134006560 msgr2=0x7fb134006970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.737+0000 7fb13ad9d640 1 -- 172.21.15.5:0/4082496061 shutdown_connections 2024-05-16T21:32:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fb13ad9d640 1 -- 172.21.15.5:0/4082496061 wait complete. 2024-05-16T21:32:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f0935db4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0930070300 0x7f09300beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f0935db4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300a0dc0 0x7f09301e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4772e5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008490 0x7fe4680d9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4772e5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe468008ba0 0x7fe46816f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4772e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4680cf8c0 0x7fe4680ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f2107173640 1 Processor -- start 2024-05-16T21:32:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f0935db4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09300bb6f0 0x7f09300b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4772e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe468041f40 con 0x7fe4680cf8c0 2024-05-16T21:32:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4772e5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe468009b40 con 0x7fe468008490 2024-05-16T21:32:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f2107173640 1 -- start start 2024-05-16T21:32:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4772e5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe4680420c0 con 0x7fe468008ba0 2024-05-16T21:32:27.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4762e3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008490 0x7fe4680d9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f092f7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0930070300 0x7f09300beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7ffa1da64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa1003adb0 0x7ffa100d0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f092effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300a0dc0 0x7f09301e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f092effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300a0dc0 0x7f09301e8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51050/0 (socket says 172.21.15.5:51050) 2024-05-16T21:32:27.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f092f7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0930070300 0x7f09300beb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40814/0 (socket says 172.21.15.5:40814) 2024-05-16T21:32:27.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4762e3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008490 0x7fe4680d9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40802/0 (socket says 172.21.15.5:40802) 2024-05-16T21:32:27.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7f092ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09300bb6f0 0x7f09300b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.738+0000 7fe4762e3640 1 -- 172.21.15.5:0/2010251268 learned_addr learned my addr 172.21.15.5:0/2010251268 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f092ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09300bb6f0 0x7f09300b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57520/0 (socket says 172.21.15.5:57520) 2024-05-16T21:32:27.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7ffa1ca62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa1003adb0 0x7ffa100d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7ffa1ca62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa1003adb0 0x7ffa100d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57528/0 (socket says 172.21.15.5:57528) 2024-05-16T21:32:27.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f092effd640 1 -- 172.21.15.5:0/3007742812 learned_addr learned my addr 172.21.15.5:0/3007742812 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09300b4da0 con 0x7f09300bb6f0 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f09300b6590 con 0x7f0930070300 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f09300b4f20 con 0x7f09300a0dc0 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f092effd640 1 -- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0930070300 msgr2=0x7f09300beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f092effd640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0930070300 0x7f09300beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f092effd640 1 -- 172.21.15.5:0/3007742812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09300bb6f0 msgr2=0x7f09300b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f092effd640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09300bb6f0 0x7f09300b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f092effd640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09300bf040 con 0x7f09300a0dc0 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7f092ffff640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09300bb6f0 0x7f09300b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f42cf046640 1 Processor -- start 2024-05-16T21:32:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f42cf046640 1 -- start start 2024-05-16T21:32:27.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7ffa1da64640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1003cf50 0x7ffa100d8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7ffa1da64640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa1003ea10 0x7ffa1016e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7ffa1da64640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa100d5a70 con 0x7ffa1003adb0 2024-05-16T21:32:27.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7ffa1da64640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ffa100d5da0 con 0x7ffa1003ea10 2024-05-16T21:32:27.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7ffa1da64640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ffa10039e90 con 0x7ffa1003cf50 2024-05-16T21:32:27.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7ffa1ca62640 1 -- 172.21.15.5:0/2983181129 learned_addr learned my addr 172.21.15.5:0/2983181129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f8940933640 1 Processor -- start 2024-05-16T21:32:27.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7f8940933640 1 -- start start 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fe475ae2640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe468008ba0 0x7fe46816f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fe476ae4640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4680cf8c0 0x7fe4680ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fb99ac34640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb99409eb80 0x7fb99409e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fb99ac34640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9940b4380 0x7fb9940be390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fb99ac34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9941527c0 0x7fb99409c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fb999431640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9940b4380 0x7fb9940be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb999431640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9940b4380 0x7fb9940be390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51060/0 (socket says 172.21.15.5:51060) 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb999431640 1 -- 172.21.15.5:0/3536913830 learned_addr learned my addr 172.21.15.5:0/3536913830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb99ac34640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9940724d0 con 0x7fb9941527c0 2024-05-16T21:32:27.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb99ac34640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb994072350 con 0x7fb99409eb80 2024-05-16T21:32:27.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb99ac34640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb99415d090 con 0x7fb9940b4380 2024-05-16T21:32:27.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7ffa1ca62640 1 -- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1003cf50 msgr2=0x7ffa100d8e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-16T21:32:27.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7ffa1ca62640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1003cf50 0x7ffa100d8e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7ffa1ca62640 1 -- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa1003ea10 msgr2=0x7ffa1016e850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7ffa1ca62640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa1003ea10 0x7ffa1016e850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7ffa1ca62640 1 -- 172.21.15.5:0/2983181129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa100d08a0 con 0x7ffa1003adb0 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fe4762e3640 1 -- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe468008ba0 msgr2=0x7fe46816f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fe4762e3640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe468008ba0 0x7fe46816f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fe4762e3640 1 -- 172.21.15.5:0/2010251268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4680cf8c0 msgr2=0x7fe4680ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fe4762e3640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4680cf8c0 0x7fe4680ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.739+0000 7fe4762e3640 1 -- 172.21.15.5:0/2010251268 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4680d9f60 con 0x7fe468008490 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fe4762e3640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008490 0x7fe4680d9a20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4700770f0 tx=0x7fe47006ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470076270 con 0x7fe468008490 2024-05-16T21:32:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7f2107173640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec005350 0x7f21000a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe470076410 con 0x7fe468008490 2024-05-16T21:32:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7f2107173640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21001ebf00 0x7f210014a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7f092effd640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300a0dc0 0x7f09301e8b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f092400d620 tx=0x7f092400dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb99a433640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9941527c0 0x7fb99409c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb999431640 1 -- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb99409eb80 msgr2=0x7fb99409e100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-16T21:32:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb999431640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb99409eb80 0x7fb99409e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7fb999431640 1 -- 172.21.15.5:0/3536913830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9941527c0 msgr2=0x7fb99409c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092400b620 con 0x7f09300a0dc0 2024-05-16T21:32:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7ffa1ca62640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa1003adb0 0x7ffa100d0360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c7f0 tx=0x7ffa0400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7f2106171640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec005350 0x7f21000a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.740+0000 7f2106171640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec005350 0x7f21000a0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51062/0 (socket says 172.21.15.5:51062) 2024-05-16T21:32:27.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0924019070 con 0x7f09300a0dc0 2024-05-16T21:32:27.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09301e90a0 con 0x7f09300a0dc0 2024-05-16T21:32:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f2106171640 1 -- 172.21.15.5:0/3375611136 learned_addr learned my addr 172.21.15.5:0/3375611136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f2107173640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21001ec310 0x7f2100146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7fb13ad9d640 1 Processor -- start 2024-05-16T21:32:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7fb13ad9d640 1 -- start start 2024-05-16T21:32:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092400ba00 con 0x7f09300a0dc0 2024-05-16T21:32:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09301ec700 con 0x7f09300a0dc0 2024-05-16T21:32:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42cf046640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c00072f0 0x7f42c00d1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42cf046640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c003abe0 0x7f42c016b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42cf046640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003cb30 0x7f42c00d5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42cf046640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00d0150 con 0x7f42c003cb30 2024-05-16T21:32:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42cf046640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f42c0004a70 con 0x7f42c003abe0 2024-05-16T21:32:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42cf046640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f42c00d02d0 con 0x7f42c00072f0 2024-05-16T21:32:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42ce044640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c00072f0 0x7f42c00d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42ce845640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003cb30 0x7f42c00d5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f42cd843640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c003abe0 0x7f42c016b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f42cd843640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c003abe0 0x7f42c016b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40842/0 (socket says 172.21.15.5:40842) 2024-05-16T21:32:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f42cd843640 1 -- 172.21.15.5:0/195435579 learned_addr learned my addr 172.21.15.5:0/195435579 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04015070 con 0x7ffa1003adb0 2024-05-16T21:32:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f8940933640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f893403c820 0x7f89340ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f8940933640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8934041ca0 0x7f89340cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f8940933640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89340cf680 0x7f89340cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f8940933640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f89340cffd0 con 0x7f89340cf680 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f8940933640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f89340420b0 con 0x7f893403c820 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f8940933640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f89340c6250 con 0x7f8934041ca0 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f893ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f893403c820 0x7f89340ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f893b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89340cf680 0x7f89340cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f893b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89340cf680 0x7f89340cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57576/0 (socket says 172.21.15.5:57576) 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f893b59e640 1 -- 172.21.15.5:0/2407021646 learned_addr learned my addr 172.21.15.5:0/2407021646 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470076800 con 0x7fe468008490 2024-05-16T21:32:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46816f820 con 0x7fe468008490 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe468162200 con 0x7fe468008490 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f2105970640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21001ebf00 0x7f210014a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f2106972640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21001ec310 0x7f2100146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f2107173640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f21000724d0 con 0x7f21001ebf00 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f2107173640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2100072350 con 0x7f21001ec310 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7f2107173640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f21000b5fe0 con 0x7f20ec005350 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f2105970640 1 -- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec005350 msgr2=0x7f21000a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f2105970640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec005350 0x7f21000a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f2105970640 1 -- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21001ec310 msgr2=0x7f2100146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f2105970640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21001ec310 0x7f2100146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f2105970640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21000a1b80 con 0x7f21001ebf00 2024-05-16T21:32:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7fb999431640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9941527c0 0x7fb99409c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7fb999431640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99406d090 con 0x7fb9940b4380 2024-05-16T21:32:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7fb99a433640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9941527c0 0x7fb99409c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7fb999431640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9940b4380 0x7fb9940be390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb98400d620 tx=0x7fb98400dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f893a59c640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8934041ca0 0x7f89340cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f0915ffb640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0908001030 con 0x7f09300a0dc0 2024-05-16T21:32:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f2105970640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21001ebf00 0x7f210014a620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21000bbd40 tx=0x7f20f000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.741+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa040077c0 con 0x7ffa1003adb0 2024-05-16T21:32:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04015070 con 0x7ffa1003adb0 2024-05-16T21:32:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f2106171640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20ec005350 0x7f21000a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7ffa1da64640 1 -- 172.21.15.5:0/2983181129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa100d9370 con 0x7ffa1003adb0 2024-05-16T21:32:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f2106972640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21001ec310 0x7f2100146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13ad9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb1340380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d2250 0x7fb13415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb1340380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb1340380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51088/0 (socket says 172.21.15.5:51088) 2024-05-16T21:32:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1340d52c0 0x7fb134167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7ffa1da64640 1 -- 172.21.15.5:0/2983181129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa100d9d70 con 0x7ffa1003adb0 2024-05-16T21:32:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb139d9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d2250 0x7fb13415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb139d9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d2250 0x7fb13415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40864/0 (socket says 172.21.15.5:40864) 2024-05-16T21:32:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13a59c640 1 -- 172.21.15.5:0/472876934 learned_addr learned my addr 172.21.15.5:0/472876934 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb13400cb20 con 0x7fb1340d52c0 2024-05-16T21:32:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb13403caf0 con 0x7fb1340d2250 2024-05-16T21:32:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb1340d1600 con 0x7fb13403b650 2024-05-16T21:32:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4680058f0 con 0x7fe468008490 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f42ce845640 1 -- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c00072f0 msgr2=0x7f42c00d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f42ce845640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42c00072f0 0x7f42c00d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f42ce845640 1 -- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c003abe0 msgr2=0x7f42c016b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f42ce845640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c003abe0 0x7f42c016b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7f42ce845640 1 -- 172.21.15.5:0/195435579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c00d18d0 con 0x7f42c003cb30 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f893a59c640 1 -- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f893403c820 msgr2=0x7f89340ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f893a59c640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f893403c820 0x7f89340ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f893a59c640 1 -- 172.21.15.5:0/2407021646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89340cf680 msgr2=0x7f89340cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f893a59c640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89340cf680 0x7f89340cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f893a59c640 1 -- 172.21.15.5:0/2407021646 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89340c9900 con 0x7f8934041ca0 2024-05-16T21:32:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f893a59c640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8934041ca0 0x7f89340cb020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f893c06b070 tx=0x7f893c06ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9840125f0 con 0x7fb9940b4380 2024-05-16T21:32:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984019070 con 0x7fb9940b4380 2024-05-16T21:32:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.742+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9840129d0 con 0x7fb9940b4380 2024-05-16T21:32:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7fb99ac34640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99409e640 con 0x7fb9940b4380 2024-05-16T21:32:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7f42ce845640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003cb30 0x7f42c00d5da0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42c8052210 tx=0x7f42c806ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb99ac34640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941e89e0 con 0x7fb9940b4380 2024-05-16T21:32:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0017070 con 0x7f21001ebf00 2024-05-16T21:32:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.743+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f000c6d0 con 0x7f21001ebf00 2024-05-16T21:32:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7f2107173640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21000a1e60 con 0x7f21001ebf00 2024-05-16T21:32:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7f2107173640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2100148ec0 con 0x7f21001ebf00 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f092400bba0 con 0x7f09300a0dc0 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb139d9b640 1 -- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 msgr2=0x7fb1340380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb139d9b640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13403b650 0x7fb1340380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb139d9b640 1 -- 172.21.15.5:0/472876934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1340d52c0 msgr2=0x7fb134167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb139d9b640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1340d52c0 0x7fb134167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb139d9b640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb134038620 con 0x7fb1340d2250 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb139d9b640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d2250 0x7fb13415aa80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb124031000 tx=0x7fb1240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124041020 con 0x7fb1340d2250 2024-05-16T21:32:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb124030660 con 0x7fb1340d2250 2024-05-16T21:32:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124037040 con 0x7fb1340d2250 2024-05-16T21:32:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13415afc0 con 0x7fb1340d2250 2024-05-16T21:32:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb134036710 con 0x7fb1340d2250 2024-05-16T21:32:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0017070 con 0x7f21001ebf00 2024-05-16T21:32:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7f0917fff640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f091c0763a0 0x7f091c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c097070 con 0x7f8934041ca0 2024-05-16T21:32:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89340cee20 con 0x7f8934041ca0 2024-05-16T21:32:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.744+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89340ca9b0 con 0x7f8934041ca0 2024-05-16T21:32:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7fb99ac34640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb99413ae00 con 0x7fb9940b4380 2024-05-16T21:32:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89340058f0 con 0x7f8934041ca0 2024-05-16T21:32:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893c06ee30 con 0x7f8934041ca0 2024-05-16T21:32:27.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7f092f7fe640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f091c0763a0 0x7f091c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0924098590 con 0x7f09300a0dc0 2024-05-16T21:32:27.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7f2107173640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2100074be0 con 0x7f21001ebf00 2024-05-16T21:32:27.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.745+0000 7f0917fff640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7f091c07e670 0x7f091c080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.746+0000 7f092ffff640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7f091c07e670 0x7f091c080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.746+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb984012b70 con 0x7fb9940b4380 2024-05-16T21:32:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.746+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0924004470 con 0x7f091c07e670 2024-05-16T21:32:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7f092ffff640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7f091c07e670 0x7f091c080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0924098980 con 0x7f09300a0dc0 2024-05-16T21:32:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7f092f7fe640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f091c0763a0 0x7f091c0788b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0920034000 tx=0x7f092002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c097070 con 0x7f8934041ca0 2024-05-16T21:32:27.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.746+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa04018070 con 0x7ffa1003adb0 2024-05-16T21:32:27.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c806c6e0 con 0x7f42c003cb30 2024-05-16T21:32:27.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c806c880 con 0x7f42c003cb30 2024-05-16T21:32:27.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c806cc70 con 0x7f42c003cb30 2024-05-16T21:32:27.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7fb98a7fc640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb978076300 0x7fb978078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb134005920 con 0x7fb1340d2250 2024-05-16T21:32:27.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb124044020 con 0x7fb1340d2250 2024-05-16T21:32:27.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe47006c6e0 con 0x7fe468008490 2024-05-16T21:32:27.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7fe466ffd640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe4540763d0 0x7fe4540788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7ffa1da64640 1 -- 172.21.15.5:0/2983181129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa100054a0 con 0x7ffa1003adb0 2024-05-16T21:32:27.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9840979c0 con 0x7fb9940b4380 2024-05-16T21:32:27.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7fb98a7fc640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7fb97807e550 0x7fb9780809a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb98401be70 con 0x7fb97807e550 2024-05-16T21:32:27.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe470113dd0 con 0x7fe468008490 2024-05-16T21:32:27.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb98409c2c0 con 0x7fb9940b4380 2024-05-16T21:32:27.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fe466ffd640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fe45407e6a0 0x7fe454080af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe470091e50 con 0x7fe45407e6a0 2024-05-16T21:32:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe470116430 con 0x7fe468008490 2024-05-16T21:32:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb132ffd640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb11c0763a0 0x7fb11c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c000acd0 con 0x7f42c003cb30 2024-05-16T21:32:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb999c32640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb978076300 0x7fb978078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 <== osd.1 v2:172.21.15.5:6824/1146909345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0924004470 con 0x7f091c07e670 2024-05-16T21:32:27.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c00d07f0 con 0x7f42c003cb30 2024-05-16T21:32:27.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb99a433640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7fb97807e550 0x7fb9780809a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f20f001a070 con 0x7f21001ebf00 2024-05-16T21:32:27.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1240b7d30 con 0x7fb1340d2250 2024-05-16T21:32:27.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb132ffd640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7fb11c07e670 0x7fb11c080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb124032440 con 0x7fb11c07e670 2024-05-16T21:32:27.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb1240ba390 con 0x7fb1340d2250 2024-05-16T21:32:27.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fb13a59c640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb11c0763a0 0x7fb11c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42c0005300 con 0x7f42c003cb30 2024-05-16T21:32:27.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.747+0000 7ffa157fa640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff9fc076700 0x7ff9fc078c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7ffa17fff640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff9fc076700 0x7ff9fc078c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffa040075c0 con 0x7ffa1003adb0 2024-05-16T21:32:27.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7ffa157fa640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7ff9fc07e950 0x7ff9fc080da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa0401bec0 con 0x7ff9fc07e950 2024-05-16T21:32:27.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffa0405cb70 con 0x7ffa1003adb0 2024-05-16T21:32:27.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7ffa1d263640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7ff9fc07e950 0x7ff9fc080da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7ffa17fff640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff9fc076700 0x7ff9fc078c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c034000 tx=0x7ffa0c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fe476ae4640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fe45407e6a0 0x7fe454080af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7f20f6ffd640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20e40766d0 0x7f20e4078be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f20f000eda0 con 0x7f21001ebf00 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7f2106171640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20e40766d0 0x7f20e4078be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7f20f6ffd640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f20e407e920 0x7f20e4080d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20f001fe70 con 0x7f20e407e920 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f20f00973c0 con 0x7f21001ebf00 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7f2106972640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f20e407e920 0x7f20e4080d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7fb999c32640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb978076300 0x7fb978078810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb990034000 tx=0x7fb99002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.749+0000 7fb99a433640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7fb97807e550 0x7fb9780809a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7fb13a59c640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb11c0763a0 0x7fb11c0788b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009b60 tx=0x7fb12c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.748+0000 7fe475ae2640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe4540763d0 0x7fe4540788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7fe475ae2640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe4540763d0 0x7fe4540788e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe46c034000 tx=0x7fe46c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7ffa1d263640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7ff9fc07e950 0x7ff9fc080da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7fb140f6b640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7fb11c07e670 0x7fb11c080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7fe476ae4640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fe45407e6a0 0x7fe454080af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7f2106171640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20e40766d0 0x7f20e4078be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20f8007070 tx=0x7f20f80075a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7f2106972640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f20e407e920 0x7f20e4080d70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f893c09a070 con 0x7f8934041ca0 2024-05-16T21:32:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7fb140f6b640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7fb11c07e670 0x7fb11c080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.750+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 <== osd.7 v2:172.21.15.157:6816/3015790228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb98401be70 con 0x7fb97807e550 2024-05-16T21:32:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7f89237fe640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f89280766d0 0x7f8928078be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f893c0766a0 con 0x7f8934041ca0 2024-05-16T21:32:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 <== osd.3 v2:172.21.15.5:6808/1040173321 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa0401bec0 con 0x7ff9fc07e950 2024-05-16T21:32:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 <== osd.6 v2:172.21.15.157:6800/3966496545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20f001fe70 con 0x7f20e407e920 2024-05-16T21:32:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7f89237fe640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7f892807e920 0x7f8928080d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 --> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8928081440 con 0x7f892807e920 2024-05-16T21:32:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f893c117f80 con 0x7f8934041ca0 2024-05-16T21:32:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 <== osd.5 v2:172.21.15.157:6808/2462600028 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe470091e50 con 0x7fe45407e6a0 2024-05-16T21:32:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 <== osd.0 v2:172.21.15.5:6800/971514196 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb124032440 con 0x7fb11c07e670 2024-05-16T21:32:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42c8076150 con 0x7f42c003cb30 2024-05-16T21:32:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.752+0000 7f42beffd640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42ac0763d0 0x7f42ac0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.752+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42c81140b0 con 0x7f42c003cb30 2024-05-16T21:32:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.751+0000 7f893b59e640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7f892807e920 0x7f8928080d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.752+0000 7f42beffd640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f42ac07e6a0 0x7f42ac080af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.752+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42ac0811c0 con 0x7f42ac07e6a0 2024-05-16T21:32:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.752+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f42c81144a0 con 0x7f42c003cb30 2024-05-16T21:32:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.752+0000 7f893ad9d640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f89280766d0 0x7f8928078be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.752+0000 7f42ce044640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42ac0763d0 0x7f42ac0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.753+0000 7f42cd843640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f42ac07e6a0 0x7f42ac080af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.753+0000 7f42ce044640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42ac0763d0 0x7f42ac0788e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.754+0000 7f42cd843640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f42ac07e6a0 0x7f42ac080af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.753+0000 7f893b59e640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7f892807e920 0x7f8928080d70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.754+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 <== osd.4 v2:172.21.15.157:6824/3329892271 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8928081440 con 0x7f892807e920 2024-05-16T21:32:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.755+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 <== osd.2 v2:172.21.15.5:6816/2608436175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42ac0811c0 con 0x7f42ac07e6a0 2024-05-16T21:32:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.755+0000 7f893ad9d640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f89280766d0 0x7f8928078be0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8930034000 tx=0x7f893002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.781+0000 7f0915ffb640 1 -- 172.21.15.5:0/3007742812 --> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0908002dd0 con 0x7f091c07e670 2024-05-16T21:32:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.782+0000 7f0917fff640 1 -- 172.21.15.5:0/3007742812 <== osd.1 v2:172.21.15.5:6824/1146909345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0908002dd0 con 0x7f091c07e670 2024-05-16T21:32:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.782+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7f091c07e670 msgr2=0x7f091c080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.782+0000 7f0935db4640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7f091c07e670 0x7f091c080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f091c0763a0 msgr2=0x7f091c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f0935db4640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f091c0763a0 0x7f091c0788b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0920034000 tx=0x7f092002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300a0dc0 msgr2=0x7f09301e8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f0935db4640 1 --2- 172.21.15.5:0/3007742812 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09300a0dc0 0x7f09301e8b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f092400d620 tx=0x7f092400dae0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f092ffff640 1 -- 172.21.15.5:0/3007742812 reap_dead start 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 shutdown_connections 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 >> 172.21.15.5:0/3007742812 conn(0x7f09300a1ac0 msgr2=0x7f0930146bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7ffa1da64640 1 -- 172.21.15.5:0/2983181129 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa100d9640 con 0x7ff9fc07e950 2024-05-16T21:32:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 shutdown_connections 2024-05-16T21:32:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.783+0000 7f0935db4640 1 -- 172.21.15.5:0/3007742812 wait complete. 2024-05-16T21:32:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.785+0000 7ffa157fa640 1 -- 172.21.15.5:0/2983181129 <== osd.3 v2:172.21.15.5:6808/1040173321 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffa100d9640 con 0x7ff9fc07e950 2024-05-16T21:32:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.785+0000 7fb99ac34640 1 -- 172.21.15.5:0/3536913830 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb994050860 con 0x7fb97807e550 2024-05-16T21:32:27.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.785+0000 7f2107173640 1 -- 172.21.15.5:0/3375611136 --> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f21000bb9c0 con 0x7f20e407e920 2024-05-16T21:32:27.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.785+0000 7ffa02ffd640 1 -- 172.21.15.5:0/2983181129 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7ff9fc07e950 msgr2=0x7ff9fc080da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.785+0000 7ffa02ffd640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7ff9fc07e950 0x7ff9fc080da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.785+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe468006b70 con 0x7fe45407e6a0 2024-05-16T21:32:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.785+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb134006c50 con 0x7fb11c07e670 2024-05-16T21:32:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7ffa02ffd640 1 -- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff9fc076700 msgr2=0x7ff9fc078c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7ffa02ffd640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff9fc076700 0x7ff9fc078c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c034000 tx=0x7ffa0c02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7fb98a7fc640 1 -- 172.21.15.5:0/3536913830 <== osd.7 v2:172.21.15.157:6816/3015790228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb994050860 con 0x7fb97807e550 2024-05-16T21:32:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7ffa02ffd640 1 -- 172.21.15.5:0/2983181129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa1003adb0 msgr2=0x7ffa100d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7fe466ffd640 1 -- 172.21.15.5:0/2010251268 <== osd.5 v2:172.21.15.157:6808/2462600028 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe468006b70 con 0x7fe45407e6a0 2024-05-16T21:32:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7ffa02ffd640 1 --2- 172.21.15.5:0/2983181129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa1003adb0 0x7ffa100d0360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c7f0 tx=0x7ffa0400ccb0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7ffa1d263640 1 -- 172.21.15.5:0/2983181129 reap_dead start 2024-05-16T21:32:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7f20f6ffd640 1 -- 172.21.15.5:0/3375611136 <== osd.6 v2:172.21.15.157:6800/3966496545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f21000bb9c0 con 0x7f20e407e920 2024-05-16T21:32:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7fb132ffd640 1 -- 172.21.15.5:0/472876934 <== osd.0 v2:172.21.15.5:6800/971514196 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb134006c50 con 0x7fb11c07e670 2024-05-16T21:32:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 --> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f89340404c0 con 0x7f892807e920 2024-05-16T21:32:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7ffa02ffd640 1 -- 172.21.15.5:0/2983181129 shutdown_connections 2024-05-16T21:32:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7ffa02ffd640 1 -- 172.21.15.5:0/2983181129 >> 172.21.15.5:0/2983181129 conn(0x7ffa1003f680 msgr2=0x7ffa10041d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7ffa02ffd640 1 -- 172.21.15.5:0/2983181129 shutdown_connections 2024-05-16T21:32:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7ffa02ffd640 1 -- 172.21.15.5:0/2983181129 wait complete. 2024-05-16T21:32:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fe45407e6a0 msgr2=0x7fe454080af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7fe4772e5640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fe45407e6a0 0x7fe454080af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7f20f4ff9640 1 -- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f20e407e920 msgr2=0x7f20e4080d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7f20f4ff9640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f20e407e920 0x7f20e4080d70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7f20f4ff9640 1 -- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20e40766d0 msgr2=0x7f20e4078be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7f20f4ff9640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20e40766d0 0x7f20e4078be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20f8007070 tx=0x7f20f80075a0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f20f4ff9640 1 -- 172.21.15.5:0/3375611136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21001ebf00 msgr2=0x7f210014a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f20f4ff9640 1 --2- 172.21.15.5:0/3375611136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21001ebf00 0x7f210014a620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21000bbd40 tx=0x7f20f000ec70 comp rx=0 tx=0).stop 2024-05-16T21:32:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7fb977fff640 1 -- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7fb97807e550 msgr2=0x7fb9780809a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.786+0000 7fb977fff640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7fb97807e550 0x7fb9780809a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f89237fe640 1 -- 172.21.15.5:0/2407021646 <== osd.4 v2:172.21.15.157:6824/3329892271 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f89340404c0 con 0x7f892807e920 2024-05-16T21:32:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f2106972640 1 -- 172.21.15.5:0/3375611136 reap_dead start 2024-05-16T21:32:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb977fff640 1 -- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb978076300 msgr2=0x7fb978078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f20f4ff9640 1 -- 172.21.15.5:0/3375611136 shutdown_connections 2024-05-16T21:32:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f20f4ff9640 1 -- 172.21.15.5:0/3375611136 >> 172.21.15.5:0/3375611136 conn(0x7f210006c8c0 msgr2=0x7f210014c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb977fff640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb978076300 0x7fb978078810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb990034000 tx=0x7fb99002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb977fff640 1 -- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9940b4380 msgr2=0x7fb9940be390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7fb11c07e670 msgr2=0x7fb11c080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb977fff640 1 --2- 172.21.15.5:0/3536913830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9940b4380 0x7fb9940be390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb98400d620 tx=0x7fb98400dae0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb99a433640 1 -- 172.21.15.5:0/3536913830 reap_dead start 2024-05-16T21:32:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb13ad9d640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7fb11c07e670 0x7fb11c080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb977fff640 1 -- 172.21.15.5:0/3536913830 shutdown_connections 2024-05-16T21:32:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb977fff640 1 -- 172.21.15.5:0/3536913830 >> 172.21.15.5:0/3536913830 conn(0x7fb99406c8c0 msgr2=0x7fb994144f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe4540763d0 msgr2=0x7fe4540788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fe4772e5640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe4540763d0 0x7fe4540788e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe46c034000 tx=0x7fe46c02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:27.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f20f4ff9640 1 -- 172.21.15.5:0/3375611136 shutdown_connections 2024-05-16T21:32:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f42c00058f0 con 0x7f42ac07e6a0 2024-05-16T21:32:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008490 msgr2=0x7fe4680d9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fe4772e5640 1 --2- 172.21.15.5:0/2010251268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe468008490 0x7fe4680d9a20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4700770f0 tx=0x7fe47006ead0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb11c0763a0 msgr2=0x7fb11c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fe476ae4640 1 -- 172.21.15.5:0/2010251268 reap_dead start 2024-05-16T21:32:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 shutdown_connections 2024-05-16T21:32:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb13ad9d640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb11c0763a0 0x7fb11c0788b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009b60 tx=0x7fb12c009190 comp rx=0 tx=0).stop 2024-05-16T21:32:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 >> 172.21.15.5:0/2010251268 conn(0x7fe4680450f0 msgr2=0x7fe46803eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb977fff640 1 -- 172.21.15.5:0/3536913830 shutdown_connections 2024-05-16T21:32:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb977fff640 1 -- 172.21.15.5:0/3536913830 wait complete. 2024-05-16T21:32:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d2250 msgr2=0x7fb13415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f20f4ff9640 1 -- 172.21.15.5:0/3375611136 wait complete. 2024-05-16T21:32:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7fb13ad9d640 1 --2- 172.21.15.5:0/472876934 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1340d2250 0x7fb13415aa80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb124031000 tx=0x7fb1240046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7f892807e920 msgr2=0x7f8928080d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.787+0000 7f8940933640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7f892807e920 0x7f8928080d70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7fb140f6b640 1 -- 172.21.15.5:0/472876934 reap_dead start 2024-05-16T21:32:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 shutdown_connections 2024-05-16T21:32:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f42beffd640 1 -- 172.21.15.5:0/195435579 <== osd.2 v2:172.21.15.5:6816/2608436175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f42c00058f0 con 0x7f42ac07e6a0 2024-05-16T21:32:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7fe4772e5640 1 -- 172.21.15.5:0/2010251268 wait complete. 2024-05-16T21:32:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f89280766d0 msgr2=0x7f8928078be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f8940933640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f89280766d0 0x7f8928078be0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8930034000 tx=0x7f893002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 shutdown_connections 2024-05-16T21:32:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 >> 172.21.15.5:0/472876934 conn(0x7fb134006560 msgr2=0x7fb134004e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8934041ca0 msgr2=0x7f89340cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f8940933640 1 --2- 172.21.15.5:0/2407021646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8934041ca0 0x7f89340cb020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f893c06b070 tx=0x7f893c06ec40 comp rx=0 tx=0).stop 2024-05-16T21:32:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f893b59e640 1 -- 172.21.15.5:0/2407021646 reap_dead start 2024-05-16T21:32:27.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 shutdown_connections 2024-05-16T21:32:27.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 shutdown_connections 2024-05-16T21:32:27.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 >> 172.21.15.5:0/2407021646 conn(0x7f89340450f0 msgr2=0x7f89340bf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7fb13ad9d640 1 -- 172.21.15.5:0/472876934 wait complete. 2024-05-16T21:32:27.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.788+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 shutdown_connections 2024-05-16T21:32:27.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.789+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f42ac07e6a0 msgr2=0x7f42ac080af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.789+0000 7f42cf046640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f42ac07e6a0 0x7f42ac080af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.789+0000 7f8940933640 1 -- 172.21.15.5:0/2407021646 wait complete. 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.789+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42ac0763d0 msgr2=0x7f42ac0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.789+0000 7f42cf046640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42ac0763d0 0x7f42ac0788e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c402e000 comp rx=0 tx=0).stop 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.789+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003cb30 msgr2=0x7f42c00d5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.790+0000 7f42cf046640 1 --2- 172.21.15.5:0/195435579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c003cb30 0x7f42c00d5da0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42c8052210 tx=0x7f42c806ead0 comp rx=0 tx=0).stop 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.790+0000 7f42ce845640 1 -- 172.21.15.5:0/195435579 reap_dead start 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.790+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 shutdown_connections 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.790+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 >> 172.21.15.5:0/195435579 conn(0x7f42c0006530 msgr2=0x7f42c0004bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.790+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 shutdown_connections 2024-05-16T21:32:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:27.790+0000 7f42cf046640 1 -- 172.21.15.5:0/195435579 wait complete. 2024-05-16T21:32:27.849 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:27.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-16T21:32:27.850 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:27.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-16T21:32:27.851 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-05-16T21:32:27.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-16T21:32:27.852 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-05-16T21:32:27.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-16T21:32:27.853 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:27.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-16T21:32:27.854 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-05-16T21:32:27.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-16T21:32:27.855 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-05-16T21:32:27.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-16T21:32:27.856 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-05-16T21:32:27.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-16T21:32:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.109+0000 7f1803a51640 1 Processor -- start 2024-05-16T21:32:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.109+0000 7f1803a51640 1 -- start start 2024-05-16T21:32:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.110+0000 7f5718d57640 1 Processor -- start 2024-05-16T21:32:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.110+0000 7f5718d57640 1 -- start start 2024-05-16T21:32:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7fed318f5640 1 Processor -- start 2024-05-16T21:32:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7f1803a51640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f17fc074690 0x7f17fc0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7f1803a51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc155d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7f42440e2640 1 Processor -- start 2024-05-16T21:32:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7f1803a51640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17fc0bca20 0x7f17fc1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7f1803a51640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f17fc074aa0 con 0x7f17fc0bca20 2024-05-16T21:32:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7f1803a51640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f17fc14cd80 con 0x7f17fc074690 2024-05-16T21:32:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7f1803a51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f17fc0b4840 con 0x7f17fc0bc610 2024-05-16T21:32:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f1801fee640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17fc0bca20 0x7f17fc1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f1801fee640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17fc0bca20 0x7f17fc1562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57588/0 (socket says 172.21.15.5:57588) 2024-05-16T21:32:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f1801fee640 1 -- 172.21.15.5:0/1970276210 learned_addr learned my addr 172.21.15.5:0/1970276210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f1800fec640 1 --2- 172.21.15.5:0/1970276210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f5718d57640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f570c03c1c0 0x7f570c03cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f42440e2640 1 -- start start 2024-05-16T21:32:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f18017ed640 1 --2- 172.21.15.5:0/1970276210 >> v2:172.21.15.157:3300/0 conn(0x7f17fc074690 0x7f17fc0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f5718d57640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f570c039c20 0x7f570c0d6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f1801fee640 1 -- 172.21.15.5:0/1970276210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 msgr2=0x7f17fc155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.112+0000 7f1801fee640 1 --2- 172.21.15.5:0/1970276210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.111+0000 7fed318f5640 1 -- start start 2024-05-16T21:32:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f1801fee640 1 -- 172.21.15.5:0/1970276210 >> v2:172.21.15.157:3300/0 conn(0x7f17fc074690 msgr2=0x7f17fc0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f571259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f570c03c1c0 0x7f570c03cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f1801fee640 1 --2- 172.21.15.5:0/1970276210 >> v2:172.21.15.157:3300/0 conn(0x7f17fc074690 0x7f17fc0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f571259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f570c03c1c0 0x7f570c03cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40882/0 (socket says 172.21.15.5:40882) 2024-05-16T21:32:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f1801fee640 1 -- 172.21.15.5:0/1970276210 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc0b4b20 con 0x7f17fc0bca20 2024-05-16T21:32:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f5711d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f570c039c20 0x7f570c0d6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f771766e640 1 Processor -- start 2024-05-16T21:32:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f5711d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f570c039c20 0x7f570c0d6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57596/0 (socket says 172.21.15.5:57596) 2024-05-16T21:32:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f571259c640 1 -- 172.21.15.5:0/3412439504 learned_addr learned my addr 172.21.15.5:0/3412439504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f5718d57640 1 -- 172.21.15.5:0/3412439504 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570c0d5ab0 con 0x7f570c0cfb00 2024-05-16T21:32:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f1800fec640 1 --2- 172.21.15.5:0/1970276210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f5718d57640 1 -- 172.21.15.5:0/3412439504 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f570c0d60c0 con 0x7f570c039c20 2024-05-16T21:32:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f5718d57640 1 -- 172.21.15.5:0/3412439504 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f570c03b970 con 0x7f570c03c1c0 2024-05-16T21:32:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f18017ed640 1 --2- 172.21.15.5:0/1970276210 >> v2:172.21.15.157:3300/0 conn(0x7f17fc074690 0x7f17fc0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7fed318f5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fed2c0bf930 0x7fed2c0c0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7fed318f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fed2c14c4e0 0x7fed2c14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7fed318f5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed2c155b80 con 0x7fed2c0bac00 2024-05-16T21:32:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7f771766e640 1 -- start start 2024-05-16T21:32:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f42440e2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f423c1455f0 0x7f423c14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7fed318f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fed2c0bd520 con 0x7fed2c14c4e0 2024-05-16T21:32:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.113+0000 7fed318f5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fed2c0bbfe0 con 0x7fed2c0bf930 2024-05-16T21:32:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7fed310f4640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fed2c0bac00 0x7fed2c0bb010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:41016/0 (socket says 172.21.15.5:41016) 2024-05-16T21:32:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7fed310f4640 1 -- 172.21.15.5:0/3059979362 learned_addr learned my addr 172.21.15.5:0/3059979362 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f42440e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f423c0bb470 0x7f423c1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f42440e2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f423c0bc710 con 0x7f423c0bb060 2024-05-16T21:32:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f42440e2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f423c14b590 con 0x7f423c0bb470 2024-05-16T21:32:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f42440e2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f423c14f1c0 con 0x7f423c1455f0 2024-05-16T21:32:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f424167d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f423c0bb060 0x7f423c14e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34918/0 (socket says 172.21.15.5:34918) 2024-05-16T21:32:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f424167d640 1 -- 172.21.15.5:0/3510589381 learned_addr learned my addr 172.21.15.5:0/3510589381 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f424267f640 1 --2- 172.21.15.5:0/3510589381 >> v2:172.21.15.5:3300/0 conn(0x7f423c0bb470 0x7f423c1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7fed2b7fe640 1 -- 172.21.15.5:0/3059979362 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552233895 0 0) 0x7fed2c155b80 con 0x7fed2c0bac00 2024-05-16T21:32:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f7582461640 1 Processor -- start 2024-05-16T21:32:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f7582461640 1 -- start start 2024-05-16T21:32:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7fed2b7fe640 1 -- 172.21.15.5:0/3059979362 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed1c003520 con 0x7fed2c0bac00 2024-05-16T21:32:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f5711d9b640 1 -- 172.21.15.5:0/3412439504 >> v2:172.21.15.157:3300/0 conn(0x7f570c03c1c0 msgr2=0x7f570c03cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7fed308f3640 1 --2- 172.21.15.5:0/3059979362 >> v2:172.21.15.157:3300/0 conn(0x7fed2c0bf930 0x7fed2c0c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7fed2bfff640 1 --2- 172.21.15.5:0/3059979362 >> v2:172.21.15.5:3300/0 conn(0x7fed2c14c4e0 0x7fed2c14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f4240e7c640 1 -- 172.21.15.5:0/3510589381 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004696692 0 0) 0x7f423c0bc710 con 0x7f423c0bb060 2024-05-16T21:32:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f5711d9b640 1 --2- 172.21.15.5:0/3412439504 >> v2:172.21.15.157:3300/0 conn(0x7f570c03c1c0 0x7f570c03cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f4240e7c640 1 -- 172.21.15.5:0/3510589381 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4228003520 con 0x7f423c0bb060 2024-05-16T21:32:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f5711d9b640 1 -- 172.21.15.5:0/3412439504 >> v1:172.21.15.157:6789/0 conn(0x7f570c0cfb00 legacy=0x7f570c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.114+0000 7f5711d9b640 1 -- 172.21.15.5:0/3412439504 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c03ece0 con 0x7f570c039c20 2024-05-16T21:32:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7fed2b7fe640 1 -- 172.21.15.5:0/3059979362 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3430499643 0 0) 0x7fed1c003520 con 0x7fed2c0bac00 2024-05-16T21:32:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f571259c640 1 --2- 172.21.15.5:0/3412439504 >> v2:172.21.15.157:3300/0 conn(0x7f570c03c1c0 0x7f570c03cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f771766e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77100be4a0 0x7f771008d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f771766e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f77100bd640 0x7f77100c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f771766e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77100bda50 con 0x7f771014eae0 2024-05-16T21:32:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f771766e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f771006e680 con 0x7f77100be4a0 2024-05-16T21:32:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f771766e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f77100bea80 con 0x7f77100bd640 2024-05-16T21:32:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f424267f640 1 -- 172.21.15.5:0/3510589381 >> v2:172.21.15.157:3300/0 conn(0x7f423c1455f0 msgr2=0x7f423c14ba20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-16T21:32:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f424267f640 1 --2- 172.21.15.5:0/3510589381 >> v2:172.21.15.157:3300/0 conn(0x7f423c1455f0 0x7f423c14ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f424267f640 1 -- 172.21.15.5:0/3510589381 >> v1:172.21.15.5:6789/0 conn(0x7f423c0bb060 legacy=0x7f423c14e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f424267f640 1 -- 172.21.15.5:0/3510589381 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c14b220 con 0x7f423c0bb470 2024-05-16T21:32:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f1801fee640 1 --2- 172.21.15.5:0/1970276210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 0x7f17fc1562a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0bbab0 tx=0x7f17f802a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c9f37103f58671 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f8577373640 1 Processor -- start 2024-05-16T21:32:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7fed308f3640 1 -- 172.21.15.5:0/3059979362 >> v2:172.21.15.5:3300/0 conn(0x7fed2c14c4e0 msgr2=0x7fed2c14c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7fed308f3640 1 --2- 172.21.15.5:0/3059979362 >> v2:172.21.15.5:3300/0 conn(0x7fed2c14c4e0 0x7fed2c14c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7fed308f3640 1 -- 172.21.15.5:0/3059979362 >> v1:172.21.15.157:6789/0 conn(0x7fed2c0bac00 legacy=0x7fed2c0bb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f8577373640 1 -- start start 2024-05-16T21:32:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f17f3fff640 1 -- 172.21.15.5:0/1970276210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8036070 con 0x7f17fc0bca20 2024-05-16T21:32:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f5711d9b640 1 --2- 172.21.15.5:0/3412439504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c039c20 0x7f570c0d6550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f570c0d5c80 tx=0x7f570402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24ba3f61ec8015e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7fed308f3640 1 -- 172.21.15.5:0/3059979362 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c0bc2c0 con 0x7fed2c0bf930 2024-05-16T21:32:28.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f17f3fff640 1 -- 172.21.15.5:0/1970276210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f8031600 con 0x7f17fc0bca20 2024-05-16T21:32:28.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f17f3fff640 1 -- 172.21.15.5:0/1970276210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f80319d0 con 0x7f17fc0bca20 2024-05-16T21:32:28.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7fed2bfff640 1 --2- 172.21.15.5:0/3059979362 >> v2:172.21.15.5:3300/0 conn(0x7fed2c14c4e0 0x7fed2c14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:28.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.115+0000 7f8560fb2640 1 Processor -- start 2024-05-16T21:32:28.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f8560fb2640 1 -- start start 2024-05-16T21:32:28.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f7582461640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f757403d450 0x7f75740dcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f7582461640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7574040b20 con 0x7f757403c7f0 2024-05-16T21:32:28.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f7582461640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757403de80 con 0x7f75740cba70 2024-05-16T21:32:28.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f7582461640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7574040e00 con 0x7f757403d450 2024-05-16T21:32:28.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f771540a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77100be4a0 0x7f771008d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f771540a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77100be4a0 0x7f771008d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57634/0 (socket says 172.21.15.5:57634) 2024-05-16T21:32:28.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f771540a640 1 -- 172.21.15.5:0/2380074897 learned_addr learned my addr 172.21.15.5:0/2380074897 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f7714c09640 1 --2- 172.21.15.5:0/2380074897 >> v2:172.21.15.157:3300/0 conn(0x7f77100bd640 0x7f77100c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.116+0000 7f771540a640 1 -- 172.21.15.5:0/2380074897 >> v2:172.21.15.157:3300/0 conn(0x7f77100bd640 msgr2=0x7f77100c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f757b7fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f75740cba70 0x7f757403cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:41024/0 (socket says 172.21.15.5:41024) 2024-05-16T21:32:28.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 -- 172.21.15.5:0/1970276210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 msgr2=0x7f17fc1562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f757b7fe640 1 -- 172.21.15.5:0/1681541399 learned_addr learned my addr 172.21.15.5:0/1681541399 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:28.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 --2- 172.21.15.5:0/1970276210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 0x7f17fc1562a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0bbab0 tx=0x7f17f802a430 comp rx=0 tx=0).stop 2024-05-16T21:32:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 -- 172.21.15.5:0/1970276210 shutdown_connections 2024-05-16T21:32:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 --2- 172.21.15.5:0/1970276210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 0x7f17fc1562a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 --2- 172.21.15.5:0/1970276210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 --2- 172.21.15.5:0/1970276210 >> v2:172.21.15.157:3300/0 conn(0x7f17fc074690 0x7f17fc0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 -- 172.21.15.5:0/1970276210 >> 172.21.15.5:0/1970276210 conn(0x7f17fc0c0060 msgr2=0x7f17fc0bbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 -- 172.21.15.5:0/1970276210 shutdown_connections 2024-05-16T21:32:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f571159a640 1 -- 172.21.15.5:0/3412439504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704037070 con 0x7f570c039c20 2024-05-16T21:32:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f571159a640 1 -- 172.21.15.5:0/3412439504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570402ac60 con 0x7f570c039c20 2024-05-16T21:32:28.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f424267f640 1 --2- 172.21.15.5:0/3510589381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0bb470 0x7f423c1559d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f423c06e830 tx=0x7f423402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbe29429416fd8b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846572079 0 0) 0x7f757403de80 con 0x7f75740cba70 2024-05-16T21:32:28.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f756c003520 con 0x7f75740cba70 2024-05-16T21:32:28.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f571159a640 1 -- 172.21.15.5:0/3412439504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704032680 con 0x7f570c039c20 2024-05-16T21:32:28.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7fed308f3640 1 --2- 172.21.15.5:0/3059979362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed2c0bf930 0x7fed2c0c0390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0c0e80 tx=0x7fed2002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2604c5256e43d7a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f1803a51640 1 -- 172.21.15.5:0/1970276210 wait complete. 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 275617749 0 0) 0x7f756c003520 con 0x7f75740cba70 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 >> v2:172.21.15.5:3300/0 conn(0x7f757403d450 msgr2=0x7f75740dcf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f75809fe640 1 --2- 172.21.15.5:0/1681541399 >> v2:172.21.15.5:3300/0 conn(0x7f757403d450 0x7f75740dcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f757affd640 1 --2- 172.21.15.5:0/1681541399 >> v2:172.21.15.5:3300/0 conn(0x7f757403d450 0x7f75740dcf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 >> v1:172.21.15.5:6789/0 conn(0x7f757403c7f0 legacy=0x7f757403f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757403e160 con 0x7f75740cba70 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f757c050860 con 0x7f75740cba70 2024-05-16T21:32:28.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 >> v1:172.21.15.157:6789/0 conn(0x7f75740cba70 legacy=0x7f757403cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f756c0039b0 0x7f756c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f756c004800 0x7f756c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f756c0052b0 0x7f756c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7574040e00 con 0x7f756c0052b0 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f756c00c240 con 0x7f756c0039b0 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f756c00c440 con 0x7f756c004800 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f75809fe640 1 --2- 172.21.15.5:0/1681541399 >> v2:172.21.15.5:3300/0 conn(0x7f757403d450 0x7f75740dcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757bfff640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f756c0039b0 0x7f756c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f757b7fe640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f756c004800 0x7f756c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f75809fe640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f756c0052b0 0x7f756c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f5718d57640 1 -- 172.21.15.5:0/3412439504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c039c20 msgr2=0x7f570c0d6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f5718d57640 1 --2- 172.21.15.5:0/3412439504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c039c20 0x7f570c0d6550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f570c0d5c80 tx=0x7f570402a200 comp rx=0 tx=0).stop 2024-05-16T21:32:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f5718d57640 1 -- 172.21.15.5:0/3412439504 shutdown_connections 2024-05-16T21:32:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f5718d57640 1 --2- 172.21.15.5:0/3412439504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c039c20 0x7f570c0d6550 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f570c0d5c80 tx=0x7f570402a200 comp rx=0 tx=0).stop 2024-05-16T21:32:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f5718d57640 1 --2- 172.21.15.5:0/3412439504 >> v2:172.21.15.157:3300/0 conn(0x7f570c03c1c0 0x7f570c03cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f5718d57640 1 -- 172.21.15.5:0/3412439504 >> 172.21.15.5:0/3412439504 conn(0x7f570c03f6b0 msgr2=0x7f570c006110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7fed2b7fe640 1 -- 172.21.15.5:0/3059979362 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20037070 con 0x7fed2c0bf930 2024-05-16T21:32:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7fed2b7fe640 1 -- 172.21.15.5:0/3059979362 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2002ac50 con 0x7fed2c0bf930 2024-05-16T21:32:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7fed2b7fe640 1 -- 172.21.15.5:0/3059979362 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed24001a90 con 0x7fed2c0bf930 2024-05-16T21:32:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f771540a640 1 --2- 172.21.15.5:0/2380074897 >> v2:172.21.15.157:3300/0 conn(0x7f77100bd640 0x7f77100c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f771540a640 1 -- 172.21.15.5:0/2380074897 >> v1:172.21.15.5:6789/0 conn(0x7f771014eae0 legacy=0x7f771014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f771540a640 1 -- 172.21.15.5:0/2380074897 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77100bed60 con 0x7f77100be4a0 2024-05-16T21:32:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f7714c09640 1 --2- 172.21.15.5:0/2380074897 >> v2:172.21.15.157:3300/0 conn(0x7f77100bd640 0x7f77100c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f4240e7c640 1 -- 172.21.15.5:0/3510589381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234007740 con 0x7f423c0bb470 2024-05-16T21:32:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.117+0000 7f4240e7c640 1 -- 172.21.15.5:0/3510589381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42340078e0 con 0x7f423c0bb470 2024-05-16T21:32:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f8560fb2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f855c0c1490 0x7f855c0bd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f8560fb2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855c06de90 con 0x7f855c0be4e0 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f8559d9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f855c0c1490 0x7f855c0bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f855a59c640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f855c08d790 0x7f855c14edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:41040/0 (socket says 172.21.15.5:41040) 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f855a59c640 1 -- 172.21.15.5:0/3944445212 learned_addr learned my addr 172.21.15.5:0/3944445212 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f8560fb2640 1 -- 172.21.15.5:0/3944445212 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855c0bf050 con 0x7f855c08d790 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f8560fb2640 1 -- 172.21.15.5:0/3944445212 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f855c14e940 con 0x7f855c0c1490 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f855959a640 1 -- 172.21.15.5:0/3944445212 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4021388778 0 0) 0x7f855c0bf050 con 0x7f855c08d790 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.118+0000 7f855959a640 1 -- 172.21.15.5:0/3944445212 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8544003520 con 0x7f855c08d790 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8559d9b640 1 -- 172.21.15.5:0/3944445212 >> v1:172.21.15.157:6789/0 conn(0x7f855c08d790 legacy=0x7f855c14edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8559d9b640 1 -- 172.21.15.5:0/3944445212 >> v1:172.21.15.5:6789/0 conn(0x7f855c0be4e0 legacy=0x7f855c06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8559d9b640 1 -- 172.21.15.5:0/3944445212 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c0bed70 con 0x7f855c0c1490 2024-05-16T21:32:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f757b7fe640 1 -- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f756c0039b0 msgr2=0x7f756c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f757b7fe640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f756c0039b0 0x7f756c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f757b7fe640 1 -- 172.21.15.5:0/1681541399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f756c0052b0 msgr2=0x7f756c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f757b7fe640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f756c0052b0 0x7f756c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f757b7fe640 1 -- 172.21.15.5:0/1681541399 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757403e160 con 0x7f756c004800 2024-05-16T21:32:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f757bfff640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f756c0039b0 0x7f756c003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f75809fe640 1 -- 172.21.15.5:0/1681541399 reap_dead start 2024-05-16T21:32:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f42440e2640 1 -- 172.21.15.5:0/3510589381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0bb470 msgr2=0x7f423c1559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7fed318f5640 1 -- 172.21.15.5:0/3059979362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed2c0bf930 msgr2=0x7fed2c0c0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f42440e2640 1 --2- 172.21.15.5:0/3510589381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0bb470 0x7f423c1559d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f423c06e830 tx=0x7f423402a730 comp rx=0 tx=0).stop 2024-05-16T21:32:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7fed318f5640 1 --2- 172.21.15.5:0/3059979362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed2c0bf930 0x7fed2c0c0390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0c0e80 tx=0x7fed2002a1c0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f42440e2640 1 -- 172.21.15.5:0/3510589381 shutdown_connections 2024-05-16T21:32:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f771540a640 1 --2- 172.21.15.5:0/2380074897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77100be4a0 0x7f771008d280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f771006cd40 tx=0x7f770802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2567f367025778 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8577373640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8570146540 0x7f8570073830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8577373640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f857014c0b0 0x7f857006f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f757b7fe640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f756c004800 0x7f756c004c10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f757c02e1b0 tx=0x7f756c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58eb63e7a82bfadf server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8577373640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f8570072670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8577373640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f85700b6390 con 0x7f8570146540 2024-05-16T21:32:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f5718d57640 1 -- 172.21.15.5:0/3412439504 shutdown_connections 2024-05-16T21:32:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8577373640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f857014c900 con 0x7f857014c0b0 2024-05-16T21:32:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8559d9b640 1 --2- 172.21.15.5:0/3944445212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 0x7f855c0bd780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f85500097a0 tx=0x7f855002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950ec7e82693e580 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f7707fff640 1 -- 172.21.15.5:0/2380074897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708036070 con 0x7f77100be4a0 2024-05-16T21:32:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f5718d57640 1 -- 172.21.15.5:0/3412439504 wait complete. 2024-05-16T21:32:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c0af020 con 0x7f756c004800 2024-05-16T21:32:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757c06e390 con 0x7f756c004800 2024-05-16T21:32:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f757affd640 1 -- 172.21.15.5:0/1681541399 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c06a410 con 0x7f756c004800 2024-05-16T21:32:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8577373640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f857014cbe0 con 0x7f8570072260 2024-05-16T21:32:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f7707fff640 1 -- 172.21.15.5:0/2380074897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770802ae50 con 0x7f77100be4a0 2024-05-16T21:32:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f7707fff640 1 -- 172.21.15.5:0/2380074897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708031860 con 0x7f77100be4a0 2024-05-16T21:32:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f1803a51640 1 Processor -- start 2024-05-16T21:32:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f8576371640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8570146540 0x7f8570073830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8576371640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8570146540 0x7f8570073830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57668/0 (socket says 172.21.15.5:57668) 2024-05-16T21:32:28.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8576371640 1 -- 172.21.15.5:0/4117859944 learned_addr learned my addr 172.21.15.5:0/4117859944 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f42440e2640 1 --2- 172.21.15.5:0/3510589381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0bb470 0x7f423c1559d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f42440e2640 1 --2- 172.21.15.5:0/3510589381 >> v2:172.21.15.157:3300/0 conn(0x7f423c1455f0 0x7f423c14ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.119+0000 7f42440e2640 1 -- 172.21.15.5:0/3510589381 >> 172.21.15.5:0/3510589381 conn(0x7f423c0bd160 msgr2=0x7f423c0bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f1803a51640 1 -- start start 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8575b70640 1 --2- 172.21.15.5:0/4117859944 >> v2:172.21.15.157:3300/0 conn(0x7f857014c0b0 0x7f857006f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8576b72640 1 --2- 172.21.15.5:0/4117859944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f8570072670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8576b72640 1 -- 172.21.15.5:0/4117859944 >> v2:172.21.15.157:3300/0 conn(0x7f857014c0b0 msgr2=0x7f857006f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8576b72640 1 --2- 172.21.15.5:0/4117859944 >> v2:172.21.15.157:3300/0 conn(0x7f857014c0b0 0x7f857006f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8576b72640 1 -- 172.21.15.5:0/4117859944 >> v2:172.21.15.5:3300/0 conn(0x7f8570146540 msgr2=0x7f8570073830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8576b72640 1 --2- 172.21.15.5:0/4117859944 >> v2:172.21.15.5:3300/0 conn(0x7f8570146540 0x7f8570073830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f8576b72640 1 -- 172.21.15.5:0/4117859944 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857014cec0 con 0x7f8570072260 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f855959a640 1 -- 172.21.15.5:0/3944445212 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550037070 con 0x7f855c0c1490 2024-05-16T21:32:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f855959a640 1 -- 172.21.15.5:0/3944445212 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855002adb0 con 0x7f855c0c1490 2024-05-16T21:32:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.120+0000 7f855959a640 1 -- 172.21.15.5:0/3944445212 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550032660 con 0x7f855c0c1490 2024-05-16T21:32:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7fed318f5640 1 -- 172.21.15.5:0/3059979362 shutdown_connections 2024-05-16T21:32:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7fed318f5640 1 --2- 172.21.15.5:0/3059979362 >> v2:172.21.15.5:3300/0 conn(0x7fed2c14c4e0 0x7fed2c14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7fed318f5640 1 --2- 172.21.15.5:0/3059979362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed2c0bf930 0x7fed2c0c0390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7fed318f5640 1 -- 172.21.15.5:0/3059979362 >> 172.21.15.5:0/3059979362 conn(0x7fed2c073ff0 msgr2=0x7fed2c074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f771766e640 1 -- 172.21.15.5:0/2380074897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77100be4a0 msgr2=0x7f771008d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f771766e640 1 --2- 172.21.15.5:0/2380074897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77100be4a0 0x7f771008d280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f771006cd40 tx=0x7f770802a630 comp rx=0 tx=0).stop 2024-05-16T21:32:28.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f42440e2640 1 -- 172.21.15.5:0/3510589381 shutdown_connections 2024-05-16T21:32:28.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f42440e2640 1 -- 172.21.15.5:0/3510589381 wait complete. 2024-05-16T21:32:28.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7fed318f5640 1 -- 172.21.15.5:0/3059979362 shutdown_connections 2024-05-16T21:32:28.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f771766e640 1 -- 172.21.15.5:0/2380074897 shutdown_connections 2024-05-16T21:32:28.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f771766e640 1 --2- 172.21.15.5:0/2380074897 >> v2:172.21.15.157:3300/0 conn(0x7f77100bd640 0x7f77100c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f771766e640 1 --2- 172.21.15.5:0/2380074897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77100be4a0 0x7f771008d280 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f771766e640 1 -- 172.21.15.5:0/2380074897 >> 172.21.15.5:0/2380074897 conn(0x7f77100c3db0 msgr2=0x7f77100c0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f7582461640 1 -- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f756c004800 msgr2=0x7f756c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f7582461640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f756c004800 0x7f756c004c10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f757c02e1b0 tx=0x7f756c005830 comp rx=0 tx=0).stop 2024-05-16T21:32:28.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f8576b72640 1 --2- 172.21.15.5:0/4117859944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f8570072670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85700b9a20 tx=0x7f856c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3446517b9806791e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7fed318f5640 1 -- 172.21.15.5:0/3059979362 wait complete. 2024-05-16T21:32:28.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f7582461640 1 -- 172.21.15.5:0/1681541399 shutdown_connections 2024-05-16T21:32:28.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f7582461640 1 --2- 172.21.15.5:0/1681541399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f756c004800 0x7f756c004c10 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f757c02e1b0 tx=0x7f756c005830 comp rx=0 tx=0).stop 2024-05-16T21:32:28.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f7582461640 1 -- 172.21.15.5:0/1681541399 >> 172.21.15.5:0/1681541399 conn(0x7f7574043880 msgr2=0x7f7574043c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f771766e640 1 -- 172.21.15.5:0/2380074897 shutdown_connections 2024-05-16T21:32:28.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f771766e640 1 -- 172.21.15.5:0/2380074897 wait complete. 2024-05-16T21:32:28.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f8560fb2640 1 -- 172.21.15.5:0/3944445212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 msgr2=0x7f855c0bd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f8560fb2640 1 --2- 172.21.15.5:0/3944445212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 0x7f855c0bd780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f85500097a0 tx=0x7f855002a060 comp rx=0 tx=0).stop 2024-05-16T21:32:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.121+0000 7f7582461640 1 -- 172.21.15.5:0/1681541399 shutdown_connections 2024-05-16T21:32:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f7582461640 1 -- 172.21.15.5:0/1681541399 wait complete. 2024-05-16T21:32:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f8560fb2640 1 -- 172.21.15.5:0/3944445212 shutdown_connections 2024-05-16T21:32:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f8560fb2640 1 --2- 172.21.15.5:0/3944445212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 0x7f855c0bd780 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f8560fb2640 1 -- 172.21.15.5:0/3944445212 >> 172.21.15.5:0/3944445212 conn(0x7f855c0c3ab0 msgr2=0x7f855c0c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f8560fb2640 1 -- 172.21.15.5:0/3944445212 shutdown_connections 2024-05-16T21:32:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f8560fb2640 1 -- 172.21.15.5:0/3944445212 wait complete. 2024-05-16T21:32:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f1803a51640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17fc074690 0x7f17fc0b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f857536f640 1 -- 172.21.15.5:0/4117859944 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c037070 con 0x7f8570072260 2024-05-16T21:32:28.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f1803a51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f1803a51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 0x7f17fc148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f857536f640 1 -- 172.21.15.5:0/4117859944 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856c02add0 con 0x7f8570072260 2024-05-16T21:32:28.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f857536f640 1 -- 172.21.15.5:0/4117859944 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c032660 con 0x7f8570072260 2024-05-16T21:32:28.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f5718d57640 1 Processor -- start 2024-05-16T21:32:28.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.122+0000 7f18017ed640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17fc074690 0x7f17fc0b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.123+0000 7f18017ed640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17fc074690 0x7f17fc0b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40950/0 (socket says 172.21.15.5:40950) 2024-05-16T21:32:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.123+0000 7f18017ed640 1 -- 172.21.15.5:0/2584374129 learned_addr learned my addr 172.21.15.5:0/2584374129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.123+0000 7f1801fee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 0x7f17fc148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.123+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc0725b0 con 0x7f17fc0bca20 2024-05-16T21:32:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.123+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc0b50e0 con 0x7f17fc074690 2024-05-16T21:32:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.123+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f17fc0b4420 con 0x7f17fc0bc610 2024-05-16T21:32:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.123+0000 7f5718d57640 1 -- start start 2024-05-16T21:32:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.123+0000 7fed318f5640 1 Processor -- start 2024-05-16T21:32:28.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7fed318f5640 1 -- start start 2024-05-16T21:32:28.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f1800fec640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f42440e2640 1 Processor -- start 2024-05-16T21:32:28.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f771766e640 1 Processor -- start 2024-05-16T21:32:28.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f42440e2640 1 -- start start 2024-05-16T21:32:28.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f8577373640 1 -- 172.21.15.5:0/4117859944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 msgr2=0x7f8570072670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f8577373640 1 --2- 172.21.15.5:0/4117859944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f8570072670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85700b9a20 tx=0x7f856c02a080 comp rx=0 tx=0).stop 2024-05-16T21:32:28.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f18017ed640 1 -- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 msgr2=0x7f17fc0b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f7582461640 1 Processor -- start 2024-05-16T21:32:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f18017ed640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc0b7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f18017ed640 1 -- 172.21.15.5:0/2584374129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 msgr2=0x7f17fc148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f18017ed640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 0x7f17fc148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f18017ed640 1 -- 172.21.15.5:0/2584374129 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc0b96f0 con 0x7f17fc074690 2024-05-16T21:32:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f771766e640 1 -- start start 2024-05-16T21:32:28.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f7582461640 1 -- start start 2024-05-16T21:32:28.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f18017ed640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17fc074690 0x7f17fc0b91b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c7f0 tx=0x7f17ec00ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.124+0000 7f1801fee640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 0x7f17fc148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:28.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f17f1ffb640 1 -- 172.21.15.5:0/2584374129 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec015070 con 0x7f17fc074690 2024-05-16T21:32:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f17f1ffb640 1 -- 172.21.15.5:0/2584374129 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec007820 con 0x7f17fc074690 2024-05-16T21:32:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8577373640 1 -- 172.21.15.5:0/4117859944 shutdown_connections 2024-05-16T21:32:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8577373640 1 --2- 172.21.15.5:0/4117859944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f8570072670 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8577373640 1 --2- 172.21.15.5:0/4117859944 >> v2:172.21.15.157:3300/0 conn(0x7f857014c0b0 0x7f857006f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8577373640 1 --2- 172.21.15.5:0/4117859944 >> v2:172.21.15.5:3300/0 conn(0x7f8570146540 0x7f8570073830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8577373640 1 -- 172.21.15.5:0/4117859944 >> 172.21.15.5:0/4117859944 conn(0x7f857006c8c0 msgr2=0x7f857006ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8560fb2640 1 Processor -- start 2024-05-16T21:32:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8560fb2640 1 -- start start 2024-05-16T21:32:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f5718d57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c03c1c0 0x7f570c1611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f5718d57640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f570c0cfb00 0x7f570c0d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f5718d57640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f570c0d89d0 0x7f570c16f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5718d57640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f570c0d0090 con 0x7f570c03c1c0 2024-05-16T21:32:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5718d57640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f570c0cff10 con 0x7f570c0d89d0 2024-05-16T21:32:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f771766e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77100bd640 0x7f7710141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f771766e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77100be4a0 0x7f77100a7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f771766e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771014eae0 0x7f77100a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f42440e2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f423c0bb060 0x7f423c145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5718d57640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f570c0d0210 con 0x7f570c0cfb00 2024-05-16T21:32:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5712d9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f570c0d89d0 0x7f570c16f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5712d9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f570c0d89d0 0x7f570c16f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:40964/0 (socket says 172.21.15.5:40964) 2024-05-16T21:32:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5712d9d640 1 -- 172.21.15.5:0/1120542733 learned_addr learned my addr 172.21.15.5:0/1120542733 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f42440e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f423c0bb470 0x7f423c143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7fed318f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c0bac00 0x7fed2c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f42440e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c1455f0 0x7f423c1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f42440e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f423c073120 con 0x7f423c1455f0 2024-05-16T21:32:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5711d9b640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f570c0cfb00 0x7f570c0d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f42440e2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f423c14f4a0 con 0x7f423c0bb060 2024-05-16T21:32:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f17f1ffb640 1 -- 172.21.15.5:0/2584374129 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec007bf0 con 0x7f17fc074690 2024-05-16T21:32:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f7715c0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771014eae0 0x7f77100a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f7715c0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771014eae0 0x7f77100a7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57690/0 (socket says 172.21.15.5:57690) 2024-05-16T21:32:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f42440e2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f423c0a4a80 con 0x7f423c0bb470 2024-05-16T21:32:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f771540a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77100bd640 0x7f7710141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc1e8e70 con 0x7f17fc074690 2024-05-16T21:32:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f7715c0b640 1 -- 172.21.15.5:0/1736948987 learned_addr learned my addr 172.21.15.5:0/1736948987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8577373640 1 -- 172.21.15.5:0/4117859944 shutdown_connections 2024-05-16T21:32:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.125+0000 7f8577373640 1 -- 172.21.15.5:0/4117859944 wait complete. 2024-05-16T21:32:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7fed318f5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed2c0bf930 0x7fed2c06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7fed318f5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed2c14c4e0 0x7fed2c147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7fed318f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c0bb720 con 0x7fed2c0bac00 2024-05-16T21:32:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7fed318f5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c0c0ae0 con 0x7fed2c0bf930 2024-05-16T21:32:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7fed318f5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fed2c0bb8a0 con 0x7fed2c14c4e0 2024-05-16T21:32:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77100c0e50 con 0x7f771014eae0 2024-05-16T21:32:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f77100bf040 con 0x7f77100be4a0 2024-05-16T21:32:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f77100c0fd0 con 0x7f77100bd640 2024-05-16T21:32:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5712d9d640 1 -- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f570c0cfb00 msgr2=0x7f570c0d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5712d9d640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f570c0cfb00 0x7f570c0d7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5712d9d640 1 -- 172.21.15.5:0/1120542733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c03c1c0 msgr2=0x7f570c1611f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-16T21:32:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5712d9d640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c03c1c0 0x7f570c1611f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f5712d9d640 1 -- 172.21.15.5:0/1120542733 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c161730 con 0x7f570c0d89d0 2024-05-16T21:32:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7fed308f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c0bac00 0x7fed2c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f424267f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c1455f0 0x7f423c1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f7582461640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75740cc190 0x7f757416ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.126+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc1e90f0 con 0x7f17fc074690 2024-05-16T21:32:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7fed308f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c0bac00 0x7fed2c14e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57718/0 (socket says 172.21.15.5:57718) 2024-05-16T21:32:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7fed308f3640 1 -- 172.21.15.5:0/3675935649 learned_addr learned my addr 172.21.15.5:0/3675935649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f424267f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c1455f0 0x7f423c1444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57706/0 (socket says 172.21.15.5:57706) 2024-05-16T21:32:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f424267f640 1 -- 172.21.15.5:0/4169831893 learned_addr learned my addr 172.21.15.5:0/4169831893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f7582461640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757415cc00 0x7f757415d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f424167d640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f423c0bb470 0x7f423c143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f7582461640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7574167870 0x7f7574167c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f5712d9d640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f570c0d89d0 0x7f570c16f420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f57140770f0 tx=0x7f571406ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f7582461640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f757403cd40 con 0x7f757415cc00 2024-05-16T21:32:28.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f7582461640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f757403da70 con 0x7f75740cc190 2024-05-16T21:32:28.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f75809fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7574167870 0x7f7574167c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f75809fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7574167870 0x7f7574167c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51152/0 (socket says 172.21.15.5:51152) 2024-05-16T21:32:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f75809fe640 1 -- 172.21.15.5:0/663284601 learned_addr learned my addr 172.21.15.5:0/663284601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f5702ffd640 1 -- 172.21.15.5:0/1120542733 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57140766a0 con 0x7f570c0d89d0 2024-05-16T21:32:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7fed310f4640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed2c14c4e0 0x7fed2c147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7fed308f3640 1 -- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed2c14c4e0 msgr2=0x7fed2c147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7fed308f3640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed2c14c4e0 0x7fed2c147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f757403cec0 con 0x7f7574167870 2024-05-16T21:32:28.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f5702ffd640 1 -- 172.21.15.5:0/1120542733 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714090070 con 0x7f570c0d89d0 2024-05-16T21:32:28.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7fed308f3640 1 -- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed2c0bf930 msgr2=0x7fed2c06fbe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-16T21:32:28.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7fed308f3640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed2c0bf930 0x7fed2c06fbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f757bfff640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75740cc190 0x7f757416ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f5718d57640 1 -- 172.21.15.5:0/1120542733 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570c0d7f50 con 0x7f570c0d89d0 2024-05-16T21:32:28.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7fed308f3640 1 -- 172.21.15.5:0/3675935649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c070120 con 0x7fed2c0bac00 2024-05-16T21:32:28.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f5718d57640 1 -- 172.21.15.5:0/1120542733 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570c0d9880 con 0x7f570c0d89d0 2024-05-16T21:32:28.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f424267f640 1 -- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f423c0bb470 msgr2=0x7f423c143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.127+0000 7f5702ffd640 1 -- 172.21.15.5:0/1120542733 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714095470 con 0x7f570c0d89d0 2024-05-16T21:32:28.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f424267f640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f423c0bb470 0x7f423c143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f424267f640 1 -- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f423c0bb060 msgr2=0x7f423c145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8560fb2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f855c08d790 0x7f855c143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7fed308f3640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c0bac00 0x7fed2c14e9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fed20009890 tx=0x7fed200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f424267f640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f423c0bb060 0x7f423c145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8577373640 1 Processor -- start 2024-05-16T21:32:28.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8560fb2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855c0be4e0 0x7f855c1e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8577373640 1 -- start start 2024-05-16T21:32:28.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f75809fe640 1 -- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75740cc190 msgr2=0x7f757416ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f75809fe640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75740cc190 0x7f757416ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f75809fe640 1 -- 172.21.15.5:0/663284601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757415cc00 msgr2=0x7f757415d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f75809fe640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757415cc00 0x7f757415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f75809fe640 1 -- 172.21.15.5:0/663284601 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75740cc9d0 con 0x7f7574167870 2024-05-16T21:32:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f855a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f855c08d790 0x7f855c143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f855a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f855c08d790 0x7f855c143c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51160/0 (socket says 172.21.15.5:51160) 2024-05-16T21:32:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f75809fe640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7574167870 0x7f7574167c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f757403ec00 tx=0x7f756800e890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8559d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855c0be4e0 0x7f855c1e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8559d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855c0be4e0 0x7f855c1e4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57736/0 (socket says 172.21.15.5:57736) 2024-05-16T21:32:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f855a59c640 1 -- 172.21.15.5:0/2682365062 learned_addr learned my addr 172.21.15.5:0/2682365062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7fed297fa640 1 -- 172.21.15.5:0/3675935649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20037040 con 0x7fed2c0bac00 2024-05-16T21:32:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8560fb2640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 0x7f855c0b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f7578ff9640 1 -- 172.21.15.5:0/663284601 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568004240 con 0x7f7574167870 2024-05-16T21:32:28.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f855c0bea70 con 0x7f855c0be4e0 2024-05-16T21:32:28.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c072230 con 0x7fed2c0bac00 2024-05-16T21:32:28.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f855c0be8f0 con 0x7f855c0c1490 2024-05-16T21:32:28.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f7578ff9640 1 -- 172.21.15.5:0/663284601 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7568019070 con 0x7f7574167870 2024-05-16T21:32:28.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.129+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c1524d0 con 0x7fed2c0bac00 2024-05-16T21:32:28.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.129+0000 7f855ad9d640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 0x7f855c0b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.129+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f855c159c70 con 0x7f855c08d790 2024-05-16T21:32:28.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.129+0000 7fed297fa640 1 -- 172.21.15.5:0/3675935649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed20004030 con 0x7fed2c0bac00 2024-05-16T21:32:28.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.129+0000 7f424267f640 1 -- 172.21.15.5:0/4169831893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c1461a0 con 0x7f423c1455f0 2024-05-16T21:32:28.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.128+0000 7f17df7fe640 1 -- 172.21.15.5:0/2584374129 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d8005290 con 0x7f17fc074690 2024-05-16T21:32:28.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.129+0000 7f424267f640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c1455f0 0x7f423c1444a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4234009e50 tx=0x7f4234004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7578ff9640 1 -- 172.21.15.5:0/663284601 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568003610 con 0x7f7574167870 2024-05-16T21:32:28.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75740d2090 con 0x7f7574167870 2024-05-16T21:32:28.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75740cecd0 con 0x7f7574167870 2024-05-16T21:32:28.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f17f1ffb640 1 -- 172.21.15.5:0/2584374129 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f17ec018070 con 0x7f17fc074690 2024-05-16T21:32:28.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f17f1ffb640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f17e00763a0 0x7f17e00788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f5702ffd640 1 -- 172.21.15.5:0/1120542733 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5714095610 con 0x7f570c0d89d0 2024-05-16T21:32:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f5702ffd640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f56f40762d0 0x7f56f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f5702ffd640 1 -- 172.21.15.5:0/1120542733 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5714113e10 con 0x7f570c0d89d0 2024-05-16T21:32:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f571259c640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f56f40762d0 0x7f56f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8577373640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f85700be400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8577373640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8570146540 0x7f857013b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8577373640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f857014c0b0 0x7f857013baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8577373640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f857014c640 con 0x7f8570146540 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8577373640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f857014c4c0 con 0x7f857014c0b0 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8577373640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f857006fbd0 con 0x7f8570072260 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8575b70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8570146540 0x7f857013b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8576371640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f85700be400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8575b70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8570146540 0x7f857013b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57742/0 (socket says 172.21.15.5:57742) 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8575b70640 1 -- 172.21.15.5:0/3901565772 learned_addr learned my addr 172.21.15.5:0/3901565772 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f8576b72640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f857014c0b0 0x7f857013baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f8575b70640 1 -- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 msgr2=0x7f85700be400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f8575b70640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f85700be400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f8575b70640 1 -- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f857014c0b0 msgr2=0x7f857013baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f8575b70640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f857014c0b0 0x7f857013baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f8575b70640 1 -- 172.21.15.5:0/3901565772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85700b6be0 con 0x7f8570146540 2024-05-16T21:32:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7fed297fa640 1 -- 172.21.15.5:0/3675935649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20004400 con 0x7fed2c0bac00 2024-05-16T21:32:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.129+0000 7f7714c09640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77100be4a0 0x7f77100a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7714c09640 1 -- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77100bd640 msgr2=0x7f7710141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7714c09640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77100bd640 0x7f7710141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7714c09640 1 -- 172.21.15.5:0/1736948987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771014eae0 msgr2=0x7f77100a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7714c09640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771014eae0 0x7f77100a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7714c09640 1 -- 172.21.15.5:0/1736948987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7710141960 con 0x7f77100be4a0 2024-05-16T21:32:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f7715c0b640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771014eae0 0x7f77100a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f7714c09640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77100be4a0 0x7f77100a7720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c5e0 tx=0x7f770c00caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8559d9b640 1 -- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f855c08d790 msgr2=0x7f855c143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8559d9b640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f855c08d790 0x7f855c143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8559d9b640 1 -- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 msgr2=0x7f855c0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8559d9b640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 0x7f855c0b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7f8559d9b640 1 -- 172.21.15.5:0/2682365062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c144150 con 0x7f855c0be4e0 2024-05-16T21:32:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f8559d9b640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855c0be4e0 0x7f855c1e4200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8550031000 tx=0x7f85500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f1800fec640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f17e00763a0 0x7f17e00788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f17f1ffb640 1 -- 172.21.15.5:0/2584374129 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f17ec0975a0 con 0x7f17fc074690 2024-05-16T21:32:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f8575b70640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8570146540 0x7f857013b5b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f856800efc0 tx=0x7f856800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.130+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed0c005290 con 0x7fed2c0bac00 2024-05-16T21:32:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f771540a640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77100bd640 0x7f7710141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f8566ffd640 1 -- 172.21.15.5:0/3901565772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568018020 con 0x7f8570146540 2024-05-16T21:32:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85700be940 con 0x7f8570146540 2024-05-16T21:32:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f857013ce40 con 0x7f8570146540 2024-05-16T21:32:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f854affd640 1 -- 172.21.15.5:0/2682365062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550041070 con 0x7f855c0be4e0 2024-05-16T21:32:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c1e4740 con 0x7f855c0be4e0 2024-05-16T21:32:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c1e7700 con 0x7f855c0be4e0 2024-05-16T21:32:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75740cd5e0 con 0x7f7574167870 2024-05-16T21:32:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f5700ff9640 1 -- 172.21.15.5:0/1120542733 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570c006650 con 0x7f570c0d89d0 2024-05-16T21:32:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f1800fec640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f17e00763a0 0x7f17e00788b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0b7410 tx=0x7f17f400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f42327fc640 1 -- 172.21.15.5:0/4169831893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423403b610 con 0x7f423c1455f0 2024-05-16T21:32:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.131+0000 7f42327fc640 1 -- 172.21.15.5:0/4169831893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4234043070 con 0x7f423c1455f0 2024-05-16T21:32:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f42327fc640 1 -- 172.21.15.5:0/4169831893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423403b9b0 con 0x7f423c1455f0 2024-05-16T21:32:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423c1449e0 con 0x7f423c1455f0 2024-05-16T21:32:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.132+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423c1488a0 con 0x7f423c1455f0 2024-05-16T21:32:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7fed297fa640 1 -- 172.21.15.5:0/3675935649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fed20003610 con 0x7fed2c0bac00 2024-05-16T21:32:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7f7578ff9640 1 -- 172.21.15.5:0/663284601 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75680037b0 con 0x7f7574167870 2024-05-16T21:32:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7f571259c640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f56f40762d0 0x7f56f40787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f570800a810 tx=0x7f5708008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7fed297fa640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fed100763a0 0x7fed100788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85700bbc40 con 0x7f8570146540 2024-05-16T21:32:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7fed297fa640 1 -- 172.21.15.5:0/3675935649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fed200b8950 con 0x7fed2c0bac00 2024-05-16T21:32:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423c069b50 con 0x7f423c1455f0 2024-05-16T21:32:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7fed2bfff640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fed100763a0 0x7fed100788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.133+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c050860 con 0x7f855c0be4e0 2024-05-16T21:32:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.134+0000 7f7578ff9640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f75600763d0 0x7f75600788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.134+0000 7f7578ff9640 1 -- 172.21.15.5:0/663284601 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f75680970d0 con 0x7f7574167870 2024-05-16T21:32:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.134+0000 7f757bfff640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f75600763d0 0x7f75600788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.134+0000 7fed2bfff640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fed100763a0 0x7fed100788b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed18006fd0 tx=0x7fed18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.134+0000 7f757bfff640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f75600763d0 0x7f75600788e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7574042950 tx=0x7f7570009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.136+0000 7f7705ffb640 1 -- 172.21.15.5:0/1736948987 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c015070 con 0x7f77100be4a0 2024-05-16T21:32:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.136+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77100a9120 con 0x7f77100be4a0 2024-05-16T21:32:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.136+0000 7f17f1ffb640 1 -- 172.21.15.5:0/2584374129 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f17fc1e8e70 con 0x7f17fc074690 2024-05-16T21:32:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.137+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77100b9c60 con 0x7f77100be4a0 2024-05-16T21:32:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.138+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771006e3b0 con 0x7f77100be4a0 2024-05-16T21:32:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.138+0000 7f8566ffd640 1 -- 172.21.15.5:0/3901565772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8568014480 con 0x7f8570146540 2024-05-16T21:32:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.138+0000 7f854affd640 1 -- 172.21.15.5:0/2682365062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855002adb0 con 0x7f855c0be4e0 2024-05-16T21:32:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.138+0000 7f854affd640 1 -- 172.21.15.5:0/2682365062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855004b060 con 0x7f855c0be4e0 2024-05-16T21:32:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.138+0000 7f8566ffd640 1 -- 172.21.15.5:0/3901565772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568014830 con 0x7f8570146540 2024-05-16T21:32:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.138+0000 7fed297fa640 1 -- 172.21.15.5:0/3675935649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fed20082320 con 0x7fed2c0bac00 2024-05-16T21:32:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.139+0000 7f7578ff9640 1 -- 172.21.15.5:0/663284601 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7568060ad0 con 0x7f7574167870 2024-05-16T21:32:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.140+0000 7f42327fc640 1 -- 172.21.15.5:0/4169831893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f423403bb50 con 0x7f423c1455f0 2024-05-16T21:32:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.141+0000 7f42327fc640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4220076320 0x7f4220078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.141+0000 7f854affd640 1 -- 172.21.15.5:0/2682365062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8550044070 con 0x7f855c0be4e0 2024-05-16T21:32:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.141+0000 7f42327fc640 1 -- 172.21.15.5:0/4169831893 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f423407e770 con 0x7f423c1455f0 2024-05-16T21:32:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.141+0000 7f5702ffd640 1 -- 172.21.15.5:0/1120542733 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f57140dd6d0 con 0x7f570c0d89d0 2024-05-16T21:32:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f8566ffd640 1 -- 172.21.15.5:0/3901565772 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8568005d10 con 0x7f8570146540 2024-05-16T21:32:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f7705ffb640 1 -- 172.21.15.5:0/1736948987 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c011800 con 0x7f77100be4a0 2024-05-16T21:32:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f7705ffb640 1 -- 172.21.15.5:0/1736948987 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c01f060 con 0x7f77100be4a0 2024-05-16T21:32:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f854affd640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f853c0762d0 0x7f853c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f4241e7e640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4220076320 0x7f4220078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f854affd640 1 -- 172.21.15.5:0/2682365062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85500b83a0 con 0x7f855c0be4e0 2024-05-16T21:32:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f8566ffd640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85540762d0 0x7f85540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f855a59c640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f853c0762d0 0x7f853c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.142+0000 7f8566ffd640 1 -- 172.21.15.5:0/3901565772 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8568098be0 con 0x7f8570146540 2024-05-16T21:32:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.143+0000 7f8576371640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85540762d0 0x7f85540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.143+0000 7f4241e7e640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4220076320 0x7f4220078830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f422c009650 tx=0x7f422c006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.144+0000 7f8576371640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85540762d0 0x7f85540787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8560006cc0 tx=0x7f8560009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.144+0000 7f855a59c640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f853c0762d0 0x7f853c0787e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8554005c00 tx=0x7f8554009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.145+0000 7f7705ffb640 1 -- 172.21.15.5:0/1736948987 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f770c018070 con 0x7f77100be4a0 2024-05-16T21:32:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.145+0000 7f7705ffb640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f76f40762d0 0x7f76f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.145+0000 7f7705ffb640 1 -- 172.21.15.5:0/1736948987 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f770c0977b0 con 0x7f77100be4a0 2024-05-16T21:32:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.145+0000 7f771540a640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f76f40762d0 0x7f76f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.146+0000 7f771540a640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f76f40762d0 0x7f76f40787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7708033000 tx=0x7f7708009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.147+0000 7f7705ffb640 1 -- 172.21.15.5:0/1736948987 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f771006e3b0 con 0x7f77100be4a0 2024-05-16T21:32:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.147+0000 7f42327fc640 1 -- 172.21.15.5:0/4169831893 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4234082be0 con 0x7f423c1455f0 2024-05-16T21:32:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.152+0000 7f854affd640 1 -- 172.21.15.5:0/2682365062 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f855c06de90 con 0x7f855c0be4e0 2024-05-16T21:32:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.162+0000 7f8566ffd640 1 -- 172.21.15.5:0/3901565772 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8568022070 con 0x7f8570146540 2024-05-16T21:32:28.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.580+0000 7f17df7fe640 1 -- 172.21.15.5:0/2584374129 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f17d8005580 con 0x7f17fc074690 2024-05-16T21:32:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.581+0000 7f17f1ffb640 1 -- 172.21.15.5:0/2584374129 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f17ec0608a0 con 0x7f17fc074690 2024-05-16T21:32:28.583 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-05-16T21:32:28.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.585+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f17e00763a0 msgr2=0x7f17e00788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.585+0000 7f1803a51640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f17e00763a0 0x7f17e00788b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0b7410 tx=0x7f17f400b040 comp rx=0 tx=0).stop 2024-05-16T21:32:28.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.585+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17fc074690 msgr2=0x7f17fc0b91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.585+0000 7f1803a51640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17fc074690 0x7f17fc0b91b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c7f0 tx=0x7f17ec00ccb0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.585+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 shutdown_connections 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.585+0000 7f1803a51640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f17e00763a0 0x7f17e00788b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.586+0000 7f1803a51640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17fc0bca20 0x7f17fc148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.586+0000 7f1803a51640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17fc0bc610 0x7f17fc0b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.586+0000 7f1803a51640 1 --2- 172.21.15.5:0/2584374129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17fc074690 0x7f17fc0b91b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.586+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 >> 172.21.15.5:0/2584374129 conn(0x7f17fc0c0060 msgr2=0x7f17fc073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.586+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 shutdown_connections 2024-05-16T21:32:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.586+0000 7f1803a51640 1 -- 172.21.15.5:0/2584374129 wait complete. 2024-05-16T21:32:28.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.592+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fed0c005850 con 0x7fed2c0bac00 2024-05-16T21:32:28.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.593+0000 7fed297fa640 1 -- 172.21.15.5:0/3675935649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed20081c20 con 0x7fed2c0bac00 2024-05-16T21:32:28.594 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-05-16T21:32:28.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.594+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7574005490 con 0x7f7574167870 2024-05-16T21:32:28.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.595+0000 7f7578ff9640 1 -- 172.21.15.5:0/663284601 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f75680603d0 con 0x7f7574167870 2024-05-16T21:32:28.596 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-05-16T21:32:28.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.595+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f423c050940 con 0x7f423c1455f0 2024-05-16T21:32:28.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.596+0000 7f42327fc640 1 -- 172.21.15.5:0/4169831893 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4234082be0 con 0x7f423c1455f0 2024-05-16T21:32:28.597 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:28.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.596+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fed100763a0 msgr2=0x7fed100788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.596+0000 7fed318f5640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fed100763a0 0x7fed100788b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed18006fd0 tx=0x7fed18008040 comp rx=0 tx=0).stop 2024-05-16T21:32:28.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.597+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c0bac00 msgr2=0x7fed2c14e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.597+0000 7f5700ff9640 1 -- 172.21.15.5:0/1120542733 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f570c03be70 con 0x7f570c0d89d0 2024-05-16T21:32:28.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.597+0000 7fed318f5640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c0bac00 0x7fed2c14e9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fed20009890 tx=0x7fed200046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.597+0000 7f5702ffd640 1 -- 172.21.15.5:0/1120542733 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f57140dcfd0 con 0x7f570c0d89d0 2024-05-16T21:32:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.597+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 shutdown_connections 2024-05-16T21:32:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7fed318f5640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fed100763a0 0x7fed100788b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7fed318f5640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed2c14c4e0 0x7fed2c147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7fed318f5640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed2c0bf930 0x7fed2c06fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7fed318f5640 1 --2- 172.21.15.5:0/3675935649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c0bac00 0x7fed2c14e9c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 >> 172.21.15.5:0/3675935649 conn(0x7fed2c073ff0 msgr2=0x7fed2c0bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.600 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:28.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 shutdown_connections 2024-05-16T21:32:28.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7fed318f5640 1 -- 172.21.15.5:0/3675935649 wait complete. 2024-05-16T21:32:28.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f75600763d0 msgr2=0x7f75600788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.598+0000 7f7582461640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f75600763d0 0x7f75600788e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7574042950 tx=0x7f7570009040 comp rx=0 tx=0).stop 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7574167870 msgr2=0x7f7574167c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7574167870 0x7f7574167c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f757403ec00 tx=0x7f756800e890 comp rx=0 tx=0).stop 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 shutdown_connections 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f75600763d0 0x7f75600788e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7574167870 0x7f7574167c80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757415cc00 0x7f757415d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 --2- 172.21.15.5:0/663284601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75740cc190 0x7f757416ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 >> 172.21.15.5:0/663284601 conn(0x7f7574043880 msgr2=0x7f75740056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 shutdown_connections 2024-05-16T21:32:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f7582461640 1 -- 172.21.15.5:0/663284601 wait complete. 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4220076320 msgr2=0x7f4220078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.599+0000 7f42440e2640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4220076320 0x7f4220078830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f422c009650 tx=0x7f422c006ba0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c1455f0 msgr2=0x7f423c1444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c1455f0 0x7f423c1444a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4234009e50 tx=0x7f4234004a40 comp rx=0 tx=0).stop 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 shutdown_connections 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4220076320 0x7f4220078830 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f422c009650 tx=0x7f422c006ba0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c1455f0 0x7f423c1444a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f423c0bb470 0x7f423c143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 --2- 172.21.15.5:0/4169831893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f423c0bb060 0x7f423c145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 >> 172.21.15.5:0/4169831893 conn(0x7f423c0bd160 msgr2=0x7f423c073b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 shutdown_connections 2024-05-16T21:32:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.600+0000 7f42440e2640 1 -- 172.21.15.5:0/4169831893 wait complete. 2024-05-16T21:32:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.601+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f855c0bce30 con 0x7f855c0be4e0 2024-05-16T21:32:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 -- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f56f40762d0 msgr2=0x7f56f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f56f40762d0 0x7f56f40787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f570800a810 tx=0x7f5708008040 comp rx=0 tx=0).stop 2024-05-16T21:32:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 -- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f570c0d89d0 msgr2=0x7f570c16f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f570c0d89d0 0x7f570c16f420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f57140770f0 tx=0x7f571406ec40 comp rx=0 tx=0).stop 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7710050860 con 0x7f77100be4a0 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f854affd640 1 -- 172.21.15.5:0/2682365062 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8550081600 con 0x7f855c0be4e0 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 -- 172.21.15.5:0/1120542733 shutdown_connections 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f56f40762d0 0x7f56f40787e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f570c0d89d0 0x7f570c16f420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f570c0cfb00 0x7f570c0d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 --2- 172.21.15.5:0/1120542733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c03c1c0 0x7f570c1611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 -- 172.21.15.5:0/1120542733 >> 172.21.15.5:0/1120542733 conn(0x7f570c03f6b0 msgr2=0x7f570c0c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f5700ff9640 1 -- 172.21.15.5:0/1120542733 shutdown_connections 2024-05-16T21:32:28.606 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.603+0000 7f5700ff9640 1 -- 172.21.15.5:0/1120542733 wait complete. 2024-05-16T21:32:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.602+0000 7f7705ffb640 1 -- 172.21.15.5:0/1736948987 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f770c0611b0 con 0x7f77100be4a0 2024-05-16T21:32:28.607 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-05-16T21:32:28.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f853c0762d0 msgr2=0x7f853c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f853c0762d0 0x7f853c0787e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8554005c00 tx=0x7f8554009040 comp rx=0 tx=0).stop 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855c0be4e0 msgr2=0x7f855c1e4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855c0be4e0 0x7f855c1e4200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8550031000 tx=0x7f85500046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 shutdown_connections 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f853c0762d0 0x7f853c0787e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855c0c1490 0x7f855c0b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855c0be4e0 0x7f855c1e4200 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 --2- 172.21.15.5:0/2682365062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f855c08d790 0x7f855c143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 >> 172.21.15.5:0/2682365062 conn(0x7f855c0c3ab0 msgr2=0x7f855c068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 shutdown_connections 2024-05-16T21:32:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.606+0000 7f8560fb2640 1 -- 172.21.15.5:0/2682365062 wait complete. 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f76f40762d0 msgr2=0x7f76f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f76f40762d0 0x7f76f40787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7708033000 tx=0x7f7708009000 comp rx=0 tx=0).stop 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77100be4a0 msgr2=0x7f77100a7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77100be4a0 0x7f77100a7720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c5e0 tx=0x7f770c00caa0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 shutdown_connections 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f76f40762d0 0x7f76f40787e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771014eae0 0x7f77100a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77100be4a0 0x7f77100a7720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 --2- 172.21.15.5:0/1736948987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77100bd640 0x7f7710141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 >> 172.21.15.5:0/1736948987 conn(0x7f77100c3db0 msgr2=0x7f771006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 shutdown_connections 2024-05-16T21:32:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.607+0000 7f771766e640 1 -- 172.21.15.5:0/1736948987 wait complete. 2024-05-16T21:32:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.611+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8570050860 con 0x7f8570146540 2024-05-16T21:32:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.612+0000 7f8566ffd640 1 -- 172.21.15.5:0/3901565772 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8568010040 con 0x7f8570146540 2024-05-16T21:32:28.613 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.615+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85540762d0 msgr2=0x7f85540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.615+0000 7f8577373640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85540762d0 0x7f85540787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8560006cc0 tx=0x7f8560009240 comp rx=0 tx=0).stop 2024-05-16T21:32:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8570146540 msgr2=0x7f857013b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8570146540 0x7f857013b5b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f856800efc0 tx=0x7f856800c490 comp rx=0 tx=0).stop 2024-05-16T21:32:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 shutdown_connections 2024-05-16T21:32:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85540762d0 0x7f85540787e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f857014c0b0 0x7f857013baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8570146540 0x7f857013b5b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 --2- 172.21.15.5:0/3901565772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8570072260 0x7f85700be400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:28.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 >> 172.21.15.5:0/3901565772 conn(0x7f857006c8c0 msgr2=0x7f857013e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:28.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 shutdown_connections 2024-05-16T21:32:28.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:28.616+0000 7f8577373640 1 -- 172.21.15.5:0/3901565772 wait complete. 2024-05-16T21:32:28.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-05-16T21:32:28.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-05-16T21:32:28.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-05-16T21:32:28.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-05-16T21:32:28.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-05-16T21:32:28.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-05-16T21:32:28.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-05-16T21:32:29.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-16T21:32:29.626 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-16T21:32:29.626 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-16T21:32:29.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-16T21:32:29.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-16T21:32:29.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-16T21:32:29.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-16T21:32:29.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-16T21:32:29.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.802+0000 7fc93e934640 1 Processor -- start 2024-05-16T21:32:29.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.802+0000 7fc93e934640 1 -- start start 2024-05-16T21:32:29.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.805+0000 7fc93e934640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9380b62d0 0x7fc9380ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.806+0000 7fc93e934640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc93815b240 0x7fc93815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.806+0000 7fc93e934640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9380a0d40 con 0x7fc93806d0d0 2024-05-16T21:32:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.806+0000 7fc93e934640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc9380b66e0 con 0x7fc93815b240 2024-05-16T21:32:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.806+0000 7fc93e934640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc9380b55a0 con 0x7fc9380b62d0 2024-05-16T21:32:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.806+0000 7fc93ced1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc93815b240 0x7fc93815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.807+0000 7fc93ced1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc93815b240 0x7fc93815d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:41022/0 (socket says 172.21.15.5:41022) 2024-05-16T21:32:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.807+0000 7fc93ced1640 1 -- 172.21.15.5:0/3878933583 learned_addr learned my addr 172.21.15.5:0/3878933583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.807+0000 7fc93ced1640 1 -- 172.21.15.5:0/3878933583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9380b62d0 msgr2=0x7fc9380ba2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-16T21:32:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.807+0000 7fc93ced1640 1 --2- 172.21.15.5:0/3878933583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9380b62d0 0x7fc9380ba2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.807+0000 7fc93ced1640 1 -- 172.21.15.5:0/3878933583 >> v1:172.21.15.5:6789/0 conn(0x7fc93806d0d0 legacy=0x7fc938153160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T21:32:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.807+0000 7fc93ced1640 1 -- 172.21.15.5:0/3878933583 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9380b5db0 con 0x7fc93815b240 2024-05-16T21:32:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.809+0000 7fc93ced1640 1 --2- 172.21.15.5:0/3878933583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc93815b240 0x7fc93815d660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc930009e50 tx=0x7fc93002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e55585ef0e6966a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.809+0000 7fc936ffd640 1 -- 172.21.15.5:0/3878933583 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930036070 con 0x7fc93815b240 2024-05-16T21:32:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.810+0000 7fc936ffd640 1 -- 172.21.15.5:0/3878933583 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc930031600 con 0x7fc93815b240 2024-05-16T21:32:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.811+0000 7fc93e934640 1 -- 172.21.15.5:0/3878933583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc93815b240 msgr2=0x7fc93815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.811+0000 7fc93e934640 1 --2- 172.21.15.5:0/3878933583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc93815b240 0x7fc93815d660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc930009e50 tx=0x7fc93002a6a0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.811+0000 7fc93e934640 1 -- 172.21.15.5:0/3878933583 shutdown_connections 2024-05-16T21:32:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.811+0000 7fc93e934640 1 --2- 172.21.15.5:0/3878933583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc93815b240 0x7fc93815d660 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.811+0000 7fc93e934640 1 --2- 172.21.15.5:0/3878933583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9380b62d0 0x7fc9380ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.811+0000 7fc93e934640 1 -- 172.21.15.5:0/3878933583 >> 172.21.15.5:0/3878933583 conn(0x7fc9380a16b0 msgr2=0x7fc9380a1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.812+0000 7fc93e934640 1 -- 172.21.15.5:0/3878933583 shutdown_connections 2024-05-16T21:32:29.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.812+0000 7fc93e934640 1 -- 172.21.15.5:0/3878933583 wait complete. 2024-05-16T21:32:29.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.814+0000 7fc93e934640 1 Processor -- start 2024-05-16T21:32:29.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.815+0000 7fc93e934640 1 -- start start 2024-05-16T21:32:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.817+0000 7fc93e934640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc93806d0d0 0x7fc938142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.817+0000 7fc93e934640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9380b62d0 0x7fc93809fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.817+0000 7fc937fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc93806d0d0 0x7fc938142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.818+0000 7fc937fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc93806d0d0 0x7fc938142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57758/0 (socket says 172.21.15.5:57758) 2024-05-16T21:32:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.818+0000 7fc937fff640 1 -- 172.21.15.5:0/3578061033 learned_addr learned my addr 172.21.15.5:0/3578061033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.818+0000 7fc93e934640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc938153fd0 0x7fc938143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.818+0000 7fc9377fe640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9380b62d0 0x7fc93809fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.818+0000 7fc93ced1640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc938153fd0 0x7fc938143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.818+0000 7fc93e934640 1 -- 172.21.15.5:0/3578061033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc938153870 con 0x7fc93806d0d0 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.818+0000 7fc93e934640 1 -- 172.21.15.5:0/3578061033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc9380b57f0 con 0x7fc9380b62d0 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.819+0000 7fc93e934640 1 -- 172.21.15.5:0/3578061033 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc9380bbb80 con 0x7fc938153fd0 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.819+0000 7fc9377fe640 1 -- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc938153fd0 msgr2=0x7fc938143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.819+0000 7fc9377fe640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc938153fd0 0x7fc938143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.819+0000 7fc9377fe640 1 -- 172.21.15.5:0/3578061033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc93806d0d0 msgr2=0x7fc938142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.819+0000 7fc9377fe640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc93806d0d0 0x7fc938142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.819+0000 7fc9377fe640 1 -- 172.21.15.5:0/3578061033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc938145050 con 0x7fc9380b62d0 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.820+0000 7fc9377fe640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9380b62d0 0x7fc93809fce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc92800b410 tx=0x7fc92800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.820+0000 7fc934ff9640 1 -- 172.21.15.5:0/3578061033 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928015020 con 0x7fc9380b62d0 2024-05-16T21:32:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.821+0000 7fc93e934640 1 -- 172.21.15.5:0/3578061033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc938144d70 con 0x7fc9380b62d0 2024-05-16T21:32:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.821+0000 7fc93e934640 1 -- 172.21.15.5:0/3578061033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9381422b0 con 0x7fc9380b62d0 2024-05-16T21:32:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.822+0000 7fc934ff9640 1 -- 172.21.15.5:0/3578061033 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc928011850 con 0x7fc9380b62d0 2024-05-16T21:32:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.822+0000 7fc934ff9640 1 -- 172.21.15.5:0/3578061033 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928011c40 con 0x7fc9380b62d0 2024-05-16T21:32:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.824+0000 7fc93e934640 1 -- 172.21.15.5:0/3578061033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93809fac0 con 0x7fc9380b62d0 2024-05-16T21:32:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.825+0000 7fc934ff9640 1 -- 172.21.15.5:0/3578061033 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc928018020 con 0x7fc9380b62d0 2024-05-16T21:32:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.826+0000 7fc934ff9640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc9240763a0 0x7fc9240788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.826+0000 7fc934ff9640 1 -- 172.21.15.5:0/3578061033 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc928097080 con 0x7fc9380b62d0 2024-05-16T21:32:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.826+0000 7fc937fff640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc9240763a0 0x7fc9240788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.827+0000 7fc937fff640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc9240763a0 0x7fc9240788b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0099a0 tx=0x7fc92c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.831+0000 7fc934ff9640 1 -- 172.21.15.5:0/3578061033 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc92801f030 con 0x7fc9380b62d0 2024-05-16T21:32:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.864+0000 7f037bfff640 1 Processor -- start 2024-05-16T21:32:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.864+0000 7f037bfff640 1 -- start start 2024-05-16T21:32:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.866+0000 7f037bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f037403ea00 0x7f03740d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.866+0000 7f037bfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f037403cf40 0x7f03740cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.866+0000 7f037bfff640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037403c5f0 con 0x7f037403ada0 2024-05-16T21:32:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.866+0000 7f037bfff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f03740d01c0 con 0x7f037403ea00 2024-05-16T21:32:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.866+0000 7f037bfff640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f03740d6100 con 0x7f037403cf40 2024-05-16T21:32:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.866+0000 7f037b7fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f037403ada0 0x7f037403b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:41044/0 (socket says 172.21.15.5:41044) 2024-05-16T21:32:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.866+0000 7f037b7fe640 1 -- 172.21.15.5:0/2127992061 learned_addr learned my addr 172.21.15.5:0/2127992061 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.867+0000 7f037affd640 1 --2- 172.21.15.5:0/2127992061 >> v2:172.21.15.5:3300/0 conn(0x7f037403ea00 0x7f03740d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.867+0000 7f0379ffb640 1 -- 172.21.15.5:0/2127992061 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097428601 0 0) 0x7f037403c5f0 con 0x7f037403ada0 2024-05-16T21:32:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.867+0000 7f0379ffb640 1 -- 172.21.15.5:0/2127992061 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0364003520 con 0x7f037403ada0 2024-05-16T21:32:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.867+0000 7f037a7fc640 1 --2- 172.21.15.5:0/2127992061 >> v2:172.21.15.157:3300/0 conn(0x7f037403cf40 0x7f03740cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.868+0000 7f037affd640 1 -- 172.21.15.5:0/2127992061 >> v2:172.21.15.157:3300/0 conn(0x7f037403cf40 msgr2=0x7f03740cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.868+0000 7f037affd640 1 --2- 172.21.15.5:0/2127992061 >> v2:172.21.15.157:3300/0 conn(0x7f037403cf40 0x7f03740cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.868+0000 7f037affd640 1 -- 172.21.15.5:0/2127992061 >> v1:172.21.15.157:6789/0 conn(0x7f037403ada0 legacy=0x7f037403b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.868+0000 7f037affd640 1 -- 172.21.15.5:0/2127992061 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037403d350 con 0x7f037403ea00 2024-05-16T21:32:29.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.869+0000 7f037affd640 1 --2- 172.21.15.5:0/2127992061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ea00 0x7f03740d6590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f037403cb30 tx=0x7f036c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17b6a3ff50f4056 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.869+0000 7f0379ffb640 1 -- 172.21.15.5:0/2127992061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c037070 con 0x7f037403ea00 2024-05-16T21:32:29.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.869+0000 7f0379ffb640 1 -- 172.21.15.5:0/2127992061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c032440 con 0x7f037403ea00 2024-05-16T21:32:29.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.869+0000 7f0379ffb640 1 -- 172.21.15.5:0/2127992061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0327f0 con 0x7f037403ea00 2024-05-16T21:32:29.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.870+0000 7f43fb59e640 1 Processor -- start 2024-05-16T21:32:29.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.870+0000 7f037bfff640 1 -- 172.21.15.5:0/2127992061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ea00 msgr2=0x7f03740d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.870+0000 7f037bfff640 1 --2- 172.21.15.5:0/2127992061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ea00 0x7f03740d6590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f037403cb30 tx=0x7f036c02a270 comp rx=0 tx=0).stop 2024-05-16T21:32:29.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.871+0000 7f037bfff640 1 -- 172.21.15.5:0/2127992061 shutdown_connections 2024-05-16T21:32:29.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.871+0000 7f037bfff640 1 --2- 172.21.15.5:0/2127992061 >> v2:172.21.15.157:3300/0 conn(0x7f037403cf40 0x7f03740cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.871+0000 7f037bfff640 1 --2- 172.21.15.5:0/2127992061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ea00 0x7f03740d6590 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.871+0000 7f037bfff640 1 -- 172.21.15.5:0/2127992061 >> 172.21.15.5:0/2127992061 conn(0x7f037403f670 msgr2=0x7f03740060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:29.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.870+0000 7f43fb59e640 1 -- start start 2024-05-16T21:32:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.871+0000 7f037bfff640 1 -- 172.21.15.5:0/2127992061 shutdown_connections 2024-05-16T21:32:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.871+0000 7f037bfff640 1 -- 172.21.15.5:0/2127992061 wait complete. 2024-05-16T21:32:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.871+0000 7f7877591640 1 Processor -- start 2024-05-16T21:32:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.872+0000 7f7877591640 1 -- start start 2024-05-16T21:32:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.872+0000 7f43fb59e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f43fc0b72b0 0x7f43fc145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.872+0000 7f43fb59e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc14c0b0 con 0x7f43fc070b90 2024-05-16T21:32:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.873+0000 7f43fb59e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc14c390 con 0x7f43fc070780 2024-05-16T21:32:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.873+0000 7f43fb59e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f43fc0b76c0 con 0x7f43fc0b72b0 2024-05-16T21:32:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.873+0000 7f43fad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f43fc070b90 0x7f43fc156820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34960/0 (socket says 172.21.15.5:34960) 2024-05-16T21:32:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.873+0000 7f43f9d9b640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f43fc070780 0x7f43fc14d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:41058/0 (socket says 172.21.15.5:41058) 2024-05-16T21:32:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.873+0000 7f43f9d9b640 1 -- 172.21.15.5:0/4283744437 learned_addr learned my addr 172.21.15.5:0/4283744437 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f855b0c8640 1 Processor -- start 2024-05-16T21:32:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f43fa59c640 1 --2- 172.21.15.5:0/4283744437 >> v2:172.21.15.157:3300/0 conn(0x7f43fc0b72b0 0x7f43fc145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f43fa59c640 1 -- 172.21.15.5:0/4283744437 >> v1:172.21.15.157:6789/0 conn(0x7f43fc070780 legacy=0x7f43fc14d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f855b0c8640 1 -- start start 2024-05-16T21:32:29.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f7877591640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f786803a140 0x7f78680cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f43fa59c640 1 -- 172.21.15.5:0/4283744437 >> v1:172.21.15.5:6789/0 conn(0x7f43fc070b90 legacy=0x7f43fc156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f43fa59c640 1 -- 172.21.15.5:0/4283744437 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc14c670 con 0x7f43fc0b72b0 2024-05-16T21:32:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f7877591640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786803c310 con 0x7f7868038050 2024-05-16T21:32:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7fc176067640 1 Processor -- start 2024-05-16T21:32:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7fc176067640 1 -- start start 2024-05-16T21:32:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f7875d8e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f786803a140 0x7f78680cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f7877591640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78680393c0 con 0x7f78680cdd50 2024-05-16T21:32:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f7877591640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f786803be80 con 0x7f786803a140 2024-05-16T21:32:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f7876d90640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f78680cdd50 0x7f78680d8070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:41072/0 (socket says 172.21.15.5:41072) 2024-05-16T21:32:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.874+0000 7f7876d90640 1 -- 172.21.15.5:0/3803477097 learned_addr learned my addr 172.21.15.5:0/3803477097 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.875+0000 7f037bfff640 1 Processor -- start 2024-05-16T21:32:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.875+0000 7fa6265f3640 1 Processor -- start 2024-05-16T21:32:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.875+0000 7f7875d8e640 1 -- 172.21.15.5:0/3803477097 >> v1:172.21.15.157:6789/0 conn(0x7f78680cdd50 legacy=0x7f78680d8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.875+0000 7f7875d8e640 1 -- 172.21.15.5:0/3803477097 >> v1:172.21.15.5:6789/0 conn(0x7f7868038050 legacy=0x7f7868038cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.875+0000 7f7875d8e640 1 -- 172.21.15.5:0/3803477097 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786803b120 con 0x7f786803a140 2024-05-16T21:32:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.875+0000 7f787558d640 1 -- 172.21.15.5:0/3803477097 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492842952 0 0) 0x7f786803c310 con 0x7f7868038050 2024-05-16T21:32:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.875+0000 7f037bfff640 1 -- start start 2024-05-16T21:32:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.875+0000 7fa6265f3640 1 -- start start 2024-05-16T21:32:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7fec5ede7640 1 Processor -- start 2024-05-16T21:32:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f855b0c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f855414e530 0x7f85540ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f855b0c8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85540ba860 con 0x7f85540b8d70 2024-05-16T21:32:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f855b0c8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855414ece0 con 0x7f85540bd440 2024-05-16T21:32:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f855b0c8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f85540b88e0 con 0x7f855414e530 2024-05-16T21:32:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7fc176067640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc16803a2e0 0x7fc1680cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f43fa59c640 1 --2- 172.21.15.5:0/4283744437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 0x7f43fc145eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009720 tx=0x7f43ec02a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3c408cbe76a4a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f8558e64640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f855414e530 0x7f85540ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f8558e64640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f855414e530 0x7f85540ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57774/0 (socket says 172.21.15.5:57774) 2024-05-16T21:32:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f8558e64640 1 -- 172.21.15.5:0/2273168610 learned_addr learned my addr 172.21.15.5:0/2273168610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7fc176067640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc168038260 0x7fc16803b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7fc176067640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16803b1f0 con 0x7fc16803be60 2024-05-16T21:32:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7f8558e64640 1 -- 172.21.15.5:0/2273168610 >> v1:172.21.15.157:6789/0 conn(0x7f85540bd440 legacy=0x7f85540bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7f8558e64640 1 -- 172.21.15.5:0/2273168610 >> v1:172.21.15.5:6789/0 conn(0x7f85540b8d70 legacy=0x7f85540b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7f8558e64640 1 -- 172.21.15.5:0/2273168610 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855414efc0 con 0x7f855414e530 2024-05-16T21:32:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7f43f959a640 1 -- 172.21.15.5:0/4283744437 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec037070 con 0x7f43fc0b72b0 2024-05-16T21:32:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7f43f959a640 1 -- 172.21.15.5:0/4283744437 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec02ad40 con 0x7f43fc0b72b0 2024-05-16T21:32:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7f7875d8e640 1 --2- 172.21.15.5:0/3803477097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f786803a140 0x7f78680cd810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7870051610 tx=0x7f78700a8510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=956a4b6c9554b7ab server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7f787558d640 1 -- 172.21.15.5:0/3803477097 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700b4070 con 0x7f786803a140 2024-05-16T21:32:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7f787558d640 1 -- 172.21.15.5:0/3803477097 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78700af640 con 0x7f786803a140 2024-05-16T21:32:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7f787558d640 1 -- 172.21.15.5:0/3803477097 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700afa70 con 0x7f786803a140 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa6265f3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa620153490 0x7fa6200b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa6265f3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa6200a1d30 0x7fa6200b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa61ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa620153490 0x7fa6200b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa61ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa620153490 0x7fa6200b9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57796/0 (socket says 172.21.15.5:57796) 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa624b90640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6200b5d80 0x7fa620155d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34994/0 (socket says 172.21.15.5:34994) 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa6265f3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6201529b0 con 0x7fa6200b5d80 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa6265f3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa620152c90 con 0x7fa620153490 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa6265f3640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa6200ba440 con 0x7fa6200a1d30 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fa61ffff640 1 -- 172.21.15.5:0/372604114 learned_addr learned my addr 172.21.15.5:0/372604114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fa61f7fe640 1 --2- 172.21.15.5:0/372604114 >> v2:172.21.15.157:3300/0 conn(0x7fa6200a1d30 0x7fa6200b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7fc176067640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc16803c440 con 0x7fc168038260 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7fc176067640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc16803b4d0 con 0x7fc16803a2e0 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fc16effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc168038260 0x7fc16803b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fc16ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc16803be60 0x7fc1680d0c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34982/0 (socket says 172.21.15.5:34982) 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fc16ffff640 1 -- 172.21.15.5:0/3653472644 learned_addr learned my addr 172.21.15.5:0/3653472644 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fc16effd640 1 -- 172.21.15.5:0/3653472644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc16803a2e0 msgr2=0x7fc1680cd790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fc16effd640 1 --2- 172.21.15.5:0/3653472644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc16803a2e0 0x7fc1680cd790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fc16effd640 1 -- 172.21.15.5:0/3653472644 >> v1:172.21.15.5:6789/0 conn(0x7fc16803be60 legacy=0x7fc1680d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.877+0000 7fc16effd640 1 -- 172.21.15.5:0/3653472644 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc168038b00 con 0x7fc168038260 2024-05-16T21:32:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7f43fb59e640 1 -- 172.21.15.5:0/4283744437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 msgr2=0x7f43fc145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7f8558e64640 1 --2- 172.21.15.5:0/2273168610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855414e530 0x7f85540ba320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f854c009ea0 tx=0x7f854c02a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce282de6a71d9c15 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7f43fb59e640 1 --2- 172.21.15.5:0/4283744437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 0x7f43fc145eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009720 tx=0x7f43ec02a030 comp rx=0 tx=0).stop 2024-05-16T21:32:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.876+0000 7fec5ede7640 1 -- start start 2024-05-16T21:32:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fec5ede7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 0x7fec500d90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fec5ede7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec5003a3d0 0x7fec500072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fec5ede7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5003a7e0 con 0x7fec5003cb20 2024-05-16T21:32:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fa61f7fe640 1 -- 172.21.15.5:0/372604114 >> v2:172.21.15.5:3300/0 conn(0x7fa620153490 msgr2=0x7fa6200b9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fa61f7fe640 1 --2- 172.21.15.5:0/372604114 >> v2:172.21.15.5:3300/0 conn(0x7fa620153490 0x7fa6200b9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fa61f7fe640 1 -- 172.21.15.5:0/372604114 >> v1:172.21.15.5:6789/0 conn(0x7fa6200b5d80 legacy=0x7fa620155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fa61f7fe640 1 -- 172.21.15.5:0/372604114 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6200b4a60 con 0x7fa6200a1d30 2024-05-16T21:32:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fc16effd640 1 --2- 172.21.15.5:0/3653472644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc168038260 0x7fc16803b920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc164010b90 tx=0x7fc164032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8422ed429183efce server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fec5ede7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fec50039740 con 0x7fec5003a3d0 2024-05-16T21:32:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fec5ede7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec5003b850 con 0x7fec5003abd0 2024-05-16T21:32:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7f85537fe640 1 -- 172.21.15.5:0/2273168610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c037070 con 0x7f855414e530 2024-05-16T21:32:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.878+0000 7fec5dde5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 0x7fec500d90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f85537fe640 1 -- 172.21.15.5:0/2273168610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c032420 con 0x7f855414e530 2024-05-16T21:32:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f85537fe640 1 -- 172.21.15.5:0/2273168610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c032830 con 0x7f855414e530 2024-05-16T21:32:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f43fb59e640 1 -- 172.21.15.5:0/4283744437 shutdown_connections 2024-05-16T21:32:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f43fb59e640 1 --2- 172.21.15.5:0/4283744437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 0x7f43fc145eb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f43fb59e640 1 -- 172.21.15.5:0/4283744437 >> 172.21.15.5:0/4283744437 conn(0x7f43fc0c1590 msgr2=0x7f43fc0c19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fec5d5e4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec5003cb20 0x7fec500cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35004/0 (socket says 172.21.15.5:35004) 2024-05-16T21:32:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fec5d5e4640 1 -- 172.21.15.5:0/4236087275 learned_addr learned my addr 172.21.15.5:0/4236087275 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f43fb59e640 1 -- 172.21.15.5:0/4283744437 shutdown_connections 2024-05-16T21:32:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fec5e5e6640 1 --2- 172.21.15.5:0/4236087275 >> v2:172.21.15.157:3300/0 conn(0x7fec5003a3d0 0x7fec500072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f43fb59e640 1 -- 172.21.15.5:0/4283744437 wait complete. 2024-05-16T21:32:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ada0 0x7f03740bc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f037403cf40 0x7f0374036470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f037403ea00 0x7f03740d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ada0 0x7f03740bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037a7fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f037403cf40 0x7f0374036470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ada0 0x7f03740bc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57808/0 (socket says 172.21.15.5:57808) 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037a7fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f037403cf40 0x7f0374036470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:41090/0 (socket says 172.21.15.5:41090) 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037affd640 1 -- 172.21.15.5:0/1173165967 learned_addr learned my addr 172.21.15.5:0/1173165967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03740d5a60 con 0x7f037403ada0 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f037b7fe640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f037403ea00 0x7f03740d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f03740d5d90 con 0x7f037403cf40 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0374039e80 con 0x7f037403ea00 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f7877591640 1 -- 172.21.15.5:0/3803477097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f786803a140 msgr2=0x7f78680cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7f7877591640 1 --2- 172.21.15.5:0/3803477097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f786803a140 0x7f78680cd810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7870051610 tx=0x7f78700a8510 comp rx=0 tx=0).stop 2024-05-16T21:32:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f7877591640 1 -- 172.21.15.5:0/3803477097 shutdown_connections 2024-05-16T21:32:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f7877591640 1 --2- 172.21.15.5:0/3803477097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f786803a140 0x7f78680cd810 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7870051610 tx=0x7f78700a8510 comp rx=0 tx=0).stop 2024-05-16T21:32:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f7877591640 1 -- 172.21.15.5:0/3803477097 >> 172.21.15.5:0/3803477097 conn(0x7f786803f680 msgr2=0x7f78680060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fc16e7fc640 1 -- 172.21.15.5:0/3653472644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164040070 con 0x7fc168038260 2024-05-16T21:32:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fc16e7fc640 1 -- 172.21.15.5:0/3653472644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc164033960 con 0x7fc168038260 2024-05-16T21:32:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fc16e7fc640 1 -- 172.21.15.5:0/3653472644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164033d30 con 0x7fc168038260 2024-05-16T21:32:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fec5e5e6640 1 -- 172.21.15.5:0/4236087275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 msgr2=0x7fec500d90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fec5e5e6640 1 --2- 172.21.15.5:0/4236087275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 0x7fec500d90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fec5e5e6640 1 -- 172.21.15.5:0/4236087275 >> v1:172.21.15.5:6789/0 conn(0x7fec5003cb20 legacy=0x7fec500cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.879+0000 7fec5e5e6640 1 -- 172.21.15.5:0/4236087275 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50039eb0 con 0x7fec5003a3d0 2024-05-16T21:32:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7fa61f7fe640 1 --2- 172.21.15.5:0/372604114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 0x7fa6200b4520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6200a5870 tx=0x7fa61402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=244219d84e59401 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f7877591640 1 -- 172.21.15.5:0/3803477097 shutdown_connections 2024-05-16T21:32:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f855b0c8640 1 -- 172.21.15.5:0/2273168610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855414e530 msgr2=0x7f85540ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f855b0c8640 1 --2- 172.21.15.5:0/2273168610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855414e530 0x7f85540ba320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f854c009ea0 tx=0x7f854c02a870 comp rx=0 tx=0).stop 2024-05-16T21:32:29.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f7877591640 1 -- 172.21.15.5:0/3803477097 wait complete. 2024-05-16T21:32:29.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f855b0c8640 1 -- 172.21.15.5:0/2273168610 shutdown_connections 2024-05-16T21:32:29.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f855b0c8640 1 --2- 172.21.15.5:0/2273168610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f855414e530 0x7f85540ba320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f855b0c8640 1 -- 172.21.15.5:0/2273168610 >> 172.21.15.5:0/2273168610 conn(0x7f85540c0570 msgr2=0x7f85540c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f855b0c8640 1 -- 172.21.15.5:0/2273168610 shutdown_connections 2024-05-16T21:32:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fec5e5e6640 1 --2- 172.21.15.5:0/4236087275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003a3d0 0x7fec500072e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec540097a0 tx=0x7fec5402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=101ea2e3d6361418 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fc176067640 1 -- 172.21.15.5:0/3653472644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc168038260 msgr2=0x7fc16803b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fc176067640 1 --2- 172.21.15.5:0/3653472644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc168038260 0x7fc16803b920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc164010b90 tx=0x7fc164032c10 comp rx=0 tx=0).stop 2024-05-16T21:32:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7f037affd640 1 -- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f037403ea00 msgr2=0x7f03740d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7f037affd640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f037403ea00 0x7f03740d38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7f037affd640 1 -- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f037403cf40 msgr2=0x7f0374036470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7f037affd640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f037403cf40 0x7f0374036470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fec5cde3640 1 -- 172.21.15.5:0/4236087275 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54037070 con 0x7fec5003a3d0 2024-05-16T21:32:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fec5cde3640 1 -- 172.21.15.5:0/4236087275 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54032440 con 0x7fec5003a3d0 2024-05-16T21:32:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fec5cde3640 1 -- 172.21.15.5:0/4236087275 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54032810 con 0x7fec5003a3d0 2024-05-16T21:32:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7f037affd640 1 -- 172.21.15.5:0/1173165967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03740bcc40 con 0x7f037403ada0 2024-05-16T21:32:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fc176067640 1 -- 172.21.15.5:0/3653472644 shutdown_connections 2024-05-16T21:32:29.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fc176067640 1 --2- 172.21.15.5:0/3653472644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc168038260 0x7fc16803b920 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fc176067640 1 --2- 172.21.15.5:0/3653472644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc16803a2e0 0x7fc1680cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7f037affd640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ada0 0x7f03740bc700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f036c009880 tx=0x7f036c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7fc176067640 1 -- 172.21.15.5:0/3653472644 >> 172.21.15.5:0/3653472644 conn(0x7fc16803f6b0 msgr2=0x7fc168006110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fc176067640 1 -- 172.21.15.5:0/3653472644 shutdown_connections 2024-05-16T21:32:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fc176067640 1 -- 172.21.15.5:0/3653472644 wait complete. 2024-05-16T21:32:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7fa61effd640 1 -- 172.21.15.5:0/372604114 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614037070 con 0x7fa6200a1d30 2024-05-16T21:32:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7fa61effd640 1 -- 172.21.15.5:0/372604114 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614032440 con 0x7fa6200a1d30 2024-05-16T21:32:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7fa61effd640 1 -- 172.21.15.5:0/372604114 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61402ae60 con 0x7fa6200a1d30 2024-05-16T21:32:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fa6265f3640 1 -- 172.21.15.5:0/372604114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 msgr2=0x7fa6200b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fa6265f3640 1 --2- 172.21.15.5:0/372604114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 0x7fa6200b4520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6200a5870 tx=0x7fa61402a110 comp rx=0 tx=0).stop 2024-05-16T21:32:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.881+0000 7f03637fe640 1 -- 172.21.15.5:0/1173165967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c037050 con 0x7f037403ada0 2024-05-16T21:32:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7f43fb59e640 1 Processor -- start 2024-05-16T21:32:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fa6265f3640 1 -- 172.21.15.5:0/372604114 shutdown_connections 2024-05-16T21:32:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fa6265f3640 1 --2- 172.21.15.5:0/372604114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 0x7fa6200b4520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fa6265f3640 1 --2- 172.21.15.5:0/372604114 >> v2:172.21.15.5:3300/0 conn(0x7fa620153490 0x7fa6200b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fa6265f3640 1 -- 172.21.15.5:0/372604114 >> 172.21.15.5:0/372604114 conn(0x7fa6200bc000 msgr2=0x7fa6200bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7f03637fe640 1 -- 172.21.15.5:0/1173165967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c043070 con 0x7f037403ada0 2024-05-16T21:32:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03740d5800 con 0x7f037403ada0 2024-05-16T21:32:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7f43fb59e640 1 -- start start 2024-05-16T21:32:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7f7877591640 1 Processor -- start 2024-05-16T21:32:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.883+0000 7f7877591640 1 -- start start 2024-05-16T21:32:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7fa6265f3640 1 -- 172.21.15.5:0/372604114 shutdown_connections 2024-05-16T21:32:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.880+0000 7f855b0c8640 1 -- 172.21.15.5:0/2273168610 wait complete. 2024-05-16T21:32:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7f855b0c8640 1 Processor -- start 2024-05-16T21:32:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.883+0000 7f855b0c8640 1 -- start start 2024-05-16T21:32:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.883+0000 7fec5ede7640 1 -- 172.21.15.5:0/4236087275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003a3d0 msgr2=0x7fec500072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.883+0000 7fec5ede7640 1 --2- 172.21.15.5:0/4236087275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003a3d0 0x7fec500072e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec540097a0 tx=0x7fec5402a1a0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.882+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03740ce230 con 0x7f037403ada0 2024-05-16T21:32:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.884+0000 7fec5ede7640 1 -- 172.21.15.5:0/4236087275 shutdown_connections 2024-05-16T21:32:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.884+0000 7fec5ede7640 1 --2- 172.21.15.5:0/4236087275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003a3d0 0x7fec500072e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.884+0000 7fec5ede7640 1 --2- 172.21.15.5:0/4236087275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 0x7fec500d90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.884+0000 7fec5ede7640 1 -- 172.21.15.5:0/4236087275 >> 172.21.15.5:0/4236087275 conn(0x7fec50006520 msgr2=0x7fec50006930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.884+0000 7f03637fe640 1 -- 172.21.15.5:0/1173165967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0325f0 con 0x7f037403ada0 2024-05-16T21:32:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.884+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0374005490 con 0x7f037403ada0 2024-05-16T21:32:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.883+0000 7fa6265f3640 1 -- 172.21.15.5:0/372604114 wait complete. 2024-05-16T21:32:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f43fb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43fc070780 0x7f43fc0bb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7877591640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7868038050 0x7f78681657a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7fc176067640 1 Processor -- start 2024-05-16T21:32:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7877591640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78680cdd50 0x7f7868159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7877591640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680c6210 0x7f78680c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f855b0c8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85540b8d70 0x7f8554141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7fc176067640 1 -- start start 2024-05-16T21:32:29.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7877591640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7868038460 con 0x7f78680c6210 2024-05-16T21:32:29.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7877591640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f786803bb10 con 0x7f7868038050 2024-05-16T21:32:29.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7875d8e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78680cdd50 0x7f7868159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7fa6265f3640 1 Processor -- start 2024-05-16T21:32:29.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7876d90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680c6210 0x7f78680c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f855b0c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85540bd440 0x7f855413fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7875d8e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78680cdd50 0x7f7868159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51212/0 (socket says 172.21.15.5:51212) 2024-05-16T21:32:29.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f7875d8e640 1 -- 172.21.15.5:0/61109016 learned_addr learned my addr 172.21.15.5:0/61109016 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7fa6265f3640 1 -- start start 2024-05-16T21:32:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f43fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43fc070780 0x7f43fc0bb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7f8558e64640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85540b8d70 0x7f8554141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f8558e64640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85540b8d70 0x7f8554141300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51216/0 (socket says 172.21.15.5:51216) 2024-05-16T21:32:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f43fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43fc070780 0x7f43fc0bb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57822/0 (socket says 172.21.15.5:57822) 2024-05-16T21:32:29.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f8558e64640 1 -- 172.21.15.5:0/921386229 learned_addr learned my addr 172.21.15.5:0/921386229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f43fa59c640 1 -- 172.21.15.5:0/1021608740 learned_addr learned my addr 172.21.15.5:0/1021608740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f855b0c8640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855414e530 0x7f8554151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f43fb59e640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43fc070b90 0x7f43fc0b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f7877591640 1 -- 172.21.15.5:0/61109016 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f786803a550 con 0x7f78680cdd50 2024-05-16T21:32:29.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f43fb59e640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 0x7f43fc0a3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f855414e940 con 0x7f85540bd440 2024-05-16T21:32:29.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f43fb59e640 1 -- 172.21.15.5:0/1021608740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc14daa0 con 0x7f43fc070780 2024-05-16T21:32:29.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f85540bbb70 con 0x7f855414e530 2024-05-16T21:32:29.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f8559665640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855414e530 0x7f8554151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f787658f640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7868038050 0x7f78681657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f855414eac0 con 0x7f85540b8d70 2024-05-16T21:32:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f03637fe640 1 -- 172.21.15.5:0/1173165967 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f036c0327d0 con 0x7f037403ada0 2024-05-16T21:32:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f43fb59e640 1 -- 172.21.15.5:0/1021608740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc0b8130 con 0x7f43fc0b72b0 2024-05-16T21:32:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f43fb59e640 1 -- 172.21.15.5:0/1021608740 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f43fc14dc20 con 0x7f43fc070b90 2024-05-16T21:32:29.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.885+0000 7fec5ede7640 1 -- 172.21.15.5:0/4236087275 shutdown_connections 2024-05-16T21:32:29.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f8553fff640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85540bd440 0x7f855413fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f7875d8e640 1 -- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7868038050 msgr2=0x7f78681657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f03637fe640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f03680763a0 0x7f03680788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f7875d8e640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7868038050 0x7f78681657a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f7875d8e640 1 -- 172.21.15.5:0/61109016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680c6210 msgr2=0x7f78680c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f7875d8e640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680c6210 0x7f78680c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f03637fe640 1 -- 172.21.15.5:0/1173165967 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f036c0b7f40 con 0x7f037403ada0 2024-05-16T21:32:29.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.886+0000 7f7875d8e640 1 -- 172.21.15.5:0/61109016 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7868165ce0 con 0x7f78680cdd50 2024-05-16T21:32:29.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f43fa59c640 1 -- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43fc070b90 msgr2=0x7f43fc0b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f43f9d9b640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43fc070b90 0x7f43fc0b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7fc176067640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc168038260 0x7fc168030df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f8558e64640 1 -- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855414e530 msgr2=0x7f8554151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f8558e64640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855414e530 0x7f8554151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f8558e64640 1 -- 172.21.15.5:0/921386229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85540bd440 msgr2=0x7f855413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f8558e64640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85540bd440 0x7f855413fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f8558e64640 1 -- 172.21.15.5:0/921386229 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8554141840 con 0x7f85540b8d70 2024-05-16T21:32:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f43fad9d640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 0x7f43fc0a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7fc176067640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc16803a2e0 0x7fc168157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc168038260 0x7fc168030df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f43fa59c640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43fc070b90 0x7f43fc0b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f43fa59c640 1 -- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 msgr2=0x7f43fc0a3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f43fa59c640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 0x7f43fc0a3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f43fa59c640 1 -- 172.21.15.5:0/1021608740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc0a1ba0 con 0x7f43fc070780 2024-05-16T21:32:29.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7f7875d8e640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78680cdd50 0x7f7868159400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7870066130 tx=0x7f7870075e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f43fad9d640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 0x7f43fc0a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:29.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa6265f3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 0x7fa62014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc168038260 0x7fc168030df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51228/0 (socket says 172.21.15.5:51228) 2024-05-16T21:32:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f037a7fc640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f03680763a0 0x7f03680788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa6265f3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6200b5d80 0x7fa62014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc16effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc16803a2e0 0x7fc168157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc16effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc16803a2e0 0x7fc168157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57844/0 (socket says 172.21.15.5:57844) 2024-05-16T21:32:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc176067640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc168031c10 0x7fc168032020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f8558e64640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85540b8d70 0x7f8554141300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f854c000f80 tx=0x7f854c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f43fa59c640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43fc070780 0x7f43fc0bb5b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43ec02a620 tx=0x7f43ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa61ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 0x7fa62014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa6265f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62009cc90 0x7fa6201ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa61ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 0x7fa62014eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:41126/0 (socket says 172.21.15.5:41126) 2024-05-16T21:32:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc16f7fe640 1 -- 172.21.15.5:0/2599904292 learned_addr learned my addr 172.21.15.5:0/2599904292 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f85517fa640 1 -- 172.21.15.5:0/921386229 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c040020 con 0x7f85540b8d70 2024-05-16T21:32:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f85517fa640 1 -- 172.21.15.5:0/921386229 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c032c90 con 0x7f85540b8d70 2024-05-16T21:32:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f85517fa640 1 -- 172.21.15.5:0/921386229 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c037040 con 0x7f85540b8d70 2024-05-16T21:32:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc168039300 con 0x7fc16803a2e0 2024-05-16T21:32:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc16ffff640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc168031c10 0x7fc168032020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8554140530 con 0x7f85540b8d70 2024-05-16T21:32:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc1680cdcd0 con 0x7fc168031c10 2024-05-16T21:32:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc168039480 con 0x7fc168038260 2024-05-16T21:32:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85541e4cc0 con 0x7f85540b8d70 2024-05-16T21:32:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa61f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6200b5d80 0x7fa62014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa61f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6200b5d80 0x7fa62014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51234/0 (socket says 172.21.15.5:51234) 2024-05-16T21:32:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa624b90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62009cc90 0x7fa6201ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.888+0000 7fa624b90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62009cc90 0x7fa6201ee160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57846/0 (socket says 172.21.15.5:57846) 2024-05-16T21:32:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa61ffff640 1 -- 172.21.15.5:0/1835152705 learned_addr learned my addr 172.21.15.5:0/1835152705 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200b6190 con 0x7fa62009cc90 2024-05-16T21:32:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.887+0000 7fec5ede7640 1 -- 172.21.15.5:0/4236087275 wait complete. 2024-05-16T21:32:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200b5bb0 con 0x7fa6200a1d30 2024-05-16T21:32:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6200b6310 con 0x7fa6200b5d80 2024-05-16T21:32:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa61f7fe640 1 -- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 msgr2=0x7fa62014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa61f7fe640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 0x7fa62014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa61f7fe640 1 -- 172.21.15.5:0/1835152705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62009cc90 msgr2=0x7fa6201ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa61f7fe640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62009cc90 0x7fa6201ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fa61f7fe640 1 -- 172.21.15.5:0/1835152705 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62014f430 con 0x7fa6200b5d80 2024-05-16T21:32:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8534005290 con 0x7f85540b8d70 2024-05-16T21:32:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7f7866ffd640 1 -- 172.21.15.5:0/61109016 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700b4050 con 0x7f78680cdd50 2024-05-16T21:32:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7f7866ffd640 1 -- 172.21.15.5:0/61109016 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78700b5040 con 0x7f78680cdd50 2024-05-16T21:32:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7f7866ffd640 1 -- 172.21.15.5:0/61109016 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700aec60 con 0x7f78680cdd50 2024-05-16T21:32:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7fa61f7fe640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6200b5d80 0x7fa62014d180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa620071c40 tx=0x7fa6140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7f7877591640 1 -- 172.21.15.5:0/61109016 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78680cadc0 con 0x7f78680cdd50 2024-05-16T21:32:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7f7877591640 1 -- 172.21.15.5:0/61109016 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7868159db0 con 0x7f78680cdd50 2024-05-16T21:32:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7fa61cff9640 1 -- 172.21.15.5:0/1835152705 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614041030 con 0x7fa6200b5d80 2024-05-16T21:32:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7fa61cff9640 1 -- 172.21.15.5:0/1835152705 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614030500 con 0x7fa6200b5d80 2024-05-16T21:32:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7fc16effd640 1 -- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc168038260 msgr2=0x7fc168030df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7fc16effd640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc168038260 0x7fc168030df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7fc16effd640 1 -- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc168031c10 msgr2=0x7fc168032020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7fc16effd640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc168031c10 0x7fc168032020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7fc16effd640 1 -- 172.21.15.5:0/2599904292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc168158160 con 0x7fc16803a2e0 2024-05-16T21:32:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fec5ede7640 1 Processor -- start 2024-05-16T21:32:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.889+0000 7fec5ede7640 1 -- start start 2024-05-16T21:32:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5ede7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5003a3d0 0x7fec500382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5ede7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 0x7fec50034de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5ede7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003cb20 0x7fec50036c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fa61cff9640 1 -- 172.21.15.5:0/1835152705 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614037040 con 0x7fa6200b5d80 2024-05-16T21:32:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62014d6c0 con 0x7fa6200b5d80 2024-05-16T21:32:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62009be30 con 0x7fa6200b5d80 2024-05-16T21:32:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5ede7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec500d0140 con 0x7fec5003a3d0 2024-05-16T21:32:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5ede7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fec50004a60 con 0x7fec5003cb20 2024-05-16T21:32:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5ede7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec500d02c0 con 0x7fec5003abd0 2024-05-16T21:32:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.890+0000 7f037a7fc640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f03680763a0 0x7f03680788b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03740bcf40 tx=0x7f0370008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fc16effd640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc16803a2e0 0x7fc168157c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc16403a000 tx=0x7fc1640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5e5e6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003cb20 0x7fec50036c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5e5e6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003cb20 0x7fec50036c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:41144/0 (socket says 172.21.15.5:41144) 2024-05-16T21:32:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5e5e6640 1 -- 172.21.15.5:0/2160023582 learned_addr learned my addr 172.21.15.5:0/2160023582 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.891+0000 7fec5d5e4640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 0x7fec50034de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7f85517fa640 1 -- 172.21.15.5:0/921386229 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f854c043020 con 0x7f85540b8d70 2024-05-16T21:32:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7fec5dde5640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5003a3d0 0x7fec500382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7fec5e5e6640 1 -- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 msgr2=0x7fec50034de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7fec5e5e6640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 0x7fec50034de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7fec5e5e6640 1 -- 172.21.15.5:0/2160023582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5003a3d0 msgr2=0x7fec500382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7fec5e5e6640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5003a3d0 0x7fec500382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7f7864ff9640 1 -- 172.21.15.5:0/61109016 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784c005290 con 0x7f78680cdd50 2024-05-16T21:32:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7fec5e5e6640 1 -- 172.21.15.5:0/2160023582 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50038820 con 0x7fec5003cb20 2024-05-16T21:32:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.892+0000 7f85517fa640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85400763d0 0x7f85400788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7fec5e5e6640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003cb20 0x7fec50036c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fec5402a790 tx=0x7fec540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7f85517fa640 1 -- 172.21.15.5:0/921386229 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f854c0b7790 con 0x7f85540b8d70 2024-05-16T21:32:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7f8553fff640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85400763d0 0x7f85400788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7fec4e7fc640 1 -- 172.21.15.5:0/2160023582 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54040020 con 0x7fec5003cb20 2024-05-16T21:32:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec50035690 con 0x7fec5003cb20 2024-05-16T21:32:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec50037dc0 con 0x7fec5003cb20 2024-05-16T21:32:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa620050860 con 0x7fa6200b5d80 2024-05-16T21:32:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7fec4e7fc640 1 -- 172.21.15.5:0/2160023582 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54038040 con 0x7fec5003cb20 2024-05-16T21:32:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7f7866ffd640 1 -- 172.21.15.5:0/61109016 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f78700b9600 con 0x7f78680cdd50 2024-05-16T21:32:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.893+0000 7f8553fff640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85400763d0 0x7f85400788e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8554144e10 tx=0x7f8544009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.894+0000 7fec4e7fc640 1 -- 172.21.15.5:0/2160023582 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54037070 con 0x7fec5003cb20 2024-05-16T21:32:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.894+0000 7f7866ffd640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f78540763d0 0x7f78540788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.894+0000 7fa61cff9640 1 -- 172.21.15.5:0/1835152705 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa614044070 con 0x7fa6200b5d80 2024-05-16T21:32:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.894+0000 7f787658f640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f78540763d0 0x7f78540788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.894+0000 7f7866ffd640 1 -- 172.21.15.5:0/61109016 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7870138b10 con 0x7f78680cdd50 2024-05-16T21:32:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.894+0000 7f43eaffd640 1 -- 172.21.15.5:0/1021608740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec037050 con 0x7f43fc070780 2024-05-16T21:32:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.894+0000 7f787658f640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f78540763d0 0x7f78540788e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f786c001520 tx=0x7f786c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.894+0000 7fa61cff9640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa604076320 0x7fa604078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7f43eaffd640 1 -- 172.21.15.5:0/1021608740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec043070 con 0x7f43fc070780 2024-05-16T21:32:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7f43fb59e640 1 -- 172.21.15.5:0/1021608740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc0ba2e0 con 0x7f43fc070780 2024-05-16T21:32:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7f03637fe640 1 -- 172.21.15.5:0/1173165967 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f036c04d020 con 0x7f037403ada0 2024-05-16T21:32:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7fa61ffff640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa604076320 0x7fa604078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7fc15bfff640 1 -- 172.21.15.5:0/2599904292 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16404b020 con 0x7fc16803a2e0 2024-05-16T21:32:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7f43fb59e640 1 -- 172.21.15.5:0/1021608740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc0b8990 con 0x7f43fc070780 2024-05-16T21:32:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec50008600 con 0x7fec5003cb20 2024-05-16T21:32:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7fc15bfff640 1 -- 172.21.15.5:0/2599904292 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc164041040 con 0x7fc16803a2e0 2024-05-16T21:32:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7f43eaffd640 1 -- 172.21.15.5:0/1021608740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec030e20 con 0x7f43fc070780 2024-05-16T21:32:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc168032560 con 0x7fc16803a2e0 2024-05-16T21:32:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7fc15bfff640 1 -- 172.21.15.5:0/2599904292 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164040070 con 0x7fc16803a2e0 2024-05-16T21:32:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.895+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc168156ac0 con 0x7fc16803a2e0 2024-05-16T21:32:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.896+0000 7fa61ffff640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa604076320 0x7fa604078830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006f40 tx=0x7fa60c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.896+0000 7fec4e7fc640 1 -- 172.21.15.5:0/2160023582 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fec54043020 con 0x7fec5003cb20 2024-05-16T21:32:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.896+0000 7fec4e7fc640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec3c076300 0x7fec3c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.896+0000 7fec4e7fc640 1 -- 172.21.15.5:0/2160023582 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fec540b7740 con 0x7fec5003cb20 2024-05-16T21:32:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.897+0000 7fec5dde5640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec3c076300 0x7fec3c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.897+0000 7fec5dde5640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec3c076300 0x7fec3c078810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec48006fd0 tx=0x7fec48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.897+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc150005290 con 0x7fc16803a2e0 2024-05-16T21:32:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.897+0000 7f43e8ff9640 1 -- 172.21.15.5:0/1021608740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d4005290 con 0x7f43fc070780 2024-05-16T21:32:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.898+0000 7f43eaffd640 1 -- 172.21.15.5:0/1021608740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f43ec048460 con 0x7f43fc070780 2024-05-16T21:32:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.898+0000 7fc15bfff640 1 -- 172.21.15.5:0/2599904292 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc16404e020 con 0x7fc16803a2e0 2024-05-16T21:32:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7f43eaffd640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43dc0762d0 0x7f43dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7fc15bfff640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc154076320 0x7fc154078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7fa61cff9640 1 -- 172.21.15.5:0/1835152705 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa6140b6230 con 0x7fa6200b5d80 2024-05-16T21:32:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7f85517fa640 1 -- 172.21.15.5:0/921386229 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f854c04a030 con 0x7f85540b8d70 2024-05-16T21:32:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7f43f9d9b640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43dc0762d0 0x7f43dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7fc15bfff640 1 -- 172.21.15.5:0/2599904292 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc1640c0b80 con 0x7fc16803a2e0 2024-05-16T21:32:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7f43eaffd640 1 -- 172.21.15.5:0/1021608740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f43ec0b8380 con 0x7f43fc070780 2024-05-16T21:32:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7fc16f7fe640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc154076320 0x7fc154078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.899+0000 7f43f9d9b640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43dc0762d0 0x7f43dc0787e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f43f40012e0 tx=0x7f43f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.900+0000 7fc16f7fe640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc154076320 0x7fc154078830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc15c006fd0 tx=0x7fc15c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.907+0000 7fec4e7fc640 1 -- 172.21.15.5:0/2160023582 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fec50008600 con 0x7fec5003cb20 2024-05-16T21:32:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.908+0000 7f7866ffd640 1 -- 172.21.15.5:0/61109016 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7870102450 con 0x7f78680cdd50 2024-05-16T21:32:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.908+0000 7f43eaffd640 1 -- 172.21.15.5:0/1021608740 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f43ec082300 con 0x7f43fc070780 2024-05-16T21:32:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.914+0000 7fa61cff9640 1 -- 172.21.15.5:0/1835152705 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa614080e70 con 0x7fa6200b5d80 2024-05-16T21:32:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:29.919+0000 7fc15bfff640 1 -- 172.21.15.5:0/2599904292 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc164055030 con 0x7fc16803a2e0 2024-05-16T21:32:30.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.263+0000 7fc93e934640 1 -- 172.21.15.5:0/3578061033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc9380b4c30 con 0x7fc9380b62d0 2024-05-16T21:32:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:30.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.264+0000 7fc934ff9640 1 -- 172.21.15.5:0/3578061033 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9280602e0 con 0x7fc9380b62d0 2024-05-16T21:32:30.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.267+0000 7fc91e7fc640 1 -- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc9240763a0 msgr2=0x7fc9240788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc9240763a0 0x7fc9240788b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0099a0 tx=0x7fc92c0090e0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 -- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9380b62d0 msgr2=0x7fc93809fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9380b62d0 0x7fc93809fce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc92800b410 tx=0x7fc92800b8d0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 -- 172.21.15.5:0/3578061033 shutdown_connections 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc9240763a0 0x7fc9240788b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc938153fd0 0x7fc938143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9380b62d0 0x7fc93809fce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 --2- 172.21.15.5:0/3578061033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc93806d0d0 0x7fc938142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.268+0000 7fc91e7fc640 1 -- 172.21.15.5:0/3578061033 >> 172.21.15.5:0/3578061033 conn(0x7fc9380a16b0 msgr2=0x7fc938068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.269+0000 7fc91e7fc640 1 -- 172.21.15.5:0/3578061033 shutdown_connections 2024-05-16T21:32:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.269+0000 7fc91e7fc640 1 -- 172.21.15.5:0/3578061033 wait complete. 2024-05-16T21:32:30.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-05-16T21:32:30.289 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:30.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.319+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa620133570 con 0x7fa6200b5d80 2024-05-16T21:32:30.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.320+0000 7fa61cff9640 1 -- 172.21.15.5:0/1835152705 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa614085170 con 0x7fa6200b5d80 2024-05-16T21:32:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-05-16T21:32:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa604076320 msgr2=0x7fa604078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa604076320 0x7fa604078830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006f40 tx=0x7fa60c009240 comp rx=0 tx=0).stop 2024-05-16T21:32:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6200b5d80 msgr2=0x7fa62014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6200b5d80 0x7fa62014d180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa620071c40 tx=0x7fa6140046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 shutdown_connections 2024-05-16T21:32:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa604076320 0x7fa604078830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62009cc90 0x7fa6201ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6200b5d80 0x7fa62014d180 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 --2- 172.21.15.5:0/1835152705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6200a1d30 0x7fa62014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 >> 172.21.15.5:0/1835152705 conn(0x7fa6200bc000 msgr2=0x7fa6200bebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 shutdown_connections 2024-05-16T21:32:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.322+0000 7fa6265f3640 1 -- 172.21.15.5:0/1835152705 wait complete. 2024-05-16T21:32:30.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-05-16T21:32:30.336 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.345+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f03740e11b0 con 0x7f037403ada0 2024-05-16T21:32:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.345+0000 7f03637fe640 1 -- 172.21.15.5:0/1173165967 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f037403d350 con 0x7f037403ada0 2024-05-16T21:32:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-05-16T21:32:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f03680763a0 msgr2=0x7f03680788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f03680763a0 0x7f03680788b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03740bcf40 tx=0x7f0370008040 comp rx=0 tx=0).stop 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ada0 msgr2=0x7f03740bc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ada0 0x7f03740bc700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f036c009880 tx=0x7f036c0046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 shutdown_connections 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f03680763a0 0x7f03680788b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f037403ea00 0x7f03740d38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f037403cf40 0x7f0374036470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 --2- 172.21.15.5:0/1173165967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037403ada0 0x7f03740bc700 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.347+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 >> 172.21.15.5:0/1173165967 conn(0x7f037403f670 msgr2=0x7f037403d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.348+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 shutdown_connections 2024-05-16T21:32:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.348+0000 7f037bfff640 1 -- 172.21.15.5:0/1173165967 wait complete. 2024-05-16T21:32:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.349+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8534005580 con 0x7f85540b8d70 2024-05-16T21:32:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.350+0000 7f85517fa640 1 -- 172.21.15.5:0/921386229 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f854c081040 con 0x7f85540b8d70 2024-05-16T21:32:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.353+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85400763d0 msgr2=0x7f85400788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.353+0000 7f855b0c8640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85400763d0 0x7f85400788e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8554144e10 tx=0x7f8544009040 comp rx=0 tx=0).stop 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.353+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85540b8d70 msgr2=0x7f8554141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.353+0000 7f855b0c8640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85540b8d70 0x7f8554141300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f854c000f80 tx=0x7f854c004a40 comp rx=0 tx=0).stop 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.353+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 shutdown_connections 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.353+0000 7f855b0c8640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f85400763d0 0x7f85400788e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.354+0000 7f855b0c8640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f855414e530 0x7f8554151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.354+0000 7f855b0c8640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85540bd440 0x7f855413fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.354+0000 7f855b0c8640 1 --2- 172.21.15.5:0/921386229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85540b8d70 0x7f8554141300 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.354+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 >> 172.21.15.5:0/921386229 conn(0x7f85540c0570 msgr2=0x7f8554146f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.354+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 shutdown_connections 2024-05-16T21:32:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.354+0000 7f855b0c8640 1 -- 172.21.15.5:0/921386229 wait complete. 2024-05-16T21:32:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.354+0000 7f43e8ff9640 1 -- 172.21.15.5:0/1021608740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f43d4005580 con 0x7f43fc070780 2024-05-16T21:32:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.355+0000 7f43eaffd640 1 -- 172.21.15.5:0/1021608740 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43ec081c00 con 0x7f43fc070780 2024-05-16T21:32:30.358 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-05-16T21:32:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.357+0000 7f7864ff9640 1 -- 172.21.15.5:0/61109016 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f784c005580 con 0x7f78680cdd50 2024-05-16T21:32:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.357+0000 7f43e8ff9640 1 -- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43dc0762d0 msgr2=0x7f43dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.357+0000 7f43e8ff9640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43dc0762d0 0x7f43dc0787e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f43f40012e0 tx=0x7f43f4009040 comp rx=0 tx=0).stop 2024-05-16T21:32:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 -- 172.21.15.5:0/1021608740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43fc070780 msgr2=0x7f43fc0bb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43fc070780 0x7f43fc0bb5b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43ec02a620 tx=0x7f43ec0046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 -- 172.21.15.5:0/1021608740 shutdown_connections 2024-05-16T21:32:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f43dc0762d0 0x7f43dc0787e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43fc0b72b0 0x7f43fc0a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43fc070b90 0x7f43fc0b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 --2- 172.21.15.5:0/1021608740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43fc070780 0x7f43fc0bb5b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 -- 172.21.15.5:0/1021608740 >> 172.21.15.5:0/1021608740 conn(0x7f43fc0c1590 msgr2=0x7f43fc14d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f7866ffd640 1 -- 172.21.15.5:0/61109016 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7870101d50 con 0x7f78680cdd50 2024-05-16T21:32:30.362 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-05-16T21:32:30.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 -- 172.21.15.5:0/1021608740 shutdown_connections 2024-05-16T21:32:30.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.358+0000 7f43e8ff9640 1 -- 172.21.15.5:0/1021608740 wait complete. 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 -- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f78540763d0 msgr2=0x7f78540788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f78540763d0 0x7f78540788e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f786c001520 tx=0x7f786c009040 comp rx=0 tx=0).stop 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 -- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78680cdd50 msgr2=0x7f7868159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78680cdd50 0x7f7868159400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7870066130 tx=0x7f7870075e20 comp rx=0 tx=0).stop 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 -- 172.21.15.5:0/61109016 shutdown_connections 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f78540763d0 0x7f78540788e0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f786c001520 tx=0x7f786c009040 comp rx=0 tx=0).stop 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680c6210 0x7f78680c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78680cdd50 0x7f7868159400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 --2- 172.21.15.5:0/61109016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7868038050 0x7f78681657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 -- 172.21.15.5:0/61109016 >> 172.21.15.5:0/61109016 conn(0x7f786803f680 msgr2=0x7f78680371f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 -- 172.21.15.5:0/61109016 shutdown_connections 2024-05-16T21:32:30.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.360+0000 7f7864ff9640 1 -- 172.21.15.5:0/61109016 wait complete. 2024-05-16T21:32:30.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.361+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fec500058e0 con 0x7fec5003cb20 2024-05-16T21:32:30.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-05-16T21:32:30.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.362+0000 7fec4e7fc640 1 -- 172.21.15.5:0/2160023582 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fec5404a070 con 0x7fec5003cb20 2024-05-16T21:32:30.366 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-05-16T21:32:30.367 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:30.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.363+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc150005850 con 0x7fc16803a2e0 2024-05-16T21:32:30.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.364+0000 7fc15bfff640 1 -- 172.21.15.5:0/2599904292 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc16408a5c0 con 0x7fc16803a2e0 2024-05-16T21:32:30.367 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-05-16T21:32:30.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec3c076300 msgr2=0x7fec3c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec3c076300 0x7fec3c078810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec48006fd0 tx=0x7fec48008040 comp rx=0 tx=0).stop 2024-05-16T21:32:30.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003cb20 msgr2=0x7fec50036c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003cb20 0x7fec50036c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fec5402a790 tx=0x7fec540046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 shutdown_connections 2024-05-16T21:32:30.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec3c076300 0x7fec3c078810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec5003cb20 0x7fec50036c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec5003abd0 0x7fec50034de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 --2- 172.21.15.5:0/2160023582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5003a3d0 0x7fec500382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 >> 172.21.15.5:0/2160023582 conn(0x7fec50006520 msgr2=0x7fec500ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 shutdown_connections 2024-05-16T21:32:30.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.366+0000 7fec5ede7640 1 -- 172.21.15.5:0/2160023582 wait complete. 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.367+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc154076320 msgr2=0x7fc154078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.367+0000 7fc176067640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc154076320 0x7fc154078830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc15c006fd0 tx=0x7fc15c008040 comp rx=0 tx=0).stop 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.367+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc16803a2e0 msgr2=0x7fc168157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.367+0000 7fc176067640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc16803a2e0 0x7fc168157c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc16403a000 tx=0x7fc1640046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.367+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 shutdown_connections 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.367+0000 7fc176067640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc154076320 0x7fc154078830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.367+0000 7fc176067640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc168031c10 0x7fc168032020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.367+0000 7fc176067640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc16803a2e0 0x7fc168157c20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.368+0000 7fc176067640 1 --2- 172.21.15.5:0/2599904292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc168038260 0x7fc168030df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.368+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 >> 172.21.15.5:0/2599904292 conn(0x7fc16803f6b0 msgr2=0x7fc168006bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.368+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 shutdown_connections 2024-05-16T21:32:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.368+0000 7fc176067640 1 -- 172.21.15.5:0/2599904292 wait complete. 2024-05-16T21:32:30.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-05-16T21:32:30.374 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:30.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-05-16T21:32:30.378 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:30.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-05-16T21:32:30.380 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:30.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-05-16T21:32:30.388 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:30.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-05-16T21:32:30.389 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:30.389 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T21:32:30.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T21:32:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.536+0000 7f102755e640 1 Processor -- start 2024-05-16T21:32:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.537+0000 7f102755e640 1 -- start start 2024-05-16T21:32:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f102755e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f10200bd6d0 0x7f10200be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f102755e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10200bee80 0x7f1020158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f102755e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102006e140 con 0x7f1020151fc0 2024-05-16T21:32:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f102755e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f10200c36f0 con 0x7f10200bd6d0 2024-05-16T21:32:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f102755e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1020152530 con 0x7f10200bee80 2024-05-16T21:32:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f10252fa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1020151fc0 0x7f102006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35016/0 (socket says 172.21.15.5:35016) 2024-05-16T21:32:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f10252fa640 1 -- 172.21.15.5:0/2709861350 learned_addr learned my addr 172.21.15.5:0/2709861350 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1025afb640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10200bee80 0x7f1020158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727682096 0 0) 0x7f101c001110 con 0x7f1020151fc0 2024-05-16T21:32:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f100c003520 con 0x7f1020151fc0 2024-05-16T21:32:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1024af9640 1 --2- 172.21.15.5:0/2709861350 >> v2:172.21.15.157:3300/0 conn(0x7f10200bd6d0 0x7f10200be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 362830489 0 0) 0x7f100c003520 con 0x7f1020151fc0 2024-05-16T21:32:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10200bee80 msgr2=0x7f1020158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10200bee80 0x7f1020158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 >> v2:172.21.15.157:3300/0 conn(0x7f10200bd6d0 msgr2=0x7f10200be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 --2- 172.21.15.5:0/2709861350 >> v2:172.21.15.157:3300/0 conn(0x7f10200bd6d0 0x7f10200be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1020152810 con 0x7f1020151fc0 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f101c0018c0 con 0x7f1020151fc0 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 >> v1:172.21.15.5:6789/0 conn(0x7f1020151fc0 legacy=0x7f102006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10200bee80 0x7f100c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.538+0000 7f1017fff640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c004020 0x7f100c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1017fff640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c004d40 0x7f100c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f10200c36f0 con 0x7f100c004d40 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1020152530 con 0x7f100c004020 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f100c00bb20 con 0x7f10200bee80 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1025afb640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c004d40 0x7f100c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1024af9640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c004020 0x7f100c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f10252fa640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10200bee80 0x7f100c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1025afb640 1 -- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10200bee80 msgr2=0x7f100c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1025afb640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10200bee80 0x7f100c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1025afb640 1 -- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c004020 msgr2=0x7f100c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1025afb640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c004020 0x7f100c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.539+0000 7f1025afb640 1 -- 172.21.15.5:0/2709861350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c003520 con 0x7f100c004d40 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f1025afb640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c004d40 0x7f100c005150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1018009f90 tx=0x7f100c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b422efc3f2cd609f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018009c10 con 0x7f100c004d40 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1018036070 con 0x7f100c004d40 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f1017fff640 1 -- 172.21.15.5:0/2709861350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018031850 con 0x7f100c004d40 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f102755e640 1 -- 172.21.15.5:0/2709861350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c004d40 msgr2=0x7f100c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f102755e640 1 --2- 172.21.15.5:0/2709861350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c004d40 0x7f100c005150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1018009f90 tx=0x7f100c005830 comp rx=0 tx=0).stop 2024-05-16T21:32:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f1025afb640 1 -- 172.21.15.5:0/2709861350 reap_dead start 2024-05-16T21:32:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f102755e640 1 -- 172.21.15.5:0/2709861350 shutdown_connections 2024-05-16T21:32:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.540+0000 7f102755e640 1 -- 172.21.15.5:0/2709861350 >> 172.21.15.5:0/2709861350 conn(0x7f10200c3d20 msgr2=0x7f10200c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.541+0000 7f102755e640 1 -- 172.21.15.5:0/2709861350 shutdown_connections 2024-05-16T21:32:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.541+0000 7f102755e640 1 -- 172.21.15.5:0/2709861350 wait complete. 2024-05-16T21:32:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.542+0000 7f102755e640 1 Processor -- start 2024-05-16T21:32:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.542+0000 7f102755e640 1 -- start start 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f102755e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f100c004d40 0x7f10200a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f102755e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10200bb520 0x7f10200b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f102755e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10200b6490 0x7f10201e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f102755e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f10200bdae0 con 0x7f10200b6490 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f102755e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f10200c0070 con 0x7f10200bb520 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f102755e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f10200a2ed0 con 0x7f100c004d40 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f1025afb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10200b6490 0x7f10201e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f1025afb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10200b6490 0x7f10201e79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57890/0 (socket says 172.21.15.5:57890) 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f1025afb640 1 -- 172.21.15.5:0/2585144560 learned_addr learned my addr 172.21.15.5:0/2585144560 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f1024af9640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10200bb520 0x7f10200b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.543+0000 7f10252fa640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f100c004d40 0x7f10200a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1025afb640 1 -- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f100c004d40 msgr2=0x7f10200a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1025afb640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f100c004d40 0x7f10200a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1025afb640 1 -- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10200bb520 msgr2=0x7f10200b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1025afb640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10200bb520 0x7f10200b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1025afb640 1 -- 172.21.15.5:0/2585144560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10200a3fb0 con 0x7f10200b6490 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f10252fa640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f100c004d40 0x7f10200a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1024af9640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10200bb520 0x7f10200b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1025afb640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10200b6490 0x7f10201e79e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1018033040 tx=0x7f1018009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1015ffb640 1 -- 172.21.15.5:0/2585144560 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018009c10 con 0x7f10200b6490 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1015ffb640 1 -- 172.21.15.5:0/2585144560 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1018003990 con 0x7f10200b6490 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f1015ffb640 1 -- 172.21.15.5:0/2585144560 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018003d80 con 0x7f10200b6490 2024-05-16T21:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10201e4c30 con 0x7f10200b6490 2024-05-16T21:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.544+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10201e51f0 con 0x7f10200b6490 2024-05-16T21:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.545+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10201e53c0 con 0x7f10200b6490 2024-05-16T21:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.546+0000 7f1015ffb640 1 -- 172.21.15.5:0/2585144560 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1018005d10 con 0x7f10200b6490 2024-05-16T21:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.546+0000 7f1015ffb640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10040762d0 0x7f10040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.547+0000 7f1015ffb640 1 -- 172.21.15.5:0/2585144560 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f10180b8f20 con 0x7f10200b6490 2024-05-16T21:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.547+0000 7f10252fa640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10040762d0 0x7f10040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.547+0000 7f10252fa640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10040762d0 0x7f10040787e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f101c001330 tx=0x7f101c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:30.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.551+0000 7f1015ffb640 1 -- 172.21.15.5:0/2585144560 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f101804a060 con 0x7f10200b6490 2024-05-16T21:32:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.740+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1020050940 con 0x7f10040762d0 2024-05-16T21:32:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.746+0000 7f1015ffb640 1 -- 172.21.15.5:0/2585144560 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f1020050940 con 0x7f10040762d0 2024-05-16T21:32:30.751 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:30.753 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T21:32:30.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10040762d0 msgr2=0x7f10040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10040762d0 0x7f10040787e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f101c001330 tx=0x7f101c009040 comp rx=0 tx=0).stop 2024-05-16T21:32:30.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10200b6490 msgr2=0x7f10201e79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10200b6490 0x7f10201e79e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1018033040 tx=0x7f1018009750 comp rx=0 tx=0).stop 2024-05-16T21:32:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 shutdown_connections 2024-05-16T21:32:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f10040762d0 0x7f10040787e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10200b6490 0x7f10201e79e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10200bb520 0x7f10200b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 --2- 172.21.15.5:0/2585144560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f100c004d40 0x7f10200a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 >> 172.21.15.5:0/2585144560 conn(0x7f10200c3d20 msgr2=0x7f10200c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 shutdown_connections 2024-05-16T21:32:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.749+0000 7f102755e640 1 -- 172.21.15.5:0/2585144560 wait complete. 2024-05-16T21:32:30.763 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-16T21:32:30.365099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248200,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726520,"statfs":{"total":773094113280,"available":772839956480,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.419375"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950058+0000","last_change":"2024-05-16T21:32:21.976132+0000","last_active":"2024-05-16T21:32:22.950058+0000","last_peered":"2024-05-16T21:32:22.950058+0000","last_clean":"2024-05-16T21:32:22.950058+0000","last_became_active":"2024-05-16T21:32:21.975800+0000","last_became_peered":"2024-05-16T21:32:21.975800+0000","last_unstale":"2024-05-16T21:32:22.950058+0000","last_undegraded":"2024-05-16T21:32:22.950058+0000","last_fullsized":"2024-05-16T21:32:22.950058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:02:17.009863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947415+0000","last_change":"2024-05-16T21:32:21.978779+0000","last_active":"2024-05-16T21:32:22.947415+0000","last_peered":"2024-05-16T21:32:22.947415+0000","last_clean":"2024-05-16T21:32:22.947415+0000","last_became_active":"2024-05-16T21:32:21.978388+0000","last_became_peered":"2024-05-16T21:32:21.978388+0000","last_unstale":"2024-05-16T21:32:22.947415+0000","last_undegraded":"2024-05-16T21:32:22.947415+0000","last_fullsized":"2024-05-16T21:32:22.947415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205298+0000","last_change":"2024-05-16T21:32:21.956609+0000","last_active":"2024-05-16T21:32:23.205298+0000","last_peered":"2024-05-16T21:32:23.205298+0000","last_clean":"2024-05-16T21:32:23.205298+0000","last_became_active":"2024-05-16T21:32:21.954753+0000","last_became_peered":"2024-05-16T21:32:21.954753+0000","last_unstale":"2024-05-16T21:32:23.205298+0000","last_undegraded":"2024-05-16T21:32:23.205298+0000","last_fullsized":"2024-05-16T21:32:23.205298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204851+0000","last_change":"2024-05-16T21:32:21.974803+0000","last_active":"2024-05-16T21:32:23.204851+0000","last_peered":"2024-05-16T21:32:23.204851+0000","last_clean":"2024-05-16T21:32:23.204851+0000","last_became_active":"2024-05-16T21:32:21.974451+0000","last_became_peered":"2024-05-16T21:32:21.974451+0000","last_unstale":"2024-05-16T21:32:23.204851+0000","last_undegraded":"2024-05-16T21:32:23.204851+0000","last_fullsized":"2024-05-16T21:32:23.204851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948861+0000","last_change":"2024-05-16T21:32:21.963654+0000","last_active":"2024-05-16T21:32:22.948861+0000","last_peered":"2024-05-16T21:32:22.948861+0000","last_clean":"2024-05-16T21:32:22.948861+0000","last_became_active":"2024-05-16T21:32:21.963003+0000","last_became_peered":"2024-05-16T21:32:21.963003+0000","last_unstale":"2024-05-16T21:32:22.948861+0000","last_undegraded":"2024-05-16T21:32:22.948861+0000","last_fullsized":"2024-05-16T21:32:22.948861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:40:56.776802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204660+0000","last_change":"2024-05-16T21:32:21.978787+0000","last_active":"2024-05-16T21:32:23.204660+0000","last_peered":"2024-05-16T21:32:23.204660+0000","last_clean":"2024-05-16T21:32:23.204660+0000","last_became_active":"2024-05-16T21:32:21.978449+0000","last_became_peered":"2024-05-16T21:32:21.978449+0000","last_unstale":"2024-05-16T21:32:23.204660+0000","last_undegraded":"2024-05-16T21:32:23.204660+0000","last_fullsized":"2024-05-16T21:32:23.204660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948247+0000","last_change":"2024-05-16T21:32:21.967075+0000","last_active":"2024-05-16T21:32:22.948247+0000","last_peered":"2024-05-16T21:32:22.948247+0000","last_clean":"2024-05-16T21:32:22.948247+0000","last_became_active":"2024-05-16T21:32:21.966751+0000","last_became_peered":"2024-05-16T21:32:21.966751+0000","last_unstale":"2024-05-16T21:32:22.948247+0000","last_undegraded":"2024-05-16T21:32:22.948247+0000","last_fullsized":"2024-05-16T21:32:22.948247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204828+0000","last_change":"2024-05-16T21:32:21.967791+0000","last_active":"2024-05-16T21:32:23.204828+0000","last_peered":"2024-05-16T21:32:23.204828+0000","last_clean":"2024-05-16T21:32:23.204828+0000","last_became_active":"2024-05-16T21:32:21.966100+0000","last_became_peered":"2024-05-16T21:32:21.966100+0000","last_unstale":"2024-05-16T21:32:23.204828+0000","last_undegraded":"2024-05-16T21:32:23.204828+0000","last_fullsized":"2024-05-16T21:32:23.204828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950085+0000","last_change":"2024-05-16T21:32:21.969686+0000","last_active":"2024-05-16T21:32:22.950085+0000","last_peered":"2024-05-16T21:32:22.950085+0000","last_clean":"2024-05-16T21:32:22.950085+0000","last_became_active":"2024-05-16T21:32:21.967835+0000","last_became_peered":"2024-05-16T21:32:21.967835+0000","last_unstale":"2024-05-16T21:32:22.950085+0000","last_undegraded":"2024-05-16T21:32:22.950085+0000","last_fullsized":"2024-05-16T21:32:22.950085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:36:53.325809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952569+0000","last_change":"2024-05-16T21:32:21.979053+0000","last_active":"2024-05-16T21:32:22.952569+0000","last_peered":"2024-05-16T21:32:22.952569+0000","last_clean":"2024-05-16T21:32:22.952569+0000","last_became_active":"2024-05-16T21:32:21.978745+0000","last_became_peered":"2024-05-16T21:32:21.978745+0000","last_unstale":"2024-05-16T21:32:22.952569+0000","last_undegraded":"2024-05-16T21:32:22.952569+0000","last_fullsized":"2024-05-16T21:32:22.952569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952450+0000","last_change":"2024-05-16T21:32:21.978837+0000","last_active":"2024-05-16T21:32:22.952450+0000","last_peered":"2024-05-16T21:32:22.952450+0000","last_clean":"2024-05-16T21:32:22.952450+0000","last_became_active":"2024-05-16T21:32:21.978500+0000","last_became_peered":"2024-05-16T21:32:21.978500+0000","last_unstale":"2024-05-16T21:32:22.952450+0000","last_undegraded":"2024-05-16T21:32:22.952450+0000","last_fullsized":"2024-05-16T21:32:22.952450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949482+0000","last_change":"2024-05-16T21:32:21.976349+0000","last_active":"2024-05-16T21:32:22.949482+0000","last_peered":"2024-05-16T21:32:22.949482+0000","last_clean":"2024-05-16T21:32:22.949482+0000","last_became_active":"2024-05-16T21:32:21.976005+0000","last_became_peered":"2024-05-16T21:32:21.976005+0000","last_unstale":"2024-05-16T21:32:22.949482+0000","last_undegraded":"2024-05-16T21:32:22.949482+0000","last_fullsized":"2024-05-16T21:32:22.949482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:01.168602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205372+0000","last_change":"2024-05-16T21:32:21.963536+0000","last_active":"2024-05-16T21:32:23.205372+0000","last_peered":"2024-05-16T21:32:23.205372+0000","last_clean":"2024-05-16T21:32:23.205372+0000","last_became_active":"2024-05-16T21:32:21.963178+0000","last_became_peered":"2024-05-16T21:32:21.963178+0000","last_unstale":"2024-05-16T21:32:23.205372+0000","last_undegraded":"2024-05-16T21:32:23.205372+0000","last_fullsized":"2024-05-16T21:32:23.205372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204803+0000","last_change":"2024-05-16T21:32:21.964277+0000","last_active":"2024-05-16T21:32:23.204803+0000","last_peered":"2024-05-16T21:32:23.204803+0000","last_clean":"2024-05-16T21:32:23.204803+0000","last_became_active":"2024-05-16T21:32:21.963961+0000","last_became_peered":"2024-05-16T21:32:21.963961+0000","last_unstale":"2024-05-16T21:32:23.204803+0000","last_undegraded":"2024-05-16T21:32:23.204803+0000","last_fullsized":"2024-05-16T21:32:23.204803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:42:42.960425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947030+0000","last_change":"2024-05-16T21:32:21.972498+0000","last_active":"2024-05-16T21:32:22.947030+0000","last_peered":"2024-05-16T21:32:22.947030+0000","last_clean":"2024-05-16T21:32:22.947030+0000","last_became_active":"2024-05-16T21:32:21.972162+0000","last_became_peered":"2024-05-16T21:32:21.972162+0000","last_unstale":"2024-05-16T21:32:22.947030+0000","last_undegraded":"2024-05-16T21:32:22.947030+0000","last_fullsized":"2024-05-16T21:32:22.947030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204551+0000","last_change":"2024-05-16T21:32:21.978680+0000","last_active":"2024-05-16T21:32:23.204551+0000","last_peered":"2024-05-16T21:32:23.204551+0000","last_clean":"2024-05-16T21:32:23.204551+0000","last_became_active":"2024-05-16T21:32:21.978074+0000","last_became_peered":"2024-05-16T21:32:21.978074+0000","last_unstale":"2024-05-16T21:32:23.204551+0000","last_undegraded":"2024-05-16T21:32:23.204551+0000","last_fullsized":"2024-05-16T21:32:23.204551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205355+0000","last_change":"2024-05-16T21:32:21.964040+0000","last_active":"2024-05-16T21:32:23.205355+0000","last_peered":"2024-05-16T21:32:23.205355+0000","last_clean":"2024-05-16T21:32:23.205355+0000","last_became_active":"2024-05-16T21:32:21.963704+0000","last_became_peered":"2024-05-16T21:32:21.963704+0000","last_unstale":"2024-05-16T21:32:23.205355+0000","last_undegraded":"2024-05-16T21:32:23.205355+0000","last_fullsized":"2024-05-16T21:32:23.205355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:46:18.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204455+0000","last_change":"2024-05-16T21:32:21.963298+0000","last_active":"2024-05-16T21:32:23.204455+0000","last_peered":"2024-05-16T21:32:23.204455+0000","last_clean":"2024-05-16T21:32:23.204455+0000","last_became_active":"2024-05-16T21:32:21.962963+0000","last_became_peered":"2024-05-16T21:32:21.962963+0000","last_unstale":"2024-05-16T21:32:23.204455+0000","last_undegraded":"2024-05-16T21:32:23.204455+0000","last_fullsized":"2024-05-16T21:32:23.204455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:48.226628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949999+0000","last_change":"2024-05-16T21:32:21.972160+0000","last_active":"2024-05-16T21:32:22.949999+0000","last_peered":"2024-05-16T21:32:22.949999+0000","last_clean":"2024-05-16T21:32:22.949999+0000","last_became_active":"2024-05-16T21:32:21.971811+0000","last_became_peered":"2024-05-16T21:32:21.971811+0000","last_unstale":"2024-05-16T21:32:22.949999+0000","last_undegraded":"2024-05-16T21:32:22.949999+0000","last_fullsized":"2024-05-16T21:32:22.949999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:46:18.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952546+0000","last_change":"2024-05-16T21:32:21.972168+0000","last_active":"2024-05-16T21:32:22.952546+0000","last_peered":"2024-05-16T21:32:22.952546+0000","last_clean":"2024-05-16T21:32:22.952546+0000","last_became_active":"2024-05-16T21:32:21.971862+0000","last_became_peered":"2024-05-16T21:32:21.971862+0000","last_unstale":"2024-05-16T21:32:22.952546+0000","last_undegraded":"2024-05-16T21:32:22.952546+0000","last_fullsized":"2024-05-16T21:32:22.952546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205399+0000","last_change":"2024-05-16T21:32:21.974084+0000","last_active":"2024-05-16T21:32:23.205399+0000","last_peered":"2024-05-16T21:32:23.205399+0000","last_clean":"2024-05-16T21:32:23.205399+0000","last_became_active":"2024-05-16T21:32:21.973726+0000","last_became_peered":"2024-05-16T21:32:21.973726+0000","last_unstale":"2024-05-16T21:32:23.205399+0000","last_undegraded":"2024-05-16T21:32:23.205399+0000","last_fullsized":"2024-05-16T21:32:23.205399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204801+0000","last_change":"2024-05-16T21:32:21.978211+0000","last_active":"2024-05-16T21:32:23.204801+0000","last_peered":"2024-05-16T21:32:23.204801+0000","last_clean":"2024-05-16T21:32:23.204801+0000","last_became_active":"2024-05-16T21:32:21.977793+0000","last_became_peered":"2024-05-16T21:32:21.977793+0000","last_unstale":"2024-05-16T21:32:23.204801+0000","last_undegraded":"2024-05-16T21:32:23.204801+0000","last_fullsized":"2024-05-16T21:32:23.204801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:22:33.919329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204974+0000","last_change":"2024-05-16T21:32:21.963842+0000","last_active":"2024-05-16T21:32:23.204974+0000","last_peered":"2024-05-16T21:32:23.204974+0000","last_clean":"2024-05-16T21:32:23.204974+0000","last_became_active":"2024-05-16T21:32:21.963470+0000","last_became_peered":"2024-05-16T21:32:21.963470+0000","last_unstale":"2024-05-16T21:32:23.204974+0000","last_undegraded":"2024-05-16T21:32:23.204974+0000","last_fullsized":"2024-05-16T21:32:23.204974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204836+0000","last_change":"2024-05-16T21:32:21.976067+0000","last_active":"2024-05-16T21:32:23.204836+0000","last_peered":"2024-05-16T21:32:23.204836+0000","last_clean":"2024-05-16T21:32:23.204836+0000","last_became_active":"2024-05-16T21:32:21.975725+0000","last_became_peered":"2024-05-16T21:32:21.975725+0000","last_unstale":"2024-05-16T21:32:23.204836+0000","last_undegraded":"2024-05-16T21:32:23.204836+0000","last_fullsized":"2024-05-16T21:32:23.204836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:01:44.861353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205481+0000","last_change":"2024-05-16T21:32:21.961173+0000","last_active":"2024-05-16T21:32:23.205481+0000","last_peered":"2024-05-16T21:32:23.205481+0000","last_clean":"2024-05-16T21:32:23.205481+0000","last_became_active":"2024-05-16T21:32:21.960245+0000","last_became_peered":"2024-05-16T21:32:21.960245+0000","last_unstale":"2024-05-16T21:32:23.205481+0000","last_undegraded":"2024-05-16T21:32:23.205481+0000","last_fullsized":"2024-05-16T21:32:23.205481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952682+0000","last_change":"2024-05-16T21:32:21.978891+0000","last_active":"2024-05-16T21:32:22.952682+0000","last_peered":"2024-05-16T21:32:22.952682+0000","last_clean":"2024-05-16T21:32:22.952682+0000","last_became_active":"2024-05-16T21:32:21.978606+0000","last_became_peered":"2024-05-16T21:32:21.978606+0000","last_unstale":"2024-05-16T21:32:22.952682+0000","last_undegraded":"2024-05-16T21:32:22.952682+0000","last_fullsized":"2024-05-16T21:32:22.952682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947136+0000","last_change":"2024-05-16T21:32:21.970674+0000","last_active":"2024-05-16T21:32:22.947136+0000","last_peered":"2024-05-16T21:32:22.947136+0000","last_clean":"2024-05-16T21:32:22.947136+0000","last_became_active":"2024-05-16T21:32:21.970326+0000","last_became_peered":"2024-05-16T21:32:21.970326+0000","last_unstale":"2024-05-16T21:32:22.947136+0000","last_undegraded":"2024-05-16T21:32:22.947136+0000","last_fullsized":"2024-05-16T21:32:22.947136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205856+0000","last_change":"2024-05-16T21:32:21.967452+0000","last_active":"2024-05-16T21:32:23.205856+0000","last_peered":"2024-05-16T21:32:23.205856+0000","last_clean":"2024-05-16T21:32:23.205856+0000","last_became_active":"2024-05-16T21:32:21.966389+0000","last_became_peered":"2024-05-16T21:32:21.966389+0000","last_unstale":"2024-05-16T21:32:23.205856+0000","last_undegraded":"2024-05-16T21:32:23.205856+0000","last_fullsized":"2024-05-16T21:32:23.205856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205455+0000","last_change":"2024-05-16T21:32:21.957783+0000","last_active":"2024-05-16T21:32:23.205455+0000","last_peered":"2024-05-16T21:32:23.205455+0000","last_clean":"2024-05-16T21:32:23.205455+0000","last_became_active":"2024-05-16T21:32:21.957300+0000","last_became_peered":"2024-05-16T21:32:21.957300+0000","last_unstale":"2024-05-16T21:32:23.205455+0000","last_undegraded":"2024-05-16T21:32:23.205455+0000","last_fullsized":"2024-05-16T21:32:23.205455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204948+0000","last_change":"2024-05-16T21:32:21.975799+0000","last_active":"2024-05-16T21:32:23.204948+0000","last_peered":"2024-05-16T21:32:23.204948+0000","last_clean":"2024-05-16T21:32:23.204948+0000","last_became_active":"2024-05-16T21:32:21.975482+0000","last_became_peered":"2024-05-16T21:32:21.975482+0000","last_unstale":"2024-05-16T21:32:23.204948+0000","last_undegraded":"2024-05-16T21:32:23.204948+0000","last_fullsized":"2024-05-16T21:32:23.204948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204342+0000","last_change":"2024-05-16T21:32:21.964267+0000","last_active":"2024-05-16T21:32:23.204342+0000","last_peered":"2024-05-16T21:32:23.204342+0000","last_clean":"2024-05-16T21:32:23.204342+0000","last_became_active":"2024-05-16T21:32:21.963928+0000","last_became_peered":"2024-05-16T21:32:21.963928+0000","last_unstale":"2024-05-16T21:32:23.204342+0000","last_undegraded":"2024-05-16T21:32:23.204342+0000","last_fullsized":"2024-05-16T21:32:23.204342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:01.168602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952245+0000","last_change":"2024-05-16T21:32:21.970847+0000","last_active":"2024-05-16T21:32:22.952245+0000","last_peered":"2024-05-16T21:32:22.952245+0000","last_clean":"2024-05-16T21:32:22.952245+0000","last_became_active":"2024-05-16T21:32:21.970260+0000","last_became_peered":"2024-05-16T21:32:21.970260+0000","last_unstale":"2024-05-16T21:32:22.952245+0000","last_undegraded":"2024-05-16T21:32:22.952245+0000","last_fullsized":"2024-05-16T21:32:22.952245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948708+0000","last_change":"2024-05-16T21:32:21.968173+0000","last_active":"2024-05-16T21:32:22.948708+0000","last_peered":"2024-05-16T21:32:22.948708+0000","last_clean":"2024-05-16T21:32:22.948708+0000","last_became_active":"2024-05-16T21:32:21.967815+0000","last_became_peered":"2024-05-16T21:32:21.967815+0000","last_unstale":"2024-05-16T21:32:22.948708+0000","last_undegraded":"2024-05-16T21:32:22.948708+0000","last_fullsized":"2024-05-16T21:32:22.948708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:19.038761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205694+0000","last_change":"2024-05-16T21:32:20.969468+0000","last_active":"2024-05-16T21:32:23.205694+0000","last_peered":"2024-05-16T21:32:23.205694+0000","last_clean":"2024-05-16T21:32:23.205694+0000","last_became_active":"2024-05-16T21:32:20.969070+0000","last_became_peered":"2024-05-16T21:32:20.969070+0000","last_unstale":"2024-05-16T21:32:23.205694+0000","last_undegraded":"2024-05-16T21:32:23.205694+0000","last_fullsized":"2024-05-16T21:32:23.205694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205572+0000","last_change":"2024-05-16T21:32:21.962562+0000","last_active":"2024-05-16T21:32:23.205572+0000","last_peered":"2024-05-16T21:32:23.205572+0000","last_clean":"2024-05-16T21:32:23.205572+0000","last_became_active":"2024-05-16T21:32:21.960939+0000","last_became_peered":"2024-05-16T21:32:21.960939+0000","last_unstale":"2024-05-16T21:32:23.205572+0000","last_undegraded":"2024-05-16T21:32:23.205572+0000","last_fullsized":"2024-05-16T21:32:23.205572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952228+0000","last_change":"2024-05-16T21:32:20.963331+0000","last_active":"2024-05-16T21:32:22.952228+0000","last_peered":"2024-05-16T21:32:22.952228+0000","last_clean":"2024-05-16T21:32:22.952228+0000","last_became_active":"2024-05-16T21:32:20.963022+0000","last_became_peered":"2024-05-16T21:32:20.963022+0000","last_unstale":"2024-05-16T21:32:22.952228+0000","last_undegraded":"2024-05-16T21:32:22.952228+0000","last_fullsized":"2024-05-16T21:32:22.952228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205155+0000","last_change":"2024-05-16T21:32:20.963234+0000","last_active":"2024-05-16T21:32:23.205155+0000","last_peered":"2024-05-16T21:32:23.205155+0000","last_clean":"2024-05-16T21:32:23.205155+0000","last_became_active":"2024-05-16T21:32:20.962909+0000","last_became_peered":"2024-05-16T21:32:20.962909+0000","last_unstale":"2024-05-16T21:32:23.205155+0000","last_undegraded":"2024-05-16T21:32:23.205155+0000","last_fullsized":"2024-05-16T21:32:23.205155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:53:28.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205007+0000","last_change":"2024-05-16T21:32:21.958029+0000","last_active":"2024-05-16T21:32:23.205007+0000","last_peered":"2024-05-16T21:32:23.205007+0000","last_clean":"2024-05-16T21:32:23.205007+0000","last_became_active":"2024-05-16T21:32:21.957650+0000","last_became_peered":"2024-05-16T21:32:21.957650+0000","last_unstale":"2024-05-16T21:32:23.205007+0000","last_undegraded":"2024-05-16T21:32:23.205007+0000","last_fullsized":"2024-05-16T21:32:23.205007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204693+0000","last_change":"2024-05-16T21:32:20.963432+0000","last_active":"2024-05-16T21:32:23.204693+0000","last_peered":"2024-05-16T21:32:23.204693+0000","last_clean":"2024-05-16T21:32:23.204693+0000","last_became_active":"2024-05-16T21:32:20.963062+0000","last_became_peered":"2024-05-16T21:32:20.963062+0000","last_unstale":"2024-05-16T21:32:23.204693+0000","last_undegraded":"2024-05-16T21:32:23.204693+0000","last_fullsized":"2024-05-16T21:32:23.204693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947016+0000","last_change":"2024-05-16T21:32:21.971148+0000","last_active":"2024-05-16T21:32:22.947016+0000","last_peered":"2024-05-16T21:32:22.947016+0000","last_clean":"2024-05-16T21:32:22.947016+0000","last_became_active":"2024-05-16T21:32:21.970842+0000","last_became_peered":"2024-05-16T21:32:21.970842+0000","last_unstale":"2024-05-16T21:32:22.947016+0000","last_undegraded":"2024-05-16T21:32:22.947016+0000","last_fullsized":"2024-05-16T21:32:22.947016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952504+0000","last_change":"2024-05-16T21:32:20.966317+0000","last_active":"2024-05-16T21:32:22.952504+0000","last_peered":"2024-05-16T21:32:22.952504+0000","last_clean":"2024-05-16T21:32:22.952504+0000","last_became_active":"2024-05-16T21:32:20.966009+0000","last_became_peered":"2024-05-16T21:32:20.966009+0000","last_unstale":"2024-05-16T21:32:22.952504+0000","last_undegraded":"2024-05-16T21:32:22.952504+0000","last_fullsized":"2024-05-16T21:32:22.952504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204973+0000","last_change":"2024-05-16T21:32:21.977643+0000","last_active":"2024-05-16T21:32:23.204973+0000","last_peered":"2024-05-16T21:32:23.204973+0000","last_clean":"2024-05-16T21:32:23.204973+0000","last_became_active":"2024-05-16T21:32:21.977335+0000","last_became_peered":"2024-05-16T21:32:21.977335+0000","last_unstale":"2024-05-16T21:32:23.204973+0000","last_undegraded":"2024-05-16T21:32:23.204973+0000","last_fullsized":"2024-05-16T21:32:23.204973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205222+0000","last_change":"2024-05-16T21:32:20.965401+0000","last_active":"2024-05-16T21:32:23.205222+0000","last_peered":"2024-05-16T21:32:23.205222+0000","last_clean":"2024-05-16T21:32:23.205222+0000","last_became_active":"2024-05-16T21:32:20.964989+0000","last_became_peered":"2024-05-16T21:32:20.964989+0000","last_unstale":"2024-05-16T21:32:23.205222+0000","last_undegraded":"2024-05-16T21:32:23.205222+0000","last_fullsized":"2024-05-16T21:32:23.205222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205076+0000","last_change":"2024-05-16T21:32:21.968344+0000","last_active":"2024-05-16T21:32:23.205076+0000","last_peered":"2024-05-16T21:32:23.205076+0000","last_clean":"2024-05-16T21:32:23.205076+0000","last_became_active":"2024-05-16T21:32:21.966870+0000","last_became_peered":"2024-05-16T21:32:21.966870+0000","last_unstale":"2024-05-16T21:32:23.205076+0000","last_undegraded":"2024-05-16T21:32:23.205076+0000","last_fullsized":"2024-05-16T21:32:23.205076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947126+0000","last_change":"2024-05-16T21:32:20.964832+0000","last_active":"2024-05-16T21:32:22.947126+0000","last_peered":"2024-05-16T21:32:22.947126+0000","last_clean":"2024-05-16T21:32:22.947126+0000","last_became_active":"2024-05-16T21:32:20.964458+0000","last_became_peered":"2024-05-16T21:32:20.964458+0000","last_unstale":"2024-05-16T21:32:22.947126+0000","last_undegraded":"2024-05-16T21:32:22.947126+0000","last_fullsized":"2024-05-16T21:32:22.947126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949526+0000","last_change":"2024-05-16T21:32:21.974914+0000","last_active":"2024-05-16T21:32:22.949526+0000","last_peered":"2024-05-16T21:32:22.949526+0000","last_clean":"2024-05-16T21:32:22.949526+0000","last_became_active":"2024-05-16T21:32:21.974607+0000","last_became_peered":"2024-05-16T21:32:21.974607+0000","last_unstale":"2024-05-16T21:32:22.949526+0000","last_undegraded":"2024-05-16T21:32:22.949526+0000","last_fullsized":"2024-05-16T21:32:22.949526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:48.226628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952564+0000","last_change":"2024-05-16T21:32:20.966220+0000","last_active":"2024-05-16T21:32:22.952564+0000","last_peered":"2024-05-16T21:32:22.952564+0000","last_clean":"2024-05-16T21:32:22.952564+0000","last_became_active":"2024-05-16T21:32:20.965498+0000","last_became_peered":"2024-05-16T21:32:20.965498+0000","last_unstale":"2024-05-16T21:32:22.952564+0000","last_undegraded":"2024-05-16T21:32:22.952564+0000","last_fullsized":"2024-05-16T21:32:22.952564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948771+0000","last_change":"2024-05-16T21:32:21.973995+0000","last_active":"2024-05-16T21:32:22.948771+0000","last_peered":"2024-05-16T21:32:22.948771+0000","last_clean":"2024-05-16T21:32:22.948771+0000","last_became_active":"2024-05-16T21:32:21.972703+0000","last_became_peered":"2024-05-16T21:32:21.972703+0000","last_unstale":"2024-05-16T21:32:22.948771+0000","last_undegraded":"2024-05-16T21:32:22.948771+0000","last_fullsized":"2024-05-16T21:32:22.948771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:15.421446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205568+0000","last_change":"2024-05-16T21:32:20.953536+0000","last_active":"2024-05-16T21:32:23.205568+0000","last_peered":"2024-05-16T21:32:23.205568+0000","last_clean":"2024-05-16T21:32:23.205568+0000","last_became_active":"2024-05-16T21:32:20.953195+0000","last_became_peered":"2024-05-16T21:32:20.953195+0000","last_unstale":"2024-05-16T21:32:23.205568+0000","last_undegraded":"2024-05-16T21:32:23.205568+0000","last_fullsized":"2024-05-16T21:32:23.205568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:37:41.623319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205056+0000","last_change":"2024-05-16T21:32:21.962049+0000","last_active":"2024-05-16T21:32:23.205056+0000","last_peered":"2024-05-16T21:32:23.205056+0000","last_clean":"2024-05-16T21:32:23.205056+0000","last_became_active":"2024-05-16T21:32:21.961632+0000","last_became_peered":"2024-05-16T21:32:21.961632+0000","last_unstale":"2024-05-16T21:32:23.205056+0000","last_undegraded":"2024-05-16T21:32:23.205056+0000","last_fullsized":"2024-05-16T21:32:23.205056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:16.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204985+0000","last_change":"2024-05-16T21:32:20.968243+0000","last_active":"2024-05-16T21:32:23.204985+0000","last_peered":"2024-05-16T21:32:23.204985+0000","last_clean":"2024-05-16T21:32:23.204985+0000","last_became_active":"2024-05-16T21:32:20.967901+0000","last_became_peered":"2024-05-16T21:32:20.967901+0000","last_unstale":"2024-05-16T21:32:23.204985+0000","last_undegraded":"2024-05-16T21:32:23.204985+0000","last_fullsized":"2024-05-16T21:32:23.204985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948912+0000","last_change":"2024-05-16T21:32:21.963926+0000","last_active":"2024-05-16T21:32:22.948912+0000","last_peered":"2024-05-16T21:32:22.948912+0000","last_clean":"2024-05-16T21:32:22.948912+0000","last_became_active":"2024-05-16T21:32:21.963333+0000","last_became_peered":"2024-05-16T21:32:21.963333+0000","last_unstale":"2024-05-16T21:32:22.948912+0000","last_undegraded":"2024-05-16T21:32:22.948912+0000","last_fullsized":"2024-05-16T21:32:22.948912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:26.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952200+0000","last_change":"2024-05-16T21:32:20.960218+0000","last_active":"2024-05-16T21:32:22.952200+0000","last_peered":"2024-05-16T21:32:22.952200+0000","last_clean":"2024-05-16T21:32:22.952200+0000","last_became_active":"2024-05-16T21:32:20.959870+0000","last_became_peered":"2024-05-16T21:32:20.959870+0000","last_unstale":"2024-05-16T21:32:22.952200+0000","last_undegraded":"2024-05-16T21:32:22.952200+0000","last_fullsized":"2024-05-16T21:32:22.952200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952216+0000","last_change":"2024-05-16T21:32:21.970587+0000","last_active":"2024-05-16T21:32:22.952216+0000","last_peered":"2024-05-16T21:32:22.952216+0000","last_clean":"2024-05-16T21:32:22.952216+0000","last_became_active":"2024-05-16T21:32:21.969859+0000","last_became_peered":"2024-05-16T21:32:21.969859+0000","last_unstale":"2024-05-16T21:32:22.952216+0000","last_undegraded":"2024-05-16T21:32:22.952216+0000","last_fullsized":"2024-05-16T21:32:22.952216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:19:22.267338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205276+0000","last_change":"2024-05-16T21:32:20.955486+0000","last_active":"2024-05-16T21:32:23.205276+0000","last_peered":"2024-05-16T21:32:23.205276+0000","last_clean":"2024-05-16T21:32:23.205276+0000","last_became_active":"2024-05-16T21:32:20.955104+0000","last_became_peered":"2024-05-16T21:32:20.955104+0000","last_unstale":"2024-05-16T21:32:23.205276+0000","last_undegraded":"2024-05-16T21:32:23.205276+0000","last_fullsized":"2024-05-16T21:32:23.205276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:53:28.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948444+0000","last_change":"2024-05-16T21:32:21.975286+0000","last_active":"2024-05-16T21:32:22.948444+0000","last_peered":"2024-05-16T21:32:22.948444+0000","last_clean":"2024-05-16T21:32:22.948444+0000","last_became_active":"2024-05-16T21:32:21.974919+0000","last_became_peered":"2024-05-16T21:32:21.974919+0000","last_unstale":"2024-05-16T21:32:22.948444+0000","last_undegraded":"2024-05-16T21:32:22.948444+0000","last_fullsized":"2024-05-16T21:32:22.948444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948892+0000","last_change":"2024-05-16T21:32:20.958267+0000","last_active":"2024-05-16T21:32:22.948892+0000","last_peered":"2024-05-16T21:32:22.948892+0000","last_clean":"2024-05-16T21:32:22.948892+0000","last_became_active":"2024-05-16T21:32:20.957945+0000","last_became_peered":"2024-05-16T21:32:20.957945+0000","last_unstale":"2024-05-16T21:32:22.948892+0000","last_undegraded":"2024-05-16T21:32:22.948892+0000","last_fullsized":"2024-05-16T21:32:22.948892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:12.938490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950015+0000","last_change":"2024-05-16T21:32:21.964539+0000","last_active":"2024-05-16T21:32:22.950015+0000","last_peered":"2024-05-16T21:32:22.950015+0000","last_clean":"2024-05-16T21:32:22.950015+0000","last_became_active":"2024-05-16T21:32:21.962499+0000","last_became_peered":"2024-05-16T21:32:21.962499+0000","last_unstale":"2024-05-16T21:32:22.950015+0000","last_undegraded":"2024-05-16T21:32:22.950015+0000","last_fullsized":"2024-05-16T21:32:22.950015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:08:57.226640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204577+0000","last_change":"2024-05-16T21:32:20.966720+0000","last_active":"2024-05-16T21:32:23.204577+0000","last_peered":"2024-05-16T21:32:23.204577+0000","last_clean":"2024-05-16T21:32:23.204577+0000","last_became_active":"2024-05-16T21:32:20.966403+0000","last_became_peered":"2024-05-16T21:32:20.966403+0000","last_unstale":"2024-05-16T21:32:23.204577+0000","last_undegraded":"2024-05-16T21:32:23.204577+0000","last_fullsized":"2024-05-16T21:32:23.204577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950173+0000","last_change":"2024-05-16T21:32:21.966883+0000","last_active":"2024-05-16T21:32:22.950173+0000","last_peered":"2024-05-16T21:32:22.950173+0000","last_clean":"2024-05-16T21:32:22.950173+0000","last_became_active":"2024-05-16T21:32:21.966493+0000","last_became_peered":"2024-05-16T21:32:21.966493+0000","last_unstale":"2024-05-16T21:32:22.950173+0000","last_undegraded":"2024-05-16T21:32:22.950173+0000","last_fullsized":"2024-05-16T21:32:22.950173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:51.561288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947243+0000","last_change":"2024-05-16T21:32:20.953581+0000","last_active":"2024-05-16T21:32:22.947243+0000","last_peered":"2024-05-16T21:32:22.947243+0000","last_clean":"2024-05-16T21:32:22.947243+0000","last_became_active":"2024-05-16T21:32:20.953237+0000","last_became_peered":"2024-05-16T21:32:20.953237+0000","last_unstale":"2024-05-16T21:32:22.947243+0000","last_undegraded":"2024-05-16T21:32:22.947243+0000","last_fullsized":"2024-05-16T21:32:22.947243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205106+0000","last_change":"2024-05-16T21:32:21.975314+0000","last_active":"2024-05-16T21:32:23.205106+0000","last_peered":"2024-05-16T21:32:23.205106+0000","last_clean":"2024-05-16T21:32:23.205106+0000","last_became_active":"2024-05-16T21:32:21.975001+0000","last_became_peered":"2024-05-16T21:32:21.975001+0000","last_unstale":"2024-05-16T21:32:23.205106+0000","last_undegraded":"2024-05-16T21:32:23.205106+0000","last_fullsized":"2024-05-16T21:32:23.205106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:40:56.776802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204320+0000","last_change":"2024-05-16T21:32:20.966198+0000","last_active":"2024-05-16T21:32:23.204320+0000","last_peered":"2024-05-16T21:32:23.204320+0000","last_clean":"2024-05-16T21:32:23.204320+0000","last_became_active":"2024-05-16T21:32:20.965864+0000","last_became_peered":"2024-05-16T21:32:20.965864+0000","last_unstale":"2024-05-16T21:32:23.204320+0000","last_undegraded":"2024-05-16T21:32:23.204320+0000","last_fullsized":"2024-05-16T21:32:23.204320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948960+0000","last_change":"2024-05-16T21:32:21.968642+0000","last_active":"2024-05-16T21:32:22.948960+0000","last_peered":"2024-05-16T21:32:22.948960+0000","last_clean":"2024-05-16T21:32:22.948960+0000","last_became_active":"2024-05-16T21:32:21.968084+0000","last_became_peered":"2024-05-16T21:32:21.968084+0000","last_unstale":"2024-05-16T21:32:22.948960+0000","last_undegraded":"2024-05-16T21:32:22.948960+0000","last_fullsized":"2024-05-16T21:32:22.948960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:41:08.428677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948023+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T21:32:22.948023+0000","last_peered":"2024-05-16T21:32:22.948023+0000","last_clean":"2024-05-16T21:32:22.948023+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T21:32:22.948023+0000","last_undegraded":"2024-05-16T21:32:22.948023+0000","last_fullsized":"2024-05-16T21:32:22.948023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204626+0000","last_change":"2024-05-16T21:32:20.964695+0000","last_active":"2024-05-16T21:32:23.204626+0000","last_peered":"2024-05-16T21:32:23.204626+0000","last_clean":"2024-05-16T21:32:23.204626+0000","last_became_active":"2024-05-16T21:32:20.963727+0000","last_became_peered":"2024-05-16T21:32:20.963727+0000","last_unstale":"2024-05-16T21:32:23.204626+0000","last_undegraded":"2024-05-16T21:32:23.204626+0000","last_fullsized":"2024-05-16T21:32:23.204626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205555+0000","last_change":"2024-05-16T21:32:21.967136+0000","last_active":"2024-05-16T21:32:23.205555+0000","last_peered":"2024-05-16T21:32:23.205555+0000","last_clean":"2024-05-16T21:32:23.205555+0000","last_became_active":"2024-05-16T21:32:21.966780+0000","last_became_peered":"2024-05-16T21:32:21.966780+0000","last_unstale":"2024-05-16T21:32:23.205555+0000","last_undegraded":"2024-05-16T21:32:23.205555+0000","last_fullsized":"2024-05-16T21:32:23.205555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949105+0000","last_change":"2024-05-16T21:32:20.958213+0000","last_active":"2024-05-16T21:32:22.949105+0000","last_peered":"2024-05-16T21:32:22.949105+0000","last_clean":"2024-05-16T21:32:22.949105+0000","last_became_active":"2024-05-16T21:32:20.957898+0000","last_became_peered":"2024-05-16T21:32:20.957898+0000","last_unstale":"2024-05-16T21:32:22.949105+0000","last_undegraded":"2024-05-16T21:32:22.949105+0000","last_fullsized":"2024-05-16T21:32:22.949105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:47.220802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204489+0000","last_change":"2024-05-16T21:32:21.968841+0000","last_active":"2024-05-16T21:32:23.204489+0000","last_peered":"2024-05-16T21:32:23.204489+0000","last_clean":"2024-05-16T21:32:23.204489+0000","last_became_active":"2024-05-16T21:32:21.968322+0000","last_became_peered":"2024-05-16T21:32:21.968322+0000","last_unstale":"2024-05-16T21:32:23.204489+0000","last_undegraded":"2024-05-16T21:32:23.204489+0000","last_fullsized":"2024-05-16T21:32:23.204489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:05.477666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204469+0000","last_change":"2024-05-16T21:32:20.967828+0000","last_active":"2024-05-16T21:32:23.204469+0000","last_peered":"2024-05-16T21:32:23.204469+0000","last_clean":"2024-05-16T21:32:23.204469+0000","last_became_active":"2024-05-16T21:32:20.967418+0000","last_became_peered":"2024-05-16T21:32:20.967418+0000","last_unstale":"2024-05-16T21:32:23.204469+0000","last_undegraded":"2024-05-16T21:32:23.204469+0000","last_fullsized":"2024-05-16T21:32:23.204469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947214+0000","last_change":"2024-05-16T21:32:21.961302+0000","last_active":"2024-05-16T21:32:22.947214+0000","last_peered":"2024-05-16T21:32:22.947214+0000","last_clean":"2024-05-16T21:32:22.947214+0000","last_became_active":"2024-05-16T21:32:21.960763+0000","last_became_peered":"2024-05-16T21:32:21.960763+0000","last_unstale":"2024-05-16T21:32:22.947214+0000","last_undegraded":"2024-05-16T21:32:22.947214+0000","last_fullsized":"2024-05-16T21:32:22.947214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205119+0000","last_change":"2024-05-16T21:32:20.964419+0000","last_active":"2024-05-16T21:32:23.205119+0000","last_peered":"2024-05-16T21:32:23.205119+0000","last_clean":"2024-05-16T21:32:23.205119+0000","last_became_active":"2024-05-16T21:32:20.964093+0000","last_became_peered":"2024-05-16T21:32:20.964093+0000","last_unstale":"2024-05-16T21:32:23.205119+0000","last_undegraded":"2024-05-16T21:32:23.205119+0000","last_fullsized":"2024-05-16T21:32:23.205119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948592+0000","last_change":"2024-05-16T21:32:21.958086+0000","last_active":"2024-05-16T21:32:22.948592+0000","last_peered":"2024-05-16T21:32:22.948592+0000","last_clean":"2024-05-16T21:32:22.948592+0000","last_became_active":"2024-05-16T21:32:21.957701+0000","last_became_peered":"2024-05-16T21:32:21.957701+0000","last_unstale":"2024-05-16T21:32:22.948592+0000","last_undegraded":"2024-05-16T21:32:22.948592+0000","last_fullsized":"2024-05-16T21:32:22.948592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:01.206393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947265+0000","last_change":"2024-05-16T21:32:20.959456+0000","last_active":"2024-05-16T21:32:22.947265+0000","last_peered":"2024-05-16T21:32:22.947265+0000","last_clean":"2024-05-16T21:32:22.947265+0000","last_became_active":"2024-05-16T21:32:20.959154+0000","last_became_peered":"2024-05-16T21:32:20.959154+0000","last_unstale":"2024-05-16T21:32:22.947265+0000","last_undegraded":"2024-05-16T21:32:22.947265+0000","last_fullsized":"2024-05-16T21:32:22.947265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205258+0000","last_change":"2024-05-16T21:32:21.974993+0000","last_active":"2024-05-16T21:32:23.205258+0000","last_peered":"2024-05-16T21:32:23.205258+0000","last_clean":"2024-05-16T21:32:23.205258+0000","last_became_active":"2024-05-16T21:32:21.974284+0000","last_became_peered":"2024-05-16T21:32:21.974284+0000","last_unstale":"2024-05-16T21:32:23.205258+0000","last_undegraded":"2024-05-16T21:32:23.205258+0000","last_fullsized":"2024-05-16T21:32:23.205258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:26.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950079+0000","last_change":"2024-05-16T21:32:20.960943+0000","last_active":"2024-05-16T21:32:22.950079+0000","last_peered":"2024-05-16T21:32:22.950079+0000","last_clean":"2024-05-16T21:32:22.950079+0000","last_became_active":"2024-05-16T21:32:20.960501+0000","last_became_peered":"2024-05-16T21:32:20.960501+0000","last_unstale":"2024-05-16T21:32:22.950079+0000","last_undegraded":"2024-05-16T21:32:22.950079+0000","last_fullsized":"2024-05-16T21:32:22.950079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:04.471840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947201+0000","last_change":"2024-05-16T21:32:21.966653+0000","last_active":"2024-05-16T21:32:22.947201+0000","last_peered":"2024-05-16T21:32:22.947201+0000","last_clean":"2024-05-16T21:32:22.947201+0000","last_became_active":"2024-05-16T21:32:21.966311+0000","last_became_peered":"2024-05-16T21:32:21.966311+0000","last_unstale":"2024-05-16T21:32:22.947201+0000","last_undegraded":"2024-05-16T21:32:22.947201+0000","last_fullsized":"2024-05-16T21:32:22.947201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.951673+0000","last_change":"2024-05-16T21:32:20.965931+0000","last_active":"2024-05-16T21:32:22.951673+0000","last_peered":"2024-05-16T21:32:22.951673+0000","last_clean":"2024-05-16T21:32:22.951673+0000","last_became_active":"2024-05-16T21:32:20.965603+0000","last_became_peered":"2024-05-16T21:32:20.965603+0000","last_unstale":"2024-05-16T21:32:22.951673+0000","last_undegraded":"2024-05-16T21:32:22.951673+0000","last_fullsized":"2024-05-16T21:32:22.951673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205566+0000","last_change":"2024-05-16T21:32:21.958052+0000","last_active":"2024-05-16T21:32:23.205566+0000","last_peered":"2024-05-16T21:32:23.205566+0000","last_clean":"2024-05-16T21:32:23.205566+0000","last_became_active":"2024-05-16T21:32:21.957690+0000","last_became_peered":"2024-05-16T21:32:21.957690+0000","last_unstale":"2024-05-16T21:32:23.205566+0000","last_undegraded":"2024-05-16T21:32:23.205566+0000","last_fullsized":"2024-05-16T21:32:23.205566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:22:33.919329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952599+0000","last_change":"2024-05-16T21:32:20.967895+0000","last_active":"2024-05-16T21:32:22.952599+0000","last_peered":"2024-05-16T21:32:22.952599+0000","last_clean":"2024-05-16T21:32:22.952599+0000","last_became_active":"2024-05-16T21:32:20.967450+0000","last_became_peered":"2024-05-16T21:32:20.967450+0000","last_unstale":"2024-05-16T21:32:22.952599+0000","last_undegraded":"2024-05-16T21:32:22.952599+0000","last_fullsized":"2024-05-16T21:32:22.952599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205220+0000","last_change":"2024-05-16T21:32:21.963459+0000","last_active":"2024-05-16T21:32:23.205220+0000","last_peered":"2024-05-16T21:32:23.205220+0000","last_clean":"2024-05-16T21:32:23.205220+0000","last_became_active":"2024-05-16T21:32:21.963137+0000","last_became_peered":"2024-05-16T21:32:21.963137+0000","last_unstale":"2024-05-16T21:32:23.205220+0000","last_undegraded":"2024-05-16T21:32:23.205220+0000","last_fullsized":"2024-05-16T21:32:23.205220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947954+0000","last_change":"2024-05-16T21:32:20.962252+0000","last_active":"2024-05-16T21:32:22.947954+0000","last_peered":"2024-05-16T21:32:22.947954+0000","last_clean":"2024-05-16T21:32:22.947954+0000","last_became_active":"2024-05-16T21:32:20.960720+0000","last_became_peered":"2024-05-16T21:32:20.960720+0000","last_unstale":"2024-05-16T21:32:22.947954+0000","last_undegraded":"2024-05-16T21:32:22.947954+0000","last_fullsized":"2024-05-16T21:32:22.947954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:00.162776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949215+0000","last_change":"2024-05-16T21:32:21.962732+0000","last_active":"2024-05-16T21:32:22.949215+0000","last_peered":"2024-05-16T21:32:22.949215+0000","last_clean":"2024-05-16T21:32:22.949215+0000","last_became_active":"2024-05-16T21:32:21.961668+0000","last_became_peered":"2024-05-16T21:32:21.961668+0000","last_unstale":"2024-05-16T21:32:22.949215+0000","last_undegraded":"2024-05-16T21:32:22.949215+0000","last_fullsized":"2024-05-16T21:32:22.949215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:10.289046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947142+0000","last_change":"2024-05-16T21:32:20.961726+0000","last_active":"2024-05-16T21:32:22.947142+0000","last_peered":"2024-05-16T21:32:22.947142+0000","last_clean":"2024-05-16T21:32:22.947142+0000","last_became_active":"2024-05-16T21:32:20.961210+0000","last_became_peered":"2024-05-16T21:32:20.961210+0000","last_unstale":"2024-05-16T21:32:22.947142+0000","last_undegraded":"2024-05-16T21:32:22.947142+0000","last_fullsized":"2024-05-16T21:32:22.947142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:00.162776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205183+0000","last_change":"2024-05-16T21:32:21.969756+0000","last_active":"2024-05-16T21:32:23.205183+0000","last_peered":"2024-05-16T21:32:23.205183+0000","last_clean":"2024-05-16T21:32:23.205183+0000","last_became_active":"2024-05-16T21:32:21.969427+0000","last_became_peered":"2024-05-16T21:32:21.969427+0000","last_unstale":"2024-05-16T21:32:23.205183+0000","last_undegraded":"2024-05-16T21:32:23.205183+0000","last_fullsized":"2024-05-16T21:32:23.205183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947319+0000","last_change":"2024-05-16T21:32:20.963280+0000","last_active":"2024-05-16T21:32:22.947319+0000","last_peered":"2024-05-16T21:32:22.947319+0000","last_clean":"2024-05-16T21:32:22.947319+0000","last_became_active":"2024-05-16T21:32:20.962938+0000","last_became_peered":"2024-05-16T21:32:20.962938+0000","last_unstale":"2024-05-16T21:32:22.947319+0000","last_undegraded":"2024-05-16T21:32:22.947319+0000","last_fullsized":"2024-05-16T21:32:22.947319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:47.220802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205655+0000","last_change":"2024-05-16T21:32:21.956288+0000","last_active":"2024-05-16T21:32:23.205655+0000","last_peered":"2024-05-16T21:32:23.205655+0000","last_clean":"2024-05-16T21:32:23.205655+0000","last_became_active":"2024-05-16T21:32:21.955765+0000","last_became_peered":"2024-05-16T21:32:21.955765+0000","last_unstale":"2024-05-16T21:32:23.205655+0000","last_undegraded":"2024-05-16T21:32:23.205655+0000","last_fullsized":"2024-05-16T21:32:23.205655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:01:44.861353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949002+0000","last_change":"2024-05-16T21:32:20.959535+0000","last_active":"2024-05-16T21:32:22.949002+0000","last_peered":"2024-05-16T21:32:22.949002+0000","last_clean":"2024-05-16T21:32:22.949002+0000","last_became_active":"2024-05-16T21:32:20.959011+0000","last_became_peered":"2024-05-16T21:32:20.959011+0000","last_unstale":"2024-05-16T21:32:22.949002+0000","last_undegraded":"2024-05-16T21:32:22.949002+0000","last_fullsized":"2024-05-16T21:32:22.949002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:42:41.954599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952283+0000","last_change":"2024-05-16T21:32:21.970736+0000","last_active":"2024-05-16T21:32:22.952283+0000","last_peered":"2024-05-16T21:32:22.952283+0000","last_clean":"2024-05-16T21:32:22.952283+0000","last_became_active":"2024-05-16T21:32:21.970296+0000","last_became_peered":"2024-05-16T21:32:21.970296+0000","last_unstale":"2024-05-16T21:32:22.952283+0000","last_undegraded":"2024-05-16T21:32:22.952283+0000","last_fullsized":"2024-05-16T21:32:22.952283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205253+0000","last_change":"2024-05-16T21:32:21.975252+0000","last_active":"2024-05-16T21:32:23.205253+0000","last_peered":"2024-05-16T21:32:23.205253+0000","last_clean":"2024-05-16T21:32:23.205253+0000","last_became_active":"2024-05-16T21:32:21.974676+0000","last_became_peered":"2024-05-16T21:32:21.974676+0000","last_unstale":"2024-05-16T21:32:23.205253+0000","last_undegraded":"2024-05-16T21:32:23.205253+0000","last_fullsized":"2024-05-16T21:32:23.205253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:41:08.428677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949848+0000","last_change":"2024-05-16T21:32:20.962780+0000","last_active":"2024-05-16T21:32:22.949848+0000","last_peered":"2024-05-16T21:32:22.949848+0000","last_clean":"2024-05-16T21:32:22.949848+0000","last_became_active":"2024-05-16T21:32:20.962322+0000","last_became_peered":"2024-05-16T21:32:20.962322+0000","last_unstale":"2024-05-16T21:32:22.949848+0000","last_undegraded":"2024-05-16T21:32:22.949848+0000","last_fullsized":"2024-05-16T21:32:22.949848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:53:43.525691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204971+0000","last_change":"2024-05-16T21:32:21.980984+0000","last_active":"2024-05-16T21:32:23.204971+0000","last_peered":"2024-05-16T21:32:23.204971+0000","last_clean":"2024-05-16T21:32:23.204971+0000","last_became_active":"2024-05-16T21:32:21.980660+0000","last_became_peered":"2024-05-16T21:32:21.980660+0000","last_unstale":"2024-05-16T21:32:23.204971+0000","last_undegraded":"2024-05-16T21:32:23.204971+0000","last_fullsized":"2024-05-16T21:32:23.204971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:15.421446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949920+0000","last_change":"2024-05-16T21:32:20.961620+0000","last_active":"2024-05-16T21:32:22.949920+0000","last_peered":"2024-05-16T21:32:22.949920+0000","last_clean":"2024-05-16T21:32:22.949920+0000","last_became_active":"2024-05-16T21:32:20.960591+0000","last_became_peered":"2024-05-16T21:32:20.960591+0000","last_unstale":"2024-05-16T21:32:22.949920+0000","last_undegraded":"2024-05-16T21:32:22.949920+0000","last_fullsized":"2024-05-16T21:32:22.949920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:05:47.168701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205068+0000","last_change":"2024-05-16T21:32:21.967631+0000","last_active":"2024-05-16T21:32:23.205068+0000","last_peered":"2024-05-16T21:32:23.205068+0000","last_clean":"2024-05-16T21:32:23.205068+0000","last_became_active":"2024-05-16T21:32:21.967230+0000","last_became_peered":"2024-05-16T21:32:21.967230+0000","last_unstale":"2024-05-16T21:32:23.205068+0000","last_undegraded":"2024-05-16T21:32:23.205068+0000","last_fullsized":"2024-05-16T21:32:23.205068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:19:22.267338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205795+0000","last_change":"2024-05-16T21:32:20.968463+0000","last_active":"2024-05-16T21:32:23.205795+0000","last_peered":"2024-05-16T21:32:23.205795+0000","last_clean":"2024-05-16T21:32:23.205795+0000","last_became_active":"2024-05-16T21:32:20.967280+0000","last_became_peered":"2024-05-16T21:32:20.967280+0000","last_unstale":"2024-05-16T21:32:23.205795+0000","last_undegraded":"2024-05-16T21:32:23.205795+0000","last_fullsized":"2024-05-16T21:32:23.205795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205674+0000","last_change":"2024-05-16T21:32:21.963511+0000","last_active":"2024-05-16T21:32:23.205674+0000","last_peered":"2024-05-16T21:32:23.205674+0000","last_clean":"2024-05-16T21:32:23.205674+0000","last_became_active":"2024-05-16T21:32:21.963215+0000","last_became_peered":"2024-05-16T21:32:21.963215+0000","last_unstale":"2024-05-16T21:32:23.205674+0000","last_undegraded":"2024-05-16T21:32:23.205674+0000","last_fullsized":"2024-05-16T21:32:23.205674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205197+0000","last_change":"2024-05-16T21:32:20.954854+0000","last_active":"2024-05-16T21:32:23.205197+0000","last_peered":"2024-05-16T21:32:23.205197+0000","last_clean":"2024-05-16T21:32:23.205197+0000","last_became_active":"2024-05-16T21:32:20.954461+0000","last_became_peered":"2024-05-16T21:32:20.954461+0000","last_unstale":"2024-05-16T21:32:23.205197+0000","last_undegraded":"2024-05-16T21:32:23.205197+0000","last_fullsized":"2024-05-16T21:32:23.205197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:17:50.700469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T21:32:30.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T21:32:30.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.911+0000 7f74f732d640 1 Processor -- start 2024-05-16T21:32:30.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.912+0000 7f74f732d640 1 -- start start 2024-05-16T21:32:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f732d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74f014e440 0x7f74f00b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f732d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f74f00bd770 0x7f74f00ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f732d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f014e9b0 con 0x7f74f00b8a20 2024-05-16T21:32:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f732d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f74f014ec90 con 0x7f74f014e440 2024-05-16T21:32:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f732d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f74f014ef70 con 0x7f74f00bd770 2024-05-16T21:32:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f50c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74f014e440 0x7f74f00b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f50c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74f014e440 0x7f74f00b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57902/0 (socket says 172.21.15.5:57902) 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f50c9640 1 -- 172.21.15.5:0/2394421857 learned_addr learned my addr 172.21.15.5:0/2394421857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f58ca640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f74f00b8a20 0x7f74f00b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35026/0 (socket says 172.21.15.5:35026) 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f48c8640 1 --2- 172.21.15.5:0/2394421857 >> v2:172.21.15.157:3300/0 conn(0x7f74f00bd770 0x7f74f00ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f50c9640 1 -- 172.21.15.5:0/2394421857 >> v2:172.21.15.157:3300/0 conn(0x7f74f00bd770 msgr2=0x7f74f00ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f50c9640 1 --2- 172.21.15.5:0/2394421857 >> v2:172.21.15.157:3300/0 conn(0x7f74f00bd770 0x7f74f00ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f50c9640 1 -- 172.21.15.5:0/2394421857 >> v1:172.21.15.5:6789/0 conn(0x7f74f00b8a20 legacy=0x7f74f00b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74f50c9640 1 -- 172.21.15.5:0/2394421857 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f014f250 con 0x7f74f014e440 2024-05-16T21:32:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.913+0000 7f74e7fff640 1 -- 172.21.15.5:0/2394421857 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402265820 0 0) 0x7f74f014e9b0 con 0x7f74f00b8a20 2024-05-16T21:32:30.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.914+0000 7f74f50c9640 1 --2- 172.21.15.5:0/2394421857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f00b99c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74f00bb960 tx=0x7f74ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822e779be8a57686 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.914+0000 7f74e7fff640 1 -- 172.21.15.5:0/2394421857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec037070 con 0x7f74f014e440 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.914+0000 7f74e7fff640 1 -- 172.21.15.5:0/2394421857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec032440 con 0x7f74f014e440 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.914+0000 7f74e7fff640 1 -- 172.21.15.5:0/2394421857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec032810 con 0x7f74f014e440 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.915+0000 7f74f732d640 1 -- 172.21.15.5:0/2394421857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 msgr2=0x7f74f00b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.915+0000 7f74f732d640 1 --2- 172.21.15.5:0/2394421857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f00b99c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74f00bb960 tx=0x7f74ec02a270 comp rx=0 tx=0).stop 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.915+0000 7f74f732d640 1 -- 172.21.15.5:0/2394421857 shutdown_connections 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.915+0000 7f74f732d640 1 --2- 172.21.15.5:0/2394421857 >> v2:172.21.15.157:3300/0 conn(0x7f74f00bd770 0x7f74f00ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.915+0000 7f74f732d640 1 --2- 172.21.15.5:0/2394421857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f00b99c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.915+0000 7f74f732d640 1 -- 172.21.15.5:0/2394421857 >> 172.21.15.5:0/2394421857 conn(0x7f74f00c0390 msgr2=0x7f74f00c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.915+0000 7f74f732d640 1 -- 172.21.15.5:0/2394421857 shutdown_connections 2024-05-16T21:32:30.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.915+0000 7f74f732d640 1 -- 172.21.15.5:0/2394421857 wait complete. 2024-05-16T21:32:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.916+0000 7f74f732d640 1 Processor -- start 2024-05-16T21:32:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.916+0000 7f74f732d640 1 -- start start 2024-05-16T21:32:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.917+0000 7f74f732d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74f00b8a20 0x7f74f01e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.917+0000 7f74f732d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74f00bd770 0x7f74f01d8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.917+0000 7f74f732d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f01d91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.917+0000 7f74f732d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00ba900 con 0x7f74f014e440 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.917+0000 7f74f732d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00ba780 con 0x7f74f00b8a20 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.917+0000 7f74f732d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00bdb80 con 0x7f74f00bd770 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f01d91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f01d91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57916/0 (socket says 172.21.15.5:57916) 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 -- 172.21.15.5:0/3044393578 learned_addr learned my addr 172.21.15.5:0/3044393578 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f50c9640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74f00b8a20 0x7f74f01e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f48c8640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74f00bd770 0x7f74f01d8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 -- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74f00bd770 msgr2=0x7f74f01d8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74f00bd770 0x7f74f01d8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 -- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74f00b8a20 msgr2=0x7f74f01e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74f00b8a20 0x7f74f01e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 -- 172.21.15.5:0/3044393578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f01e81a0 con 0x7f74f014e440 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f58ca640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f01d91c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c6b0 tx=0x7f74e800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74e5ffb640 1 -- 172.21.15.5:0/3044393578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8018070 con 0x7f74f014e440 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74e5ffb640 1 -- 172.21.15.5:0/3044393578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e8004da0 con 0x7f74f014e440 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f01da1b0 con 0x7f74f014e440 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74e5ffb640 1 -- 172.21.15.5:0/3044393578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e800a880 con 0x7f74f014e440 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.918+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f01e7740 con 0x7f74f014e440 2024-05-16T21:32:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.920+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f01da380 con 0x7f74f014e440 2024-05-16T21:32:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.920+0000 7f74e5ffb640 1 -- 172.21.15.5:0/3044393578 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f74e801b070 con 0x7f74f014e440 2024-05-16T21:32:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.921+0000 7f74e5ffb640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f74d40762d0 0x7f74d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.921+0000 7f74e5ffb640 1 -- 172.21.15.5:0/3044393578 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f74e8096b60 con 0x7f74f014e440 2024-05-16T21:32:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.921+0000 7f74f50c9640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f74d40762d0 0x7f74d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.922+0000 7f74f50c9640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f74d40762d0 0x7f74d40787e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74ec034000 tx=0x7f74ec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:30.926+0000 7f74e5ffb640 1 -- 172.21.15.5:0/3044393578 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f74e805fe70 con 0x7f74f014e440 2024-05-16T21:32:31.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.114+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74f0050940 con 0x7f74d40762d0 2024-05-16T21:32:31.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.121+0000 7f74e5ffb640 1 -- 172.21.15.5:0/3044393578 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f74f0050940 con 0x7f74d40762d0 2024-05-16T21:32:31.126 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:31.127 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f74d40762d0 msgr2=0x7f74d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f74d40762d0 0x7f74d40787e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74ec034000 tx=0x7f74ec02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 msgr2=0x7f74f01d91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f01d91c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c6b0 tx=0x7f74e800cb70 comp rx=0 tx=0).stop 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 shutdown_connections 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f74d40762d0 0x7f74d40787e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014e440 0x7f74f01d91c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74f00bd770 0x7f74f01d8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 --2- 172.21.15.5:0/3044393578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74f00b8a20 0x7f74f01e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 >> 172.21.15.5:0/3044393578 conn(0x7f74f00c0390 msgr2=0x7f74f00bbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 shutdown_connections 2024-05-16T21:32:31.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.124+0000 7f74f732d640 1 -- 172.21.15.5:0/3044393578 wait complete. 2024-05-16T21:32:31.138 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-16T21:32:30.365099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248200,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726520,"statfs":{"total":773094113280,"available":772839956480,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.419375"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950058+0000","last_change":"2024-05-16T21:32:21.976132+0000","last_active":"2024-05-16T21:32:22.950058+0000","last_peered":"2024-05-16T21:32:22.950058+0000","last_clean":"2024-05-16T21:32:22.950058+0000","last_became_active":"2024-05-16T21:32:21.975800+0000","last_became_peered":"2024-05-16T21:32:21.975800+0000","last_unstale":"2024-05-16T21:32:22.950058+0000","last_undegraded":"2024-05-16T21:32:22.950058+0000","last_fullsized":"2024-05-16T21:32:22.950058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:02:17.009863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947415+0000","last_change":"2024-05-16T21:32:21.978779+0000","last_active":"2024-05-16T21:32:22.947415+0000","last_peered":"2024-05-16T21:32:22.947415+0000","last_clean":"2024-05-16T21:32:22.947415+0000","last_became_active":"2024-05-16T21:32:21.978388+0000","last_became_peered":"2024-05-16T21:32:21.978388+0000","last_unstale":"2024-05-16T21:32:22.947415+0000","last_undegraded":"2024-05-16T21:32:22.947415+0000","last_fullsized":"2024-05-16T21:32:22.947415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205298+0000","last_change":"2024-05-16T21:32:21.956609+0000","last_active":"2024-05-16T21:32:23.205298+0000","last_peered":"2024-05-16T21:32:23.205298+0000","last_clean":"2024-05-16T21:32:23.205298+0000","last_became_active":"2024-05-16T21:32:21.954753+0000","last_became_peered":"2024-05-16T21:32:21.954753+0000","last_unstale":"2024-05-16T21:32:23.205298+0000","last_undegraded":"2024-05-16T21:32:23.205298+0000","last_fullsized":"2024-05-16T21:32:23.205298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204851+0000","last_change":"2024-05-16T21:32:21.974803+0000","last_active":"2024-05-16T21:32:23.204851+0000","last_peered":"2024-05-16T21:32:23.204851+0000","last_clean":"2024-05-16T21:32:23.204851+0000","last_became_active":"2024-05-16T21:32:21.974451+0000","last_became_peered":"2024-05-16T21:32:21.974451+0000","last_unstale":"2024-05-16T21:32:23.204851+0000","last_undegraded":"2024-05-16T21:32:23.204851+0000","last_fullsized":"2024-05-16T21:32:23.204851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948861+0000","last_change":"2024-05-16T21:32:21.963654+0000","last_active":"2024-05-16T21:32:22.948861+0000","last_peered":"2024-05-16T21:32:22.948861+0000","last_clean":"2024-05-16T21:32:22.948861+0000","last_became_active":"2024-05-16T21:32:21.963003+0000","last_became_peered":"2024-05-16T21:32:21.963003+0000","last_unstale":"2024-05-16T21:32:22.948861+0000","last_undegraded":"2024-05-16T21:32:22.948861+0000","last_fullsized":"2024-05-16T21:32:22.948861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:40:56.776802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204660+0000","last_change":"2024-05-16T21:32:21.978787+0000","last_active":"2024-05-16T21:32:23.204660+0000","last_peered":"2024-05-16T21:32:23.204660+0000","last_clean":"2024-05-16T21:32:23.204660+0000","last_became_active":"2024-05-16T21:32:21.978449+0000","last_became_peered":"2024-05-16T21:32:21.978449+0000","last_unstale":"2024-05-16T21:32:23.204660+0000","last_undegraded":"2024-05-16T21:32:23.204660+0000","last_fullsized":"2024-05-16T21:32:23.204660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948247+0000","last_change":"2024-05-16T21:32:21.967075+0000","last_active":"2024-05-16T21:32:22.948247+0000","last_peered":"2024-05-16T21:32:22.948247+0000","last_clean":"2024-05-16T21:32:22.948247+0000","last_became_active":"2024-05-16T21:32:21.966751+0000","last_became_peered":"2024-05-16T21:32:21.966751+0000","last_unstale":"2024-05-16T21:32:22.948247+0000","last_undegraded":"2024-05-16T21:32:22.948247+0000","last_fullsized":"2024-05-16T21:32:22.948247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204828+0000","last_change":"2024-05-16T21:32:21.967791+0000","last_active":"2024-05-16T21:32:23.204828+0000","last_peered":"2024-05-16T21:32:23.204828+0000","last_clean":"2024-05-16T21:32:23.204828+0000","last_became_active":"2024-05-16T21:32:21.966100+0000","last_became_peered":"2024-05-16T21:32:21.966100+0000","last_unstale":"2024-05-16T21:32:23.204828+0000","last_undegraded":"2024-05-16T21:32:23.204828+0000","last_fullsized":"2024-05-16T21:32:23.204828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950085+0000","last_change":"2024-05-16T21:32:21.969686+0000","last_active":"2024-05-16T21:32:22.950085+0000","last_peered":"2024-05-16T21:32:22.950085+0000","last_clean":"2024-05-16T21:32:22.950085+0000","last_became_active":"2024-05-16T21:32:21.967835+0000","last_became_peered":"2024-05-16T21:32:21.967835+0000","last_unstale":"2024-05-16T21:32:22.950085+0000","last_undegraded":"2024-05-16T21:32:22.950085+0000","last_fullsized":"2024-05-16T21:32:22.950085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:36:53.325809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952569+0000","last_change":"2024-05-16T21:32:21.979053+0000","last_active":"2024-05-16T21:32:22.952569+0000","last_peered":"2024-05-16T21:32:22.952569+0000","last_clean":"2024-05-16T21:32:22.952569+0000","last_became_active":"2024-05-16T21:32:21.978745+0000","last_became_peered":"2024-05-16T21:32:21.978745+0000","last_unstale":"2024-05-16T21:32:22.952569+0000","last_undegraded":"2024-05-16T21:32:22.952569+0000","last_fullsized":"2024-05-16T21:32:22.952569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952450+0000","last_change":"2024-05-16T21:32:21.978837+0000","last_active":"2024-05-16T21:32:22.952450+0000","last_peered":"2024-05-16T21:32:22.952450+0000","last_clean":"2024-05-16T21:32:22.952450+0000","last_became_active":"2024-05-16T21:32:21.978500+0000","last_became_peered":"2024-05-16T21:32:21.978500+0000","last_unstale":"2024-05-16T21:32:22.952450+0000","last_undegraded":"2024-05-16T21:32:22.952450+0000","last_fullsized":"2024-05-16T21:32:22.952450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949482+0000","last_change":"2024-05-16T21:32:21.976349+0000","last_active":"2024-05-16T21:32:22.949482+0000","last_peered":"2024-05-16T21:32:22.949482+0000","last_clean":"2024-05-16T21:32:22.949482+0000","last_became_active":"2024-05-16T21:32:21.976005+0000","last_became_peered":"2024-05-16T21:32:21.976005+0000","last_unstale":"2024-05-16T21:32:22.949482+0000","last_undegraded":"2024-05-16T21:32:22.949482+0000","last_fullsized":"2024-05-16T21:32:22.949482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:01.168602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205372+0000","last_change":"2024-05-16T21:32:21.963536+0000","last_active":"2024-05-16T21:32:23.205372+0000","last_peered":"2024-05-16T21:32:23.205372+0000","last_clean":"2024-05-16T21:32:23.205372+0000","last_became_active":"2024-05-16T21:32:21.963178+0000","last_became_peered":"2024-05-16T21:32:21.963178+0000","last_unstale":"2024-05-16T21:32:23.205372+0000","last_undegraded":"2024-05-16T21:32:23.205372+0000","last_fullsized":"2024-05-16T21:32:23.205372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204803+0000","last_change":"2024-05-16T21:32:21.964277+0000","last_active":"2024-05-16T21:32:23.204803+0000","last_peered":"2024-05-16T21:32:23.204803+0000","last_clean":"2024-05-16T21:32:23.204803+0000","last_became_active":"2024-05-16T21:32:21.963961+0000","last_became_peered":"2024-05-16T21:32:21.963961+0000","last_unstale":"2024-05-16T21:32:23.204803+0000","last_undegraded":"2024-05-16T21:32:23.204803+0000","last_fullsized":"2024-05-16T21:32:23.204803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:42:42.960425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947030+0000","last_change":"2024-05-16T21:32:21.972498+0000","last_active":"2024-05-16T21:32:22.947030+0000","last_peered":"2024-05-16T21:32:22.947030+0000","last_clean":"2024-05-16T21:32:22.947030+0000","last_became_active":"2024-05-16T21:32:21.972162+0000","last_became_peered":"2024-05-16T21:32:21.972162+0000","last_unstale":"2024-05-16T21:32:22.947030+0000","last_undegraded":"2024-05-16T21:32:22.947030+0000","last_fullsized":"2024-05-16T21:32:22.947030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204551+0000","last_change":"2024-05-16T21:32:21.978680+0000","last_active":"2024-05-16T21:32:23.204551+0000","last_peered":"2024-05-16T21:32:23.204551+0000","last_clean":"2024-05-16T21:32:23.204551+0000","last_became_active":"2024-05-16T21:32:21.978074+0000","last_became_peered":"2024-05-16T21:32:21.978074+0000","last_unstale":"2024-05-16T21:32:23.204551+0000","last_undegraded":"2024-05-16T21:32:23.204551+0000","last_fullsized":"2024-05-16T21:32:23.204551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205355+0000","last_change":"2024-05-16T21:32:21.964040+0000","last_active":"2024-05-16T21:32:23.205355+0000","last_peered":"2024-05-16T21:32:23.205355+0000","last_clean":"2024-05-16T21:32:23.205355+0000","last_became_active":"2024-05-16T21:32:21.963704+0000","last_became_peered":"2024-05-16T21:32:21.963704+0000","last_unstale":"2024-05-16T21:32:23.205355+0000","last_undegraded":"2024-05-16T21:32:23.205355+0000","last_fullsized":"2024-05-16T21:32:23.205355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:46:18.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204455+0000","last_change":"2024-05-16T21:32:21.963298+0000","last_active":"2024-05-16T21:32:23.204455+0000","last_peered":"2024-05-16T21:32:23.204455+0000","last_clean":"2024-05-16T21:32:23.204455+0000","last_became_active":"2024-05-16T21:32:21.962963+0000","last_became_peered":"2024-05-16T21:32:21.962963+0000","last_unstale":"2024-05-16T21:32:23.204455+0000","last_undegraded":"2024-05-16T21:32:23.204455+0000","last_fullsized":"2024-05-16T21:32:23.204455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:48.226628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949999+0000","last_change":"2024-05-16T21:32:21.972160+0000","last_active":"2024-05-16T21:32:22.949999+0000","last_peered":"2024-05-16T21:32:22.949999+0000","last_clean":"2024-05-16T21:32:22.949999+0000","last_became_active":"2024-05-16T21:32:21.971811+0000","last_became_peered":"2024-05-16T21:32:21.971811+0000","last_unstale":"2024-05-16T21:32:22.949999+0000","last_undegraded":"2024-05-16T21:32:22.949999+0000","last_fullsized":"2024-05-16T21:32:22.949999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:46:18.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952546+0000","last_change":"2024-05-16T21:32:21.972168+0000","last_active":"2024-05-16T21:32:22.952546+0000","last_peered":"2024-05-16T21:32:22.952546+0000","last_clean":"2024-05-16T21:32:22.952546+0000","last_became_active":"2024-05-16T21:32:21.971862+0000","last_became_peered":"2024-05-16T21:32:21.971862+0000","last_unstale":"2024-05-16T21:32:22.952546+0000","last_undegraded":"2024-05-16T21:32:22.952546+0000","last_fullsized":"2024-05-16T21:32:22.952546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205399+0000","last_change":"2024-05-16T21:32:21.974084+0000","last_active":"2024-05-16T21:32:23.205399+0000","last_peered":"2024-05-16T21:32:23.205399+0000","last_clean":"2024-05-16T21:32:23.205399+0000","last_became_active":"2024-05-16T21:32:21.973726+0000","last_became_peered":"2024-05-16T21:32:21.973726+0000","last_unstale":"2024-05-16T21:32:23.205399+0000","last_undegraded":"2024-05-16T21:32:23.205399+0000","last_fullsized":"2024-05-16T21:32:23.205399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204801+0000","last_change":"2024-05-16T21:32:21.978211+0000","last_active":"2024-05-16T21:32:23.204801+0000","last_peered":"2024-05-16T21:32:23.204801+0000","last_clean":"2024-05-16T21:32:23.204801+0000","last_became_active":"2024-05-16T21:32:21.977793+0000","last_became_peered":"2024-05-16T21:32:21.977793+0000","last_unstale":"2024-05-16T21:32:23.204801+0000","last_undegraded":"2024-05-16T21:32:23.204801+0000","last_fullsized":"2024-05-16T21:32:23.204801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:22:33.919329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204974+0000","last_change":"2024-05-16T21:32:21.963842+0000","last_active":"2024-05-16T21:32:23.204974+0000","last_peered":"2024-05-16T21:32:23.204974+0000","last_clean":"2024-05-16T21:32:23.204974+0000","last_became_active":"2024-05-16T21:32:21.963470+0000","last_became_peered":"2024-05-16T21:32:21.963470+0000","last_unstale":"2024-05-16T21:32:23.204974+0000","last_undegraded":"2024-05-16T21:32:23.204974+0000","last_fullsized":"2024-05-16T21:32:23.204974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204836+0000","last_change":"2024-05-16T21:32:21.976067+0000","last_active":"2024-05-16T21:32:23.204836+0000","last_peered":"2024-05-16T21:32:23.204836+0000","last_clean":"2024-05-16T21:32:23.204836+0000","last_became_active":"2024-05-16T21:32:21.975725+0000","last_became_peered":"2024-05-16T21:32:21.975725+0000","last_unstale":"2024-05-16T21:32:23.204836+0000","last_undegraded":"2024-05-16T21:32:23.204836+0000","last_fullsized":"2024-05-16T21:32:23.204836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:01:44.861353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205481+0000","last_change":"2024-05-16T21:32:21.961173+0000","last_active":"2024-05-16T21:32:23.205481+0000","last_peered":"2024-05-16T21:32:23.205481+0000","last_clean":"2024-05-16T21:32:23.205481+0000","last_became_active":"2024-05-16T21:32:21.960245+0000","last_became_peered":"2024-05-16T21:32:21.960245+0000","last_unstale":"2024-05-16T21:32:23.205481+0000","last_undegraded":"2024-05-16T21:32:23.205481+0000","last_fullsized":"2024-05-16T21:32:23.205481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952682+0000","last_change":"2024-05-16T21:32:21.978891+0000","last_active":"2024-05-16T21:32:22.952682+0000","last_peered":"2024-05-16T21:32:22.952682+0000","last_clean":"2024-05-16T21:32:22.952682+0000","last_became_active":"2024-05-16T21:32:21.978606+0000","last_became_peered":"2024-05-16T21:32:21.978606+0000","last_unstale":"2024-05-16T21:32:22.952682+0000","last_undegraded":"2024-05-16T21:32:22.952682+0000","last_fullsized":"2024-05-16T21:32:22.952682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947136+0000","last_change":"2024-05-16T21:32:21.970674+0000","last_active":"2024-05-16T21:32:22.947136+0000","last_peered":"2024-05-16T21:32:22.947136+0000","last_clean":"2024-05-16T21:32:22.947136+0000","last_became_active":"2024-05-16T21:32:21.970326+0000","last_became_peered":"2024-05-16T21:32:21.970326+0000","last_unstale":"2024-05-16T21:32:22.947136+0000","last_undegraded":"2024-05-16T21:32:22.947136+0000","last_fullsized":"2024-05-16T21:32:22.947136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205856+0000","last_change":"2024-05-16T21:32:21.967452+0000","last_active":"2024-05-16T21:32:23.205856+0000","last_peered":"2024-05-16T21:32:23.205856+0000","last_clean":"2024-05-16T21:32:23.205856+0000","last_became_active":"2024-05-16T21:32:21.966389+0000","last_became_peered":"2024-05-16T21:32:21.966389+0000","last_unstale":"2024-05-16T21:32:23.205856+0000","last_undegraded":"2024-05-16T21:32:23.205856+0000","last_fullsized":"2024-05-16T21:32:23.205856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205455+0000","last_change":"2024-05-16T21:32:21.957783+0000","last_active":"2024-05-16T21:32:23.205455+0000","last_peered":"2024-05-16T21:32:23.205455+0000","last_clean":"2024-05-16T21:32:23.205455+0000","last_became_active":"2024-05-16T21:32:21.957300+0000","last_became_peered":"2024-05-16T21:32:21.957300+0000","last_unstale":"2024-05-16T21:32:23.205455+0000","last_undegraded":"2024-05-16T21:32:23.205455+0000","last_fullsized":"2024-05-16T21:32:23.205455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:58:20.115851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204948+0000","last_change":"2024-05-16T21:32:21.975799+0000","last_active":"2024-05-16T21:32:23.204948+0000","last_peered":"2024-05-16T21:32:23.204948+0000","last_clean":"2024-05-16T21:32:23.204948+0000","last_became_active":"2024-05-16T21:32:21.975482+0000","last_became_peered":"2024-05-16T21:32:21.975482+0000","last_unstale":"2024-05-16T21:32:23.204948+0000","last_undegraded":"2024-05-16T21:32:23.204948+0000","last_fullsized":"2024-05-16T21:32:23.204948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204342+0000","last_change":"2024-05-16T21:32:21.964267+0000","last_active":"2024-05-16T21:32:23.204342+0000","last_peered":"2024-05-16T21:32:23.204342+0000","last_clean":"2024-05-16T21:32:23.204342+0000","last_became_active":"2024-05-16T21:32:21.963928+0000","last_became_peered":"2024-05-16T21:32:21.963928+0000","last_unstale":"2024-05-16T21:32:23.204342+0000","last_undegraded":"2024-05-16T21:32:23.204342+0000","last_fullsized":"2024-05-16T21:32:23.204342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:01.168602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952245+0000","last_change":"2024-05-16T21:32:21.970847+0000","last_active":"2024-05-16T21:32:22.952245+0000","last_peered":"2024-05-16T21:32:22.952245+0000","last_clean":"2024-05-16T21:32:22.952245+0000","last_became_active":"2024-05-16T21:32:21.970260+0000","last_became_peered":"2024-05-16T21:32:21.970260+0000","last_unstale":"2024-05-16T21:32:22.952245+0000","last_undegraded":"2024-05-16T21:32:22.952245+0000","last_fullsized":"2024-05-16T21:32:22.952245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948708+0000","last_change":"2024-05-16T21:32:21.968173+0000","last_active":"2024-05-16T21:32:22.948708+0000","last_peered":"2024-05-16T21:32:22.948708+0000","last_clean":"2024-05-16T21:32:22.948708+0000","last_became_active":"2024-05-16T21:32:21.967815+0000","last_became_peered":"2024-05-16T21:32:21.967815+0000","last_unstale":"2024-05-16T21:32:22.948708+0000","last_undegraded":"2024-05-16T21:32:22.948708+0000","last_fullsized":"2024-05-16T21:32:22.948708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:19.038761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205694+0000","last_change":"2024-05-16T21:32:20.969468+0000","last_active":"2024-05-16T21:32:23.205694+0000","last_peered":"2024-05-16T21:32:23.205694+0000","last_clean":"2024-05-16T21:32:23.205694+0000","last_became_active":"2024-05-16T21:32:20.969070+0000","last_became_peered":"2024-05-16T21:32:20.969070+0000","last_unstale":"2024-05-16T21:32:23.205694+0000","last_undegraded":"2024-05-16T21:32:23.205694+0000","last_fullsized":"2024-05-16T21:32:23.205694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205572+0000","last_change":"2024-05-16T21:32:21.962562+0000","last_active":"2024-05-16T21:32:23.205572+0000","last_peered":"2024-05-16T21:32:23.205572+0000","last_clean":"2024-05-16T21:32:23.205572+0000","last_became_active":"2024-05-16T21:32:21.960939+0000","last_became_peered":"2024-05-16T21:32:21.960939+0000","last_unstale":"2024-05-16T21:32:23.205572+0000","last_undegraded":"2024-05-16T21:32:23.205572+0000","last_fullsized":"2024-05-16T21:32:23.205572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952228+0000","last_change":"2024-05-16T21:32:20.963331+0000","last_active":"2024-05-16T21:32:22.952228+0000","last_peered":"2024-05-16T21:32:22.952228+0000","last_clean":"2024-05-16T21:32:22.952228+0000","last_became_active":"2024-05-16T21:32:20.963022+0000","last_became_peered":"2024-05-16T21:32:20.963022+0000","last_unstale":"2024-05-16T21:32:22.952228+0000","last_undegraded":"2024-05-16T21:32:22.952228+0000","last_fullsized":"2024-05-16T21:32:22.952228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205155+0000","last_change":"2024-05-16T21:32:20.963234+0000","last_active":"2024-05-16T21:32:23.205155+0000","last_peered":"2024-05-16T21:32:23.205155+0000","last_clean":"2024-05-16T21:32:23.205155+0000","last_became_active":"2024-05-16T21:32:20.962909+0000","last_became_peered":"2024-05-16T21:32:20.962909+0000","last_unstale":"2024-05-16T21:32:23.205155+0000","last_undegraded":"2024-05-16T21:32:23.205155+0000","last_fullsized":"2024-05-16T21:32:23.205155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:53:28.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205007+0000","last_change":"2024-05-16T21:32:21.958029+0000","last_active":"2024-05-16T21:32:23.205007+0000","last_peered":"2024-05-16T21:32:23.205007+0000","last_clean":"2024-05-16T21:32:23.205007+0000","last_became_active":"2024-05-16T21:32:21.957650+0000","last_became_peered":"2024-05-16T21:32:21.957650+0000","last_unstale":"2024-05-16T21:32:23.205007+0000","last_undegraded":"2024-05-16T21:32:23.205007+0000","last_fullsized":"2024-05-16T21:32:23.205007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:53:52.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204693+0000","last_change":"2024-05-16T21:32:20.963432+0000","last_active":"2024-05-16T21:32:23.204693+0000","last_peered":"2024-05-16T21:32:23.204693+0000","last_clean":"2024-05-16T21:32:23.204693+0000","last_became_active":"2024-05-16T21:32:20.963062+0000","last_became_peered":"2024-05-16T21:32:20.963062+0000","last_unstale":"2024-05-16T21:32:23.204693+0000","last_undegraded":"2024-05-16T21:32:23.204693+0000","last_fullsized":"2024-05-16T21:32:23.204693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947016+0000","last_change":"2024-05-16T21:32:21.971148+0000","last_active":"2024-05-16T21:32:22.947016+0000","last_peered":"2024-05-16T21:32:22.947016+0000","last_clean":"2024-05-16T21:32:22.947016+0000","last_became_active":"2024-05-16T21:32:21.970842+0000","last_became_peered":"2024-05-16T21:32:21.970842+0000","last_unstale":"2024-05-16T21:32:22.947016+0000","last_undegraded":"2024-05-16T21:32:22.947016+0000","last_fullsized":"2024-05-16T21:32:22.947016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952504+0000","last_change":"2024-05-16T21:32:20.966317+0000","last_active":"2024-05-16T21:32:22.952504+0000","last_peered":"2024-05-16T21:32:22.952504+0000","last_clean":"2024-05-16T21:32:22.952504+0000","last_became_active":"2024-05-16T21:32:20.966009+0000","last_became_peered":"2024-05-16T21:32:20.966009+0000","last_unstale":"2024-05-16T21:32:22.952504+0000","last_undegraded":"2024-05-16T21:32:22.952504+0000","last_fullsized":"2024-05-16T21:32:22.952504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204973+0000","last_change":"2024-05-16T21:32:21.977643+0000","last_active":"2024-05-16T21:32:23.204973+0000","last_peered":"2024-05-16T21:32:23.204973+0000","last_clean":"2024-05-16T21:32:23.204973+0000","last_became_active":"2024-05-16T21:32:21.977335+0000","last_became_peered":"2024-05-16T21:32:21.977335+0000","last_unstale":"2024-05-16T21:32:23.204973+0000","last_undegraded":"2024-05-16T21:32:23.204973+0000","last_fullsized":"2024-05-16T21:32:23.204973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205222+0000","last_change":"2024-05-16T21:32:20.965401+0000","last_active":"2024-05-16T21:32:23.205222+0000","last_peered":"2024-05-16T21:32:23.205222+0000","last_clean":"2024-05-16T21:32:23.205222+0000","last_became_active":"2024-05-16T21:32:20.964989+0000","last_became_peered":"2024-05-16T21:32:20.964989+0000","last_unstale":"2024-05-16T21:32:23.205222+0000","last_undegraded":"2024-05-16T21:32:23.205222+0000","last_fullsized":"2024-05-16T21:32:23.205222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205076+0000","last_change":"2024-05-16T21:32:21.968344+0000","last_active":"2024-05-16T21:32:23.205076+0000","last_peered":"2024-05-16T21:32:23.205076+0000","last_clean":"2024-05-16T21:32:23.205076+0000","last_became_active":"2024-05-16T21:32:21.966870+0000","last_became_peered":"2024-05-16T21:32:21.966870+0000","last_unstale":"2024-05-16T21:32:23.205076+0000","last_undegraded":"2024-05-16T21:32:23.205076+0000","last_fullsized":"2024-05-16T21:32:23.205076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:12:16.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947126+0000","last_change":"2024-05-16T21:32:20.964832+0000","last_active":"2024-05-16T21:32:22.947126+0000","last_peered":"2024-05-16T21:32:22.947126+0000","last_clean":"2024-05-16T21:32:22.947126+0000","last_became_active":"2024-05-16T21:32:20.964458+0000","last_became_peered":"2024-05-16T21:32:20.964458+0000","last_unstale":"2024-05-16T21:32:22.947126+0000","last_undegraded":"2024-05-16T21:32:22.947126+0000","last_fullsized":"2024-05-16T21:32:22.947126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949526+0000","last_change":"2024-05-16T21:32:21.974914+0000","last_active":"2024-05-16T21:32:22.949526+0000","last_peered":"2024-05-16T21:32:22.949526+0000","last_clean":"2024-05-16T21:32:22.949526+0000","last_became_active":"2024-05-16T21:32:21.974607+0000","last_became_peered":"2024-05-16T21:32:21.974607+0000","last_unstale":"2024-05-16T21:32:22.949526+0000","last_undegraded":"2024-05-16T21:32:22.949526+0000","last_fullsized":"2024-05-16T21:32:22.949526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:48.226628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952564+0000","last_change":"2024-05-16T21:32:20.966220+0000","last_active":"2024-05-16T21:32:22.952564+0000","last_peered":"2024-05-16T21:32:22.952564+0000","last_clean":"2024-05-16T21:32:22.952564+0000","last_became_active":"2024-05-16T21:32:20.965498+0000","last_became_peered":"2024-05-16T21:32:20.965498+0000","last_unstale":"2024-05-16T21:32:22.952564+0000","last_undegraded":"2024-05-16T21:32:22.952564+0000","last_fullsized":"2024-05-16T21:32:22.952564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948771+0000","last_change":"2024-05-16T21:32:21.973995+0000","last_active":"2024-05-16T21:32:22.948771+0000","last_peered":"2024-05-16T21:32:22.948771+0000","last_clean":"2024-05-16T21:32:22.948771+0000","last_became_active":"2024-05-16T21:32:21.972703+0000","last_became_peered":"2024-05-16T21:32:21.972703+0000","last_unstale":"2024-05-16T21:32:22.948771+0000","last_undegraded":"2024-05-16T21:32:22.948771+0000","last_fullsized":"2024-05-16T21:32:22.948771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:15.421446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205568+0000","last_change":"2024-05-16T21:32:20.953536+0000","last_active":"2024-05-16T21:32:23.205568+0000","last_peered":"2024-05-16T21:32:23.205568+0000","last_clean":"2024-05-16T21:32:23.205568+0000","last_became_active":"2024-05-16T21:32:20.953195+0000","last_became_peered":"2024-05-16T21:32:20.953195+0000","last_unstale":"2024-05-16T21:32:23.205568+0000","last_undegraded":"2024-05-16T21:32:23.205568+0000","last_fullsized":"2024-05-16T21:32:23.205568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:37:41.623319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205056+0000","last_change":"2024-05-16T21:32:21.962049+0000","last_active":"2024-05-16T21:32:23.205056+0000","last_peered":"2024-05-16T21:32:23.205056+0000","last_clean":"2024-05-16T21:32:23.205056+0000","last_became_active":"2024-05-16T21:32:21.961632+0000","last_became_peered":"2024-05-16T21:32:21.961632+0000","last_unstale":"2024-05-16T21:32:23.205056+0000","last_undegraded":"2024-05-16T21:32:23.205056+0000","last_fullsized":"2024-05-16T21:32:23.205056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:16.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204985+0000","last_change":"2024-05-16T21:32:20.968243+0000","last_active":"2024-05-16T21:32:23.204985+0000","last_peered":"2024-05-16T21:32:23.204985+0000","last_clean":"2024-05-16T21:32:23.204985+0000","last_became_active":"2024-05-16T21:32:20.967901+0000","last_became_peered":"2024-05-16T21:32:20.967901+0000","last_unstale":"2024-05-16T21:32:23.204985+0000","last_undegraded":"2024-05-16T21:32:23.204985+0000","last_fullsized":"2024-05-16T21:32:23.204985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948912+0000","last_change":"2024-05-16T21:32:21.963926+0000","last_active":"2024-05-16T21:32:22.948912+0000","last_peered":"2024-05-16T21:32:22.948912+0000","last_clean":"2024-05-16T21:32:22.948912+0000","last_became_active":"2024-05-16T21:32:21.963333+0000","last_became_peered":"2024-05-16T21:32:21.963333+0000","last_unstale":"2024-05-16T21:32:22.948912+0000","last_undegraded":"2024-05-16T21:32:22.948912+0000","last_fullsized":"2024-05-16T21:32:22.948912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:26.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952200+0000","last_change":"2024-05-16T21:32:20.960218+0000","last_active":"2024-05-16T21:32:22.952200+0000","last_peered":"2024-05-16T21:32:22.952200+0000","last_clean":"2024-05-16T21:32:22.952200+0000","last_became_active":"2024-05-16T21:32:20.959870+0000","last_became_peered":"2024-05-16T21:32:20.959870+0000","last_unstale":"2024-05-16T21:32:22.952200+0000","last_undegraded":"2024-05-16T21:32:22.952200+0000","last_fullsized":"2024-05-16T21:32:22.952200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952216+0000","last_change":"2024-05-16T21:32:21.970587+0000","last_active":"2024-05-16T21:32:22.952216+0000","last_peered":"2024-05-16T21:32:22.952216+0000","last_clean":"2024-05-16T21:32:22.952216+0000","last_became_active":"2024-05-16T21:32:21.969859+0000","last_became_peered":"2024-05-16T21:32:21.969859+0000","last_unstale":"2024-05-16T21:32:22.952216+0000","last_undegraded":"2024-05-16T21:32:22.952216+0000","last_fullsized":"2024-05-16T21:32:22.952216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:19:22.267338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205276+0000","last_change":"2024-05-16T21:32:20.955486+0000","last_active":"2024-05-16T21:32:23.205276+0000","last_peered":"2024-05-16T21:32:23.205276+0000","last_clean":"2024-05-16T21:32:23.205276+0000","last_became_active":"2024-05-16T21:32:20.955104+0000","last_became_peered":"2024-05-16T21:32:20.955104+0000","last_unstale":"2024-05-16T21:32:23.205276+0000","last_undegraded":"2024-05-16T21:32:23.205276+0000","last_fullsized":"2024-05-16T21:32:23.205276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:53:28.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948444+0000","last_change":"2024-05-16T21:32:21.975286+0000","last_active":"2024-05-16T21:32:22.948444+0000","last_peered":"2024-05-16T21:32:22.948444+0000","last_clean":"2024-05-16T21:32:22.948444+0000","last_became_active":"2024-05-16T21:32:21.974919+0000","last_became_peered":"2024-05-16T21:32:21.974919+0000","last_unstale":"2024-05-16T21:32:22.948444+0000","last_undegraded":"2024-05-16T21:32:22.948444+0000","last_fullsized":"2024-05-16T21:32:22.948444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:20:42.225903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948892+0000","last_change":"2024-05-16T21:32:20.958267+0000","last_active":"2024-05-16T21:32:22.948892+0000","last_peered":"2024-05-16T21:32:22.948892+0000","last_clean":"2024-05-16T21:32:22.948892+0000","last_became_active":"2024-05-16T21:32:20.957945+0000","last_became_peered":"2024-05-16T21:32:20.957945+0000","last_unstale":"2024-05-16T21:32:22.948892+0000","last_undegraded":"2024-05-16T21:32:22.948892+0000","last_fullsized":"2024-05-16T21:32:22.948892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:12.938490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950015+0000","last_change":"2024-05-16T21:32:21.964539+0000","last_active":"2024-05-16T21:32:22.950015+0000","last_peered":"2024-05-16T21:32:22.950015+0000","last_clean":"2024-05-16T21:32:22.950015+0000","last_became_active":"2024-05-16T21:32:21.962499+0000","last_became_peered":"2024-05-16T21:32:21.962499+0000","last_unstale":"2024-05-16T21:32:22.950015+0000","last_undegraded":"2024-05-16T21:32:22.950015+0000","last_fullsized":"2024-05-16T21:32:22.950015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:08:57.226640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204577+0000","last_change":"2024-05-16T21:32:20.966720+0000","last_active":"2024-05-16T21:32:23.204577+0000","last_peered":"2024-05-16T21:32:23.204577+0000","last_clean":"2024-05-16T21:32:23.204577+0000","last_became_active":"2024-05-16T21:32:20.966403+0000","last_became_peered":"2024-05-16T21:32:20.966403+0000","last_unstale":"2024-05-16T21:32:23.204577+0000","last_undegraded":"2024-05-16T21:32:23.204577+0000","last_fullsized":"2024-05-16T21:32:23.204577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950173+0000","last_change":"2024-05-16T21:32:21.966883+0000","last_active":"2024-05-16T21:32:22.950173+0000","last_peered":"2024-05-16T21:32:22.950173+0000","last_clean":"2024-05-16T21:32:22.950173+0000","last_became_active":"2024-05-16T21:32:21.966493+0000","last_became_peered":"2024-05-16T21:32:21.966493+0000","last_unstale":"2024-05-16T21:32:22.950173+0000","last_undegraded":"2024-05-16T21:32:22.950173+0000","last_fullsized":"2024-05-16T21:32:22.950173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:51.561288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947243+0000","last_change":"2024-05-16T21:32:20.953581+0000","last_active":"2024-05-16T21:32:22.947243+0000","last_peered":"2024-05-16T21:32:22.947243+0000","last_clean":"2024-05-16T21:32:22.947243+0000","last_became_active":"2024-05-16T21:32:20.953237+0000","last_became_peered":"2024-05-16T21:32:20.953237+0000","last_unstale":"2024-05-16T21:32:22.947243+0000","last_undegraded":"2024-05-16T21:32:22.947243+0000","last_fullsized":"2024-05-16T21:32:22.947243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:00.200567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205106+0000","last_change":"2024-05-16T21:32:21.975314+0000","last_active":"2024-05-16T21:32:23.205106+0000","last_peered":"2024-05-16T21:32:23.205106+0000","last_clean":"2024-05-16T21:32:23.205106+0000","last_became_active":"2024-05-16T21:32:21.975001+0000","last_became_peered":"2024-05-16T21:32:21.975001+0000","last_unstale":"2024-05-16T21:32:23.205106+0000","last_undegraded":"2024-05-16T21:32:23.205106+0000","last_fullsized":"2024-05-16T21:32:23.205106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:40:56.776802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204320+0000","last_change":"2024-05-16T21:32:20.966198+0000","last_active":"2024-05-16T21:32:23.204320+0000","last_peered":"2024-05-16T21:32:23.204320+0000","last_clean":"2024-05-16T21:32:23.204320+0000","last_became_active":"2024-05-16T21:32:20.965864+0000","last_became_peered":"2024-05-16T21:32:20.965864+0000","last_unstale":"2024-05-16T21:32:23.204320+0000","last_undegraded":"2024-05-16T21:32:23.204320+0000","last_fullsized":"2024-05-16T21:32:23.204320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948960+0000","last_change":"2024-05-16T21:32:21.968642+0000","last_active":"2024-05-16T21:32:22.948960+0000","last_peered":"2024-05-16T21:32:22.948960+0000","last_clean":"2024-05-16T21:32:22.948960+0000","last_became_active":"2024-05-16T21:32:21.968084+0000","last_became_peered":"2024-05-16T21:32:21.968084+0000","last_unstale":"2024-05-16T21:32:22.948960+0000","last_undegraded":"2024-05-16T21:32:22.948960+0000","last_fullsized":"2024-05-16T21:32:22.948960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:41:08.428677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948023+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T21:32:22.948023+0000","last_peered":"2024-05-16T21:32:22.948023+0000","last_clean":"2024-05-16T21:32:22.948023+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T21:32:22.948023+0000","last_undegraded":"2024-05-16T21:32:22.948023+0000","last_fullsized":"2024-05-16T21:32:22.948023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204626+0000","last_change":"2024-05-16T21:32:20.964695+0000","last_active":"2024-05-16T21:32:23.204626+0000","last_peered":"2024-05-16T21:32:23.204626+0000","last_clean":"2024-05-16T21:32:23.204626+0000","last_became_active":"2024-05-16T21:32:20.963727+0000","last_became_peered":"2024-05-16T21:32:20.963727+0000","last_unstale":"2024-05-16T21:32:23.204626+0000","last_undegraded":"2024-05-16T21:32:23.204626+0000","last_fullsized":"2024-05-16T21:32:23.204626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:54.788147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205555+0000","last_change":"2024-05-16T21:32:21.967136+0000","last_active":"2024-05-16T21:32:23.205555+0000","last_peered":"2024-05-16T21:32:23.205555+0000","last_clean":"2024-05-16T21:32:23.205555+0000","last_became_active":"2024-05-16T21:32:21.966780+0000","last_became_peered":"2024-05-16T21:32:21.966780+0000","last_unstale":"2024-05-16T21:32:23.205555+0000","last_undegraded":"2024-05-16T21:32:23.205555+0000","last_fullsized":"2024-05-16T21:32:23.205555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:00.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949105+0000","last_change":"2024-05-16T21:32:20.958213+0000","last_active":"2024-05-16T21:32:22.949105+0000","last_peered":"2024-05-16T21:32:22.949105+0000","last_clean":"2024-05-16T21:32:22.949105+0000","last_became_active":"2024-05-16T21:32:20.957898+0000","last_became_peered":"2024-05-16T21:32:20.957898+0000","last_unstale":"2024-05-16T21:32:22.949105+0000","last_undegraded":"2024-05-16T21:32:22.949105+0000","last_fullsized":"2024-05-16T21:32:22.949105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:47.220802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204489+0000","last_change":"2024-05-16T21:32:21.968841+0000","last_active":"2024-05-16T21:32:23.204489+0000","last_peered":"2024-05-16T21:32:23.204489+0000","last_clean":"2024-05-16T21:32:23.204489+0000","last_became_active":"2024-05-16T21:32:21.968322+0000","last_became_peered":"2024-05-16T21:32:21.968322+0000","last_unstale":"2024-05-16T21:32:23.204489+0000","last_undegraded":"2024-05-16T21:32:23.204489+0000","last_fullsized":"2024-05-16T21:32:23.204489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:05.477666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204469+0000","last_change":"2024-05-16T21:32:20.967828+0000","last_active":"2024-05-16T21:32:23.204469+0000","last_peered":"2024-05-16T21:32:23.204469+0000","last_clean":"2024-05-16T21:32:23.204469+0000","last_became_active":"2024-05-16T21:32:20.967418+0000","last_became_peered":"2024-05-16T21:32:20.967418+0000","last_unstale":"2024-05-16T21:32:23.204469+0000","last_undegraded":"2024-05-16T21:32:23.204469+0000","last_fullsized":"2024-05-16T21:32:23.204469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947214+0000","last_change":"2024-05-16T21:32:21.961302+0000","last_active":"2024-05-16T21:32:22.947214+0000","last_peered":"2024-05-16T21:32:22.947214+0000","last_clean":"2024-05-16T21:32:22.947214+0000","last_became_active":"2024-05-16T21:32:21.960763+0000","last_became_peered":"2024-05-16T21:32:21.960763+0000","last_unstale":"2024-05-16T21:32:22.947214+0000","last_undegraded":"2024-05-16T21:32:22.947214+0000","last_fullsized":"2024-05-16T21:32:22.947214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205119+0000","last_change":"2024-05-16T21:32:20.964419+0000","last_active":"2024-05-16T21:32:23.205119+0000","last_peered":"2024-05-16T21:32:23.205119+0000","last_clean":"2024-05-16T21:32:23.205119+0000","last_became_active":"2024-05-16T21:32:20.964093+0000","last_became_peered":"2024-05-16T21:32:20.964093+0000","last_unstale":"2024-05-16T21:32:23.205119+0000","last_undegraded":"2024-05-16T21:32:23.205119+0000","last_fullsized":"2024-05-16T21:32:23.205119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.948592+0000","last_change":"2024-05-16T21:32:21.958086+0000","last_active":"2024-05-16T21:32:22.948592+0000","last_peered":"2024-05-16T21:32:22.948592+0000","last_clean":"2024-05-16T21:32:22.948592+0000","last_became_active":"2024-05-16T21:32:21.957701+0000","last_became_peered":"2024-05-16T21:32:21.957701+0000","last_unstale":"2024-05-16T21:32:22.948592+0000","last_undegraded":"2024-05-16T21:32:22.948592+0000","last_fullsized":"2024-05-16T21:32:22.948592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:01.206393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947265+0000","last_change":"2024-05-16T21:32:20.959456+0000","last_active":"2024-05-16T21:32:22.947265+0000","last_peered":"2024-05-16T21:32:22.947265+0000","last_clean":"2024-05-16T21:32:22.947265+0000","last_became_active":"2024-05-16T21:32:20.959154+0000","last_became_peered":"2024-05-16T21:32:20.959154+0000","last_unstale":"2024-05-16T21:32:22.947265+0000","last_undegraded":"2024-05-16T21:32:22.947265+0000","last_fullsized":"2024-05-16T21:32:22.947265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205258+0000","last_change":"2024-05-16T21:32:21.974993+0000","last_active":"2024-05-16T21:32:23.205258+0000","last_peered":"2024-05-16T21:32:23.205258+0000","last_clean":"2024-05-16T21:32:23.205258+0000","last_became_active":"2024-05-16T21:32:21.974284+0000","last_became_peered":"2024-05-16T21:32:21.974284+0000","last_unstale":"2024-05-16T21:32:23.205258+0000","last_undegraded":"2024-05-16T21:32:23.205258+0000","last_fullsized":"2024-05-16T21:32:23.205258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:26.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.950079+0000","last_change":"2024-05-16T21:32:20.960943+0000","last_active":"2024-05-16T21:32:22.950079+0000","last_peered":"2024-05-16T21:32:22.950079+0000","last_clean":"2024-05-16T21:32:22.950079+0000","last_became_active":"2024-05-16T21:32:20.960501+0000","last_became_peered":"2024-05-16T21:32:20.960501+0000","last_unstale":"2024-05-16T21:32:22.950079+0000","last_undegraded":"2024-05-16T21:32:22.950079+0000","last_fullsized":"2024-05-16T21:32:22.950079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:04.471840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947201+0000","last_change":"2024-05-16T21:32:21.966653+0000","last_active":"2024-05-16T21:32:22.947201+0000","last_peered":"2024-05-16T21:32:22.947201+0000","last_clean":"2024-05-16T21:32:22.947201+0000","last_became_active":"2024-05-16T21:32:21.966311+0000","last_became_peered":"2024-05-16T21:32:21.966311+0000","last_unstale":"2024-05-16T21:32:22.947201+0000","last_undegraded":"2024-05-16T21:32:22.947201+0000","last_fullsized":"2024-05-16T21:32:22.947201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:59:32.084900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.951673+0000","last_change":"2024-05-16T21:32:20.965931+0000","last_active":"2024-05-16T21:32:22.951673+0000","last_peered":"2024-05-16T21:32:22.951673+0000","last_clean":"2024-05-16T21:32:22.951673+0000","last_became_active":"2024-05-16T21:32:20.965603+0000","last_became_peered":"2024-05-16T21:32:20.965603+0000","last_unstale":"2024-05-16T21:32:22.951673+0000","last_undegraded":"2024-05-16T21:32:22.951673+0000","last_fullsized":"2024-05-16T21:32:22.951673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:09.283220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205566+0000","last_change":"2024-05-16T21:32:21.958052+0000","last_active":"2024-05-16T21:32:23.205566+0000","last_peered":"2024-05-16T21:32:23.205566+0000","last_clean":"2024-05-16T21:32:23.205566+0000","last_became_active":"2024-05-16T21:32:21.957690+0000","last_became_peered":"2024-05-16T21:32:21.957690+0000","last_unstale":"2024-05-16T21:32:23.205566+0000","last_undegraded":"2024-05-16T21:32:23.205566+0000","last_fullsized":"2024-05-16T21:32:23.205566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:22:33.919329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952599+0000","last_change":"2024-05-16T21:32:20.967895+0000","last_active":"2024-05-16T21:32:22.952599+0000","last_peered":"2024-05-16T21:32:22.952599+0000","last_clean":"2024-05-16T21:32:22.952599+0000","last_became_active":"2024-05-16T21:32:20.967450+0000","last_became_peered":"2024-05-16T21:32:20.967450+0000","last_unstale":"2024-05-16T21:32:22.952599+0000","last_undegraded":"2024-05-16T21:32:22.952599+0000","last_fullsized":"2024-05-16T21:32:22.952599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:55:18.032935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205220+0000","last_change":"2024-05-16T21:32:21.963459+0000","last_active":"2024-05-16T21:32:23.205220+0000","last_peered":"2024-05-16T21:32:23.205220+0000","last_clean":"2024-05-16T21:32:23.205220+0000","last_became_active":"2024-05-16T21:32:21.963137+0000","last_became_peered":"2024-05-16T21:32:21.963137+0000","last_unstale":"2024-05-16T21:32:23.205220+0000","last_undegraded":"2024-05-16T21:32:23.205220+0000","last_fullsized":"2024-05-16T21:32:23.205220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947954+0000","last_change":"2024-05-16T21:32:20.962252+0000","last_active":"2024-05-16T21:32:22.947954+0000","last_peered":"2024-05-16T21:32:22.947954+0000","last_clean":"2024-05-16T21:32:22.947954+0000","last_became_active":"2024-05-16T21:32:20.960720+0000","last_became_peered":"2024-05-16T21:32:20.960720+0000","last_unstale":"2024-05-16T21:32:22.947954+0000","last_undegraded":"2024-05-16T21:32:22.947954+0000","last_fullsized":"2024-05-16T21:32:22.947954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:00.162776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949215+0000","last_change":"2024-05-16T21:32:21.962732+0000","last_active":"2024-05-16T21:32:22.949215+0000","last_peered":"2024-05-16T21:32:22.949215+0000","last_clean":"2024-05-16T21:32:22.949215+0000","last_became_active":"2024-05-16T21:32:21.961668+0000","last_became_peered":"2024-05-16T21:32:21.961668+0000","last_unstale":"2024-05-16T21:32:22.949215+0000","last_undegraded":"2024-05-16T21:32:22.949215+0000","last_fullsized":"2024-05-16T21:32:22.949215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:32:10.289046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947142+0000","last_change":"2024-05-16T21:32:20.961726+0000","last_active":"2024-05-16T21:32:22.947142+0000","last_peered":"2024-05-16T21:32:22.947142+0000","last_clean":"2024-05-16T21:32:22.947142+0000","last_became_active":"2024-05-16T21:32:20.961210+0000","last_became_peered":"2024-05-16T21:32:20.961210+0000","last_unstale":"2024-05-16T21:32:22.947142+0000","last_undegraded":"2024-05-16T21:32:22.947142+0000","last_fullsized":"2024-05-16T21:32:22.947142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:00.162776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205183+0000","last_change":"2024-05-16T21:32:21.969756+0000","last_active":"2024-05-16T21:32:23.205183+0000","last_peered":"2024-05-16T21:32:23.205183+0000","last_clean":"2024-05-16T21:32:23.205183+0000","last_became_active":"2024-05-16T21:32:21.969427+0000","last_became_peered":"2024-05-16T21:32:21.969427+0000","last_unstale":"2024-05-16T21:32:23.205183+0000","last_undegraded":"2024-05-16T21:32:23.205183+0000","last_fullsized":"2024-05-16T21:32:23.205183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:45:45.005218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.947319+0000","last_change":"2024-05-16T21:32:20.963280+0000","last_active":"2024-05-16T21:32:22.947319+0000","last_peered":"2024-05-16T21:32:22.947319+0000","last_clean":"2024-05-16T21:32:22.947319+0000","last_became_active":"2024-05-16T21:32:20.962938+0000","last_became_peered":"2024-05-16T21:32:20.962938+0000","last_unstale":"2024-05-16T21:32:22.947319+0000","last_undegraded":"2024-05-16T21:32:22.947319+0000","last_fullsized":"2024-05-16T21:32:22.947319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:20:47.220802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205655+0000","last_change":"2024-05-16T21:32:21.956288+0000","last_active":"2024-05-16T21:32:23.205655+0000","last_peered":"2024-05-16T21:32:23.205655+0000","last_clean":"2024-05-16T21:32:23.205655+0000","last_became_active":"2024-05-16T21:32:21.955765+0000","last_became_peered":"2024-05-16T21:32:21.955765+0000","last_unstale":"2024-05-16T21:32:23.205655+0000","last_undegraded":"2024-05-16T21:32:23.205655+0000","last_fullsized":"2024-05-16T21:32:23.205655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:01:44.861353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949002+0000","last_change":"2024-05-16T21:32:20.959535+0000","last_active":"2024-05-16T21:32:22.949002+0000","last_peered":"2024-05-16T21:32:22.949002+0000","last_clean":"2024-05-16T21:32:22.949002+0000","last_became_active":"2024-05-16T21:32:20.959011+0000","last_became_peered":"2024-05-16T21:32:20.959011+0000","last_unstale":"2024-05-16T21:32:22.949002+0000","last_undegraded":"2024-05-16T21:32:22.949002+0000","last_fullsized":"2024-05-16T21:32:22.949002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:42:41.954599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.952283+0000","last_change":"2024-05-16T21:32:21.970736+0000","last_active":"2024-05-16T21:32:22.952283+0000","last_peered":"2024-05-16T21:32:22.952283+0000","last_clean":"2024-05-16T21:32:22.952283+0000","last_became_active":"2024-05-16T21:32:21.970296+0000","last_became_peered":"2024-05-16T21:32:21.970296+0000","last_unstale":"2024-05-16T21:32:22.952283+0000","last_undegraded":"2024-05-16T21:32:22.952283+0000","last_fullsized":"2024-05-16T21:32:22.952283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:15:39.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205253+0000","last_change":"2024-05-16T21:32:21.975252+0000","last_active":"2024-05-16T21:32:23.205253+0000","last_peered":"2024-05-16T21:32:23.205253+0000","last_clean":"2024-05-16T21:32:23.205253+0000","last_became_active":"2024-05-16T21:32:21.974676+0000","last_became_peered":"2024-05-16T21:32:21.974676+0000","last_unstale":"2024-05-16T21:32:23.205253+0000","last_undegraded":"2024-05-16T21:32:23.205253+0000","last_fullsized":"2024-05-16T21:32:23.205253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:41:08.428677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949848+0000","last_change":"2024-05-16T21:32:20.962780+0000","last_active":"2024-05-16T21:32:22.949848+0000","last_peered":"2024-05-16T21:32:22.949848+0000","last_clean":"2024-05-16T21:32:22.949848+0000","last_became_active":"2024-05-16T21:32:20.962322+0000","last_became_peered":"2024-05-16T21:32:20.962322+0000","last_unstale":"2024-05-16T21:32:22.949848+0000","last_undegraded":"2024-05-16T21:32:22.949848+0000","last_fullsized":"2024-05-16T21:32:22.949848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:53:43.525691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.204971+0000","last_change":"2024-05-16T21:32:21.980984+0000","last_active":"2024-05-16T21:32:23.204971+0000","last_peered":"2024-05-16T21:32:23.204971+0000","last_clean":"2024-05-16T21:32:23.204971+0000","last_became_active":"2024-05-16T21:32:21.980660+0000","last_became_peered":"2024-05-16T21:32:21.980660+0000","last_unstale":"2024-05-16T21:32:23.204971+0000","last_undegraded":"2024-05-16T21:32:23.204971+0000","last_fullsized":"2024-05-16T21:32:23.204971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:15.421446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:22.949920+0000","last_change":"2024-05-16T21:32:20.961620+0000","last_active":"2024-05-16T21:32:22.949920+0000","last_peered":"2024-05-16T21:32:22.949920+0000","last_clean":"2024-05-16T21:32:22.949920+0000","last_became_active":"2024-05-16T21:32:20.960591+0000","last_became_peered":"2024-05-16T21:32:20.960591+0000","last_unstale":"2024-05-16T21:32:22.949920+0000","last_undegraded":"2024-05-16T21:32:22.949920+0000","last_fullsized":"2024-05-16T21:32:22.949920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:05:47.168701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205068+0000","last_change":"2024-05-16T21:32:21.967631+0000","last_active":"2024-05-16T21:32:23.205068+0000","last_peered":"2024-05-16T21:32:23.205068+0000","last_clean":"2024-05-16T21:32:23.205068+0000","last_became_active":"2024-05-16T21:32:21.967230+0000","last_became_peered":"2024-05-16T21:32:21.967230+0000","last_unstale":"2024-05-16T21:32:23.205068+0000","last_undegraded":"2024-05-16T21:32:23.205068+0000","last_fullsized":"2024-05-16T21:32:23.205068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:19:22.267338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205795+0000","last_change":"2024-05-16T21:32:20.968463+0000","last_active":"2024-05-16T21:32:23.205795+0000","last_peered":"2024-05-16T21:32:23.205795+0000","last_clean":"2024-05-16T21:32:23.205795+0000","last_became_active":"2024-05-16T21:32:20.967280+0000","last_became_peered":"2024-05-16T21:32:20.967280+0000","last_unstale":"2024-05-16T21:32:23.205795+0000","last_undegraded":"2024-05-16T21:32:23.205795+0000","last_fullsized":"2024-05-16T21:32:23.205795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:14.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205674+0000","last_change":"2024-05-16T21:32:21.963511+0000","last_active":"2024-05-16T21:32:23.205674+0000","last_peered":"2024-05-16T21:32:23.205674+0000","last_clean":"2024-05-16T21:32:23.205674+0000","last_became_active":"2024-05-16T21:32:21.963215+0000","last_became_peered":"2024-05-16T21:32:21.963215+0000","last_unstale":"2024-05-16T21:32:23.205674+0000","last_undegraded":"2024-05-16T21:32:23.205674+0000","last_fullsized":"2024-05-16T21:32:23.205674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:20.937065+0000","last_clean_scrub_stamp":"2024-05-16T21:32:20.937065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:25.282491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T21:32:23.205197+0000","last_change":"2024-05-16T21:32:20.954854+0000","last_active":"2024-05-16T21:32:23.205197+0000","last_peered":"2024-05-16T21:32:23.205197+0000","last_clean":"2024-05-16T21:32:23.205197+0000","last_became_active":"2024-05-16T21:32:20.954461+0000","last_became_peered":"2024-05-16T21:32:20.954461+0000","last_unstale":"2024-05-16T21:32:23.205197+0000","last_undegraded":"2024-05-16T21:32:23.205197+0000","last_fullsized":"2024-05-16T21:32:23.205197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:19.931239+0000","last_clean_scrub_stamp":"2024-05-16T21:32:19.931239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:17:50.700469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T21:32:31.141 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T21:32:31.142 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-16T21:32:31.142 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-16T21:32:31.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-16T21:32:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.286+0000 7fa6dbb86640 1 Processor -- start 2024-05-16T21:32:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.286+0000 7fa6dbb86640 1 -- start start 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.287+0000 7fa6dbb86640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa6d40b95e0 0x7fa6d40bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.287+0000 7fa6dbb86640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d40ba4d0 con 0x7fa6d40bf6f0 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.287+0000 7fa6dbb86640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d40ba7b0 con 0x7fa6d4151b30 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.287+0000 7fa6dbb86640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d40baa90 con 0x7fa6d40b95e0 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.287+0000 7fa6d9922640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6d40bf6f0 0x7fa6d40b8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35030/0 (socket says 172.21.15.5:35030) 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.287+0000 7fa6d9922640 1 -- 172.21.15.5:0/1261763003 learned_addr learned my addr 172.21.15.5:0/1261763003 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007804634 0 0) 0x7fa6d40ba4d0 con 0x7fa6d40bf6f0 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c0003520 con 0x7fa6d40bf6f0 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d9121640 1 --2- 172.21.15.5:0/1261763003 >> v2:172.21.15.157:3300/0 conn(0x7fa6d40b95e0 0x7fa6d40bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3447282827 0 0) 0x7fa6c0003520 con 0x7fa6d40bf6f0 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 >> v2:172.21.15.157:3300/0 conn(0x7fa6d40b95e0 msgr2=0x7fa6d40bfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 --2- 172.21.15.5:0/1261763003 >> v2:172.21.15.157:3300/0 conn(0x7fa6d40b95e0 0x7fa6d40bfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 >> v1:172.21.15.157:6789/0 conn(0x7fa6d4151b30 legacy=0x7fa6d4151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d408d720 con 0x7fa6d40bf6f0 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fa6d00016f0 con 0x7fa6d40bf6f0 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 >> v1:172.21.15.5:6789/0 conn(0x7fa6d40bf6f0 legacy=0x7fa6d40b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0003a50 0x7fa6c0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0004800 0x7fa6c0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0005250 0x7fa6c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40baa90 con 0x7fa6c0003a50 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c000c1e0 con 0x7fa6c0005250 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c000c3e0 con 0x7fa6c0004800 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d9922640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0003a50 0x7fa6c0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d9121640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0004800 0x7fa6c0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6da123640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0005250 0x7fa6c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d9922640 1 -- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0004800 msgr2=0x7fa6c0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d9922640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0004800 0x7fa6c0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d9922640 1 -- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0005250 msgr2=0x7fa6c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.288+0000 7fa6d9922640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0005250 0x7fa6c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.289+0000 7fa6da123640 1 -- 172.21.15.5:0/1261763003 reap_dead start 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.289+0000 7fa6d9922640 1 -- 172.21.15.5:0/1261763003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c0003520 con 0x7fa6c0003a50 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.289+0000 7fa6d9121640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0004800 0x7fa6c0004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.289+0000 7fa6d9922640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0003a50 0x7fa6c0003ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0001050 tx=0x7fa6c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0013b9c61dec068 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.289+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0007d10 con 0x7fa6c0003a50 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.289+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d0005ad0 con 0x7fa6c0003a50 2024-05-16T21:32:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.289+0000 7fa6d8920640 1 -- 172.21.15.5:0/1261763003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0007070 con 0x7fa6c0003a50 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.290+0000 7fa6dbb86640 1 -- 172.21.15.5:0/1261763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0003a50 msgr2=0x7fa6c0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.290+0000 7fa6dbb86640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0003a50 0x7fa6c0003ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0001050 tx=0x7fa6c0005830 comp rx=0 tx=0).stop 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.290+0000 7fa6dbb86640 1 -- 172.21.15.5:0/1261763003 shutdown_connections 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.290+0000 7fa6dbb86640 1 --2- 172.21.15.5:0/1261763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0003a50 0x7fa6c0003ec0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.290+0000 7fa6dbb86640 1 -- 172.21.15.5:0/1261763003 >> 172.21.15.5:0/1261763003 conn(0x7fa6d40c0570 msgr2=0x7fa6d40c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.290+0000 7fa6dbb86640 1 -- 172.21.15.5:0/1261763003 shutdown_connections 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.290+0000 7fa6dbb86640 1 -- 172.21.15.5:0/1261763003 wait complete. 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.292+0000 7fa6dbb86640 1 Processor -- start 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.292+0000 7fa6dbb86640 1 -- start start 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6dbb86640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0003a50 0x7fa6d414ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6dbb86640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6d41d7700 0x7fa6d414b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6dbb86640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6d41d8410 0x7fa6d4144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6dbb86640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40bfe90 con 0x7fa6d41d7700 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6dbb86640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40bfd10 con 0x7fa6c0003a50 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6dbb86640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d40b8ed0 con 0x7fa6d41d8410 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6d41d7700 0x7fa6d414b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6d41d7700 0x7fa6d414b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57930/0 (socket says 172.21.15.5:57930) 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 -- 172.21.15.5:0/2418819116 learned_addr learned my addr 172.21.15.5:0/2418819116 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9922640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0003a50 0x7fa6d414ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6da123640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6d41d8410 0x7fa6d4144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 -- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6d41d8410 msgr2=0x7fa6d4144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6d41d8410 0x7fa6d4144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 -- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0003a50 msgr2=0x7fa6d414ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0003a50 0x7fa6d414ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 -- 172.21.15.5:0/2418819116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d414b590 con 0x7fa6d41d7700 2024-05-16T21:32:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6d9121640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6d41d7700 0x7fa6d414b050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4011510 tx=0x7fa6c40119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6ca7fc640 1 -- 172.21.15.5:0/2418819116 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4015870 con 0x7fa6d41d7700 2024-05-16T21:32:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6ca7fc640 1 -- 172.21.15.5:0/2418819116 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c4015a10 con 0x7fa6d41d7700 2024-05-16T21:32:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d414c340 con 0x7fa6d41d7700 2024-05-16T21:32:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.293+0000 7fa6ca7fc640 1 -- 172.21.15.5:0/2418819116 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4015e00 con 0x7fa6d41d7700 2024-05-16T21:32:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.294+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d414c900 con 0x7fa6d41d7700 2024-05-16T21:32:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.295+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d4050940 con 0x7fa6d41d7700 2024-05-16T21:32:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.295+0000 7fa6ca7fc640 1 -- 172.21.15.5:0/2418819116 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa6c401d400 con 0x7fa6d41d7700 2024-05-16T21:32:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.296+0000 7fa6ca7fc640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa6b80762d0 0x7fa6b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.296+0000 7fa6ca7fc640 1 -- 172.21.15.5:0/2418819116 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa6c4097ef0 con 0x7fa6d41d7700 2024-05-16T21:32:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.296+0000 7fa6d9922640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa6b80762d0 0x7fa6b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.297+0000 7fa6d9922640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa6b80762d0 0x7fa6b80787e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0032000 tx=0x7fa6d0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:31.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.300+0000 7fa6ca7fc640 1 -- 172.21.15.5:0/2418819116 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa6c4019030 con 0x7fa6d41d7700 2024-05-16T21:32:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.533+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa6d414fb90 con 0x7fa6d41d7700 2024-05-16T21:32:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.533+0000 7fa6ca7fc640 1 -- 172.21.15.5:0/2418819116 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa6c40617c0 con 0x7fa6d41d7700 2024-05-16T21:32:31.536 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:31.537 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-16T21:32:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa6b80762d0 msgr2=0x7fa6b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa6b80762d0 0x7fa6b80787e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0032000 tx=0x7fa6d0009030 comp rx=0 tx=0).stop 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6d41d7700 msgr2=0x7fa6d414b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6d41d7700 0x7fa6d414b050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4011510 tx=0x7fa6c40119d0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 shutdown_connections 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa6b80762d0 0x7fa6b80787e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6d41d8410 0x7fa6d4144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6d41d7700 0x7fa6d414b050 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.535+0000 7fa6dbb86640 1 --2- 172.21.15.5:0/2418819116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0003a50 0x7fa6d414ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.536+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 >> 172.21.15.5:0/2418819116 conn(0x7fa6d40c0570 msgr2=0x7fa6d40c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.536+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 shutdown_connections 2024-05-16T21:32:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.536+0000 7fa6dbb86640 1 -- 172.21.15.5:0/2418819116 wait complete. 2024-05-16T21:32:31.549 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-16T21:32:31.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.658+0000 7f4789cd9640 1 Processor -- start 2024-05-16T21:32:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.658+0000 7f4789cd9640 1 -- start start 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.659+0000 7f4789cd9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f478414e360 0x7f47841522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.659+0000 7f4789cd9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47840c1390 con 0x7f4784148770 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.659+0000 7f4789cd9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47840c0620 con 0x7f47840bf9b0 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.659+0000 7f4789cd9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4784151e40 con 0x7f478414e360 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.659+0000 7f4782ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4784148770 0x7f47840c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35042/0 (socket says 172.21.15.5:35042) 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.659+0000 7f4782ffd640 1 -- 172.21.15.5:0/2846073193 learned_addr learned my addr 172.21.15.5:0/2846073193 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.660+0000 7f47837fe640 1 --2- 172.21.15.5:0/2846073193 >> v2:172.21.15.157:3300/0 conn(0x7f478414e360 0x7f47841522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.660+0000 7f47827fc640 1 -- 172.21.15.5:0/2846073193 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411448551 0 0) 0x7f4778001110 con 0x7f4784148770 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.660+0000 7f47827fc640 1 -- 172.21.15.5:0/2846073193 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f476c003520 con 0x7f4784148770 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.660+0000 7f47827fc640 1 -- 172.21.15.5:0/2846073193 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076664419 0 0) 0x7f47840c0620 con 0x7f47840bf9b0 2024-05-16T21:32:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.660+0000 7f47827fc640 1 -- 172.21.15.5:0/2846073193 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4778001110 con 0x7f47840bf9b0 2024-05-16T21:32:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.660+0000 7f47837fe640 1 -- 172.21.15.5:0/2846073193 >> v1:172.21.15.157:6789/0 conn(0x7f47840bf9b0 legacy=0x7f47840bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.660+0000 7f47837fe640 1 -- 172.21.15.5:0/2846073193 >> v1:172.21.15.5:6789/0 conn(0x7f4784148770 legacy=0x7f47840c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.660+0000 7f47837fe640 1 -- 172.21.15.5:0/2846073193 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4784151ad0 con 0x7f478414e360 2024-05-16T21:32:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.661+0000 7f47837fe640 1 --2- 172.21.15.5:0/2846073193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 0x7f47841522d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47740097d0 tx=0x7f477402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9946532f4b114e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.661+0000 7f47827fc640 1 -- 172.21.15.5:0/2846073193 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774037070 con 0x7f478414e360 2024-05-16T21:32:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.661+0000 7f47827fc640 1 -- 172.21.15.5:0/2846073193 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774032640 con 0x7f478414e360 2024-05-16T21:32:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.661+0000 7f47827fc640 1 -- 172.21.15.5:0/2846073193 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47740329f0 con 0x7f478414e360 2024-05-16T21:32:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.662+0000 7f4789cd9640 1 -- 172.21.15.5:0/2846073193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 msgr2=0x7f47841522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.662+0000 7f4789cd9640 1 --2- 172.21.15.5:0/2846073193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 0x7f47841522d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47740097d0 tx=0x7f477402a300 comp rx=0 tx=0).stop 2024-05-16T21:32:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.662+0000 7f4789cd9640 1 -- 172.21.15.5:0/2846073193 shutdown_connections 2024-05-16T21:32:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.662+0000 7f4789cd9640 1 --2- 172.21.15.5:0/2846073193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 0x7f47841522d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.662+0000 7f4789cd9640 1 -- 172.21.15.5:0/2846073193 >> 172.21.15.5:0/2846073193 conn(0x7f47840c17c0 msgr2=0x7f47840c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.662+0000 7f4789cd9640 1 -- 172.21.15.5:0/2846073193 shutdown_connections 2024-05-16T21:32:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.662+0000 7f4789cd9640 1 -- 172.21.15.5:0/2846073193 wait complete. 2024-05-16T21:32:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.663+0000 7f4789cd9640 1 Processor -- start 2024-05-16T21:32:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.663+0000 7f4789cd9640 1 -- start start 2024-05-16T21:32:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.664+0000 7f4789cd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47840bf9b0 0x7f478414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.664+0000 7f4789cd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4784148770 0x7f478413f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.664+0000 7f4789cd9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 0x7f478413fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.664+0000 7f4789cd9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4784159e50 con 0x7f4784148770 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.664+0000 7f4789cd9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4784159cd0 con 0x7f478414e360 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.664+0000 7f4789cd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4784159fd0 con 0x7f47840bf9b0 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4784148770 0x7f478413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4784148770 0x7f478413f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57938/0 (socket says 172.21.15.5:57938) 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 -- 172.21.15.5:0/1022634603 learned_addr learned my addr 172.21.15.5:0/1022634603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4783fff640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 0x7f478413fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f47837fe640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47840bf9b0 0x7f478414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 -- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47840bf9b0 msgr2=0x7f478414f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47840bf9b0 0x7f478414f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 -- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 msgr2=0x7f478413fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 0x7f478413fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 -- 172.21.15.5:0/1022634603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4784151550 con 0x7f4784148770 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4783fff640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 0x7f478413fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4782ffd640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4784148770 0x7f478413f940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f477800c760 tx=0x7f477800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f476bfff640 1 -- 172.21.15.5:0/1022634603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778017070 con 0x7f4784148770 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f476bfff640 1 -- 172.21.15.5:0/1022634603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4778005ce0 con 0x7f4784148770 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f476bfff640 1 -- 172.21.15.5:0/1022634603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47780072b0 con 0x7f4784148770 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47841403c0 con 0x7f4784148770 2024-05-16T21:32:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.665+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4784071c30 con 0x7f4784148770 2024-05-16T21:32:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.666+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47840bd3b0 con 0x7f4784148770 2024-05-16T21:32:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.667+0000 7f476bfff640 1 -- 172.21.15.5:0/1022634603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f477801a070 con 0x7f4784148770 2024-05-16T21:32:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.667+0000 7f476bfff640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4770076300 0x7f4770078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.668+0000 7f476bfff640 1 -- 172.21.15.5:0/1022634603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4778096a60 con 0x7f4784148770 2024-05-16T21:32:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.668+0000 7f47837fe640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4770076300 0x7f4770078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.668+0000 7f47837fe640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4770076300 0x7f4770078810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4774034000 tx=0x7f477402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.672+0000 7f476bfff640 1 -- 172.21.15.5:0/1022634603 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f47840bd3b0 con 0x7f4784148770 2024-05-16T21:32:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.905+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4784050940 con 0x7f4784148770 2024-05-16T21:32:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.906+0000 7f476bfff640 1 -- 172.21.15.5:0/1022634603 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4342 (secure 0 0 0) 0x7f4784151550 con 0x7f4784148770 2024-05-16T21:32:31.909 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:31.909 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:21.341129+0000","modified":"2024-05-16T21:32:24.356428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-16T21:32:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-05-16T21:32:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4770076300 msgr2=0x7f4770078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4770076300 0x7f4770078810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4774034000 tx=0x7f477402e000 comp rx=0 tx=0).stop 2024-05-16T21:32:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4784148770 msgr2=0x7f478413f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4784148770 0x7f478413f940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f477800c760 tx=0x7f477800cc20 comp rx=0 tx=0).stop 2024-05-16T21:32:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 shutdown_connections 2024-05-16T21:32:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4770076300 0x7f4770078810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f478414e360 0x7f478413fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4784148770 0x7f478413f940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 --2- 172.21.15.5:0/1022634603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47840bf9b0 0x7f478414f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 >> 172.21.15.5:0/1022634603 conn(0x7f47840c17c0 msgr2=0x7f47841409f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 shutdown_connections 2024-05-16T21:32:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:31.908+0000 7f4789cd9640 1 -- 172.21.15.5:0/1022634603 wait complete. 2024-05-16T21:32:31.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:32.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.031+0000 7f20ece05640 1 Processor -- start 2024-05-16T21:32:32.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.031+0000 7f20ece05640 1 -- start start 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20ece05640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e80ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20ece05640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20e80b8a20 0x7f20e80b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20ece05640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e814e9b0 con 0x7f20e814e440 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20ece05640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f20e814ec90 con 0x7f20e80b8a20 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20ece05640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f20e814ef70 con 0x7f20e80b99c0 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20e80b8a20 0x7f20e80b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20e80b8a20 0x7f20e80b8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57950/0 (socket says 172.21.15.5:57950) 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e6d9d640 1 -- 172.21.15.5:0/973741797 learned_addr learned my addr 172.21.15.5:0/973741797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e5d9b640 1 --2- 172.21.15.5:0/973741797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e80ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e6d9d640 1 -- 172.21.15.5:0/973741797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 msgr2=0x7f20e80ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:32.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e6d9d640 1 --2- 172.21.15.5:0/973741797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e80ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e6d9d640 1 -- 172.21.15.5:0/973741797 >> v1:172.21.15.157:6789/0 conn(0x7f20e814e440 legacy=0x7f20e80bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:32.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e6d9d640 1 -- 172.21.15.5:0/973741797 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e814f250 con 0x7f20e80b8a20 2024-05-16T21:32:32.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.033+0000 7f20e5d9b640 1 --2- 172.21.15.5:0/973741797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e80ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.034+0000 7f20e6d9d640 1 --2- 172.21.15.5:0/973741797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e80b8a20 0x7f20e80b8e30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20e808e000 tx=0x7f20d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b3d149fe14096a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.034+0000 7f20e559a640 1 -- 172.21.15.5:0/973741797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8036070 con 0x7f20e80b8a20 2024-05-16T21:32:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.034+0000 7f20e559a640 1 -- 172.21.15.5:0/973741797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d8031600 con 0x7f20e80b8a20 2024-05-16T21:32:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.034+0000 7f20e559a640 1 -- 172.21.15.5:0/973741797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d80319d0 con 0x7f20e80b8a20 2024-05-16T21:32:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.035+0000 7f20ece05640 1 -- 172.21.15.5:0/973741797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e80b8a20 msgr2=0x7f20e80b8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.035+0000 7f20ece05640 1 --2- 172.21.15.5:0/973741797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e80b8a20 0x7f20e80b8e30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20e808e000 tx=0x7f20d802a660 comp rx=0 tx=0).stop 2024-05-16T21:32:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.035+0000 7f20ece05640 1 -- 172.21.15.5:0/973741797 shutdown_connections 2024-05-16T21:32:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.035+0000 7f20ece05640 1 --2- 172.21.15.5:0/973741797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e80b8a20 0x7f20e80b8e30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.035+0000 7f20ece05640 1 --2- 172.21.15.5:0/973741797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e80ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.035+0000 7f20ece05640 1 -- 172.21.15.5:0/973741797 >> 172.21.15.5:0/973741797 conn(0x7f20e80c0390 msgr2=0x7f20e80c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.035+0000 7f20ece05640 1 -- 172.21.15.5:0/973741797 shutdown_connections 2024-05-16T21:32:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.035+0000 7f20ece05640 1 -- 172.21.15.5:0/973741797 wait complete. 2024-05-16T21:32:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.036+0000 7f20ece05640 1 Processor -- start 2024-05-16T21:32:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.036+0000 7f20ece05640 1 -- start start 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.037+0000 7f20ece05640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e80b8a20 0x7f20e8149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.037+0000 7f20ece05640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.037+0000 7f20ece05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e814e440 0x7f20e8143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20ece05640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20e80ba780 con 0x7f20e814e440 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20ece05640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f20e808d720 con 0x7f20e80b8a20 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20ece05640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f20e80ba900 con 0x7f20e80b99c0 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e814e440 0x7f20e8143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e814e440 0x7f20e8143900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57962/0 (socket says 172.21.15.5:57962) 2024-05-16T21:32:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 -- 172.21.15.5:0/3127826562 learned_addr learned my addr 172.21.15.5:0/3127826562 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e659c640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e80b8a20 0x7f20e8149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e5d9b640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 -- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 msgr2=0x7f20e814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 -- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e80b8a20 msgr2=0x7f20e8149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e80b8a20 0x7f20e8149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 -- 172.21.15.5:0/3127826562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e8149ab0 con 0x7f20e814e440 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e5d9b640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20e6d9d640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e814e440 0x7f20e8143900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20d802ac50 tx=0x7f20d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20deffd640 1 -- 172.21.15.5:0/3127826562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8036050 con 0x7f20e814e440 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20deffd640 1 -- 172.21.15.5:0/3127826562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d8042070 con 0x7f20e814e440 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e814c4f0 con 0x7f20e814e440 2024-05-16T21:32:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20deffd640 1 -- 172.21.15.5:0/3127826562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8007b90 con 0x7f20e814e440 2024-05-16T21:32:32.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.038+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e81e4450 con 0x7f20e814e440 2024-05-16T21:32:32.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.039+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e808d8a0 con 0x7f20e814e440 2024-05-16T21:32:32.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.040+0000 7f20deffd640 1 -- 172.21.15.5:0/3127826562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f20d8009450 con 0x7f20e814e440 2024-05-16T21:32:32.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.041+0000 7f20deffd640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20c8076300 0x7f20c8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.041+0000 7f20deffd640 1 -- 172.21.15.5:0/3127826562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f20d80b8600 con 0x7f20e814e440 2024-05-16T21:32:32.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.041+0000 7f20e659c640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20c8076300 0x7f20c8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.041+0000 7f20e659c640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20c8076300 0x7f20c8078810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f20e0006fd0 tx=0x7f20e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.045+0000 7f20deffd640 1 -- 172.21.15.5:0/3127826562 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f20d8081ed0 con 0x7f20e814e440 2024-05-16T21:32:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.273+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20e8050940 con 0x7f20e814e440 2024-05-16T21:32:32.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.274+0000 7f20deffd640 1 -- 172.21.15.5:0/3127826562 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4342 (secure 0 0 0) 0x7f20d80817d0 con 0x7f20e814e440 2024-05-16T21:32:32.277 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:32.277 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:21.341129+0000","modified":"2024-05-16T21:32:24.356428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-16T21:32:32.277 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-05-16T21:32:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20c8076300 msgr2=0x7f20c8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20c8076300 0x7f20c8078810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f20e0006fd0 tx=0x7f20e0008040 comp rx=0 tx=0).stop 2024-05-16T21:32:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e814e440 msgr2=0x7f20e8143900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e814e440 0x7f20e8143900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20d802ac50 tx=0x7f20d8004a40 comp rx=0 tx=0).stop 2024-05-16T21:32:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 shutdown_connections 2024-05-16T21:32:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f20c8076300 0x7f20c8078810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20e814e440 0x7f20e8143900 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e80b99c0 0x7f20e814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 --2- 172.21.15.5:0/3127826562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e80b8a20 0x7f20e8149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 >> 172.21.15.5:0/3127826562 conn(0x7f20e80c0390 msgr2=0x7f20e8068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:32.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 shutdown_connections 2024-05-16T21:32:32.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.276+0000 7f20ece05640 1 -- 172.21.15.5:0/3127826562 wait complete. 2024-05-16T21:32:32.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.399+0000 7f734e66a640 1 Processor -- start 2024-05-16T21:32:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.399+0000 7f734e66a640 1 -- start start 2024-05-16T21:32:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f734e66a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73480bd6d0 0x7f73480be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f734e66a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734806e140 con 0x7f73480bee80 2024-05-16T21:32:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f734e66a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73480c36f0 con 0x7f7348151fc0 2024-05-16T21:32:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f734e66a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7348152530 con 0x7f73480bd6d0 2024-05-16T21:32:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f73477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73480bd6d0 0x7f73480be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f73477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73480bd6d0 0x7f73480be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57972/0 (socket says 172.21.15.5:57972) 2024-05-16T21:32:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f73477fe640 1 -- 172.21.15.5:0/2102632911 learned_addr learned my addr 172.21.15.5:0/2102632911 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:32.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f73477fe640 1 -- 172.21.15.5:0/2102632911 >> v1:172.21.15.157:6789/0 conn(0x7f7348151fc0 legacy=0x7f734806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f73477fe640 1 -- 172.21.15.5:0/2102632911 >> v1:172.21.15.5:6789/0 conn(0x7f73480bee80 legacy=0x7f7348158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.400+0000 7f73477fe640 1 -- 172.21.15.5:0/2102632911 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7348152810 con 0x7f73480bd6d0 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.401+0000 7f73477fe640 1 --2- 172.21.15.5:0/2102632911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480be940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f733c009870 tx=0x7f733c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c7ede7908b020b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.401+0000 7f7346ffd640 1 -- 172.21.15.5:0/2102632911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c037070 con 0x7f73480bd6d0 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.401+0000 7f7346ffd640 1 -- 172.21.15.5:0/2102632911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c032440 con 0x7f73480bd6d0 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.401+0000 7f7346ffd640 1 -- 172.21.15.5:0/2102632911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c032810 con 0x7f73480bd6d0 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.402+0000 7f734e66a640 1 -- 172.21.15.5:0/2102632911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 msgr2=0x7f73480be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.402+0000 7f734e66a640 1 --2- 172.21.15.5:0/2102632911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480be940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f733c009870 tx=0x7f733c02a270 comp rx=0 tx=0).stop 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.402+0000 7f734e66a640 1 -- 172.21.15.5:0/2102632911 shutdown_connections 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.402+0000 7f734e66a640 1 --2- 172.21.15.5:0/2102632911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480be940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.402+0000 7f734e66a640 1 -- 172.21.15.5:0/2102632911 >> 172.21.15.5:0/2102632911 conn(0x7f73480c3d20 msgr2=0x7f73480c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:32.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.402+0000 7f734e66a640 1 -- 172.21.15.5:0/2102632911 shutdown_connections 2024-05-16T21:32:32.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.402+0000 7f734e66a640 1 -- 172.21.15.5:0/2102632911 wait complete. 2024-05-16T21:32:32.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.403+0000 7f734e66a640 1 Processor -- start 2024-05-16T21:32:32.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.404+0000 7f734e66a640 1 -- start start 2024-05-16T21:32:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734e66a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734e66a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73480bee80 0x7f73480b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734e66a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7348151fc0 0x7f73480b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734e66a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73480bdae0 con 0x7f73480bd6d0 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734e66a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f73480c0070 con 0x7f73480bee80 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734e66a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f73480a2ed0 con 0x7f7348151fc0 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57988/0 (socket says 172.21.15.5:57988) 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 -- 172.21.15.5:0/1851940684 learned_addr learned my addr 172.21.15.5:0/1851940684 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f73477fe640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73480bee80 0x7f73480b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734cc07640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7348151fc0 0x7f73480b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 -- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7348151fc0 msgr2=0x7f73480b87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7348151fc0 0x7f73480b87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 -- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73480bee80 msgr2=0x7f73480b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73480bee80 0x7f73480b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 -- 172.21.15.5:0/1851940684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73480ba690 con 0x7f73480bd6d0 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f73477fe640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73480bee80 0x7f73480b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7347fff640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480b7610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f733800c400 tx=0x7f733800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7344ff9640 1 -- 172.21.15.5:0/1851940684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338017070 con 0x7f73480bd6d0 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7344ff9640 1 -- 172.21.15.5:0/1851940684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73380052d0 con 0x7f73480bd6d0 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73481e4ce0 con 0x7f73480bd6d0 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f7344ff9640 1 -- 172.21.15.5:0/1851940684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338003830 con 0x7f73480bd6d0 2024-05-16T21:32:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.405+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734814e110 con 0x7f73480bd6d0 2024-05-16T21:32:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.406+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7348050940 con 0x7f73480bd6d0 2024-05-16T21:32:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.407+0000 7f7344ff9640 1 -- 172.21.15.5:0/1851940684 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f733801a070 con 0x7f73480bd6d0 2024-05-16T21:32:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.408+0000 7f7344ff9640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f73340762d0 0x7f73340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.408+0000 7f7344ff9640 1 -- 172.21.15.5:0/1851940684 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7338096b80 con 0x7f73480bd6d0 2024-05-16T21:32:32.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.408+0000 7f73477fe640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f73340762d0 0x7f73340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.408+0000 7f73477fe640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f73340762d0 0x7f73340787e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f733c034000 tx=0x7f733c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.413+0000 7f7344ff9640 1 -- 172.21.15.5:0/1851940684 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7338060330 con 0x7f73480bd6d0 2024-05-16T21:32:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.604+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f734806eb40 con 0x7f73480bd6d0 2024-05-16T21:32:32.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.606+0000 7f7344ff9640 1 -- 172.21.15.5:0/1851940684 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f73380683b0 con 0x7f73480bd6d0 2024-05-16T21:32:32.609 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:32.609 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:22.944103+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f73340762d0 msgr2=0x7f73340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f73340762d0 0x7f73340787e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f733c034000 tx=0x7f733c02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 msgr2=0x7f73480b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480b7610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f733800c400 tx=0x7f733800c8c0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 shutdown_connections 2024-05-16T21:32:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f73340762d0 0x7f73340787e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7348151fc0 0x7f73480b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73480bee80 0x7f73480b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 --2- 172.21.15.5:0/1851940684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480bd6d0 0x7f73480b7610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 >> 172.21.15.5:0/1851940684 conn(0x7f73480c3d20 msgr2=0x7f73480c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 shutdown_connections 2024-05-16T21:32:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.608+0000 7f734e66a640 1 -- 172.21.15.5:0/1851940684 wait complete. 2024-05-16T21:32:32.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.731+0000 7f66443b7640 1 Processor -- start 2024-05-16T21:32:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.731+0000 7f66443b7640 1 -- start start 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f66443b7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 0x7f663c09fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f66443b7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663c151910 con 0x7f663c0bd7b0 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f66443b7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663c151bf0 con 0x7f663c0be6d0 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f66443b7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f663c152240 con 0x7f663c0be2c0 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f6642954640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f663c0bd7b0 0x7f663c158c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35064/0 (socket says 172.21.15.5:35064) 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f6642954640 1 -- 172.21.15.5:0/1140725924 learned_addr learned my addr 172.21.15.5:0/1140725924 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099648459 0 0) 0x7f663c151910 con 0x7f663c0bd7b0 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f6642153640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 0x7f663c09fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.732+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6628003520 con 0x7f663c0bd7b0 2024-05-16T21:32:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2286274755 0 0) 0x7f6628003520 con 0x7f663c0bd7b0 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 msgr2=0x7f663c09fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 0x7f663c09fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 >> v1:172.21.15.157:6789/0 conn(0x7f663c0be6d0 legacy=0x7f663c0bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c151ed0 con 0x7f663c0bd7b0 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f6634001a70 con 0x7f663c0bd7b0 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 >> v1:172.21.15.5:6789/0 conn(0x7f663c0bd7b0 legacy=0x7f663c158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66280039e0 0x7f6628003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6628004800 0x7f6628004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 0x7f6628005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f663c152240 con 0x7f66280039e0 2024-05-16T21:32:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f662800baf0 con 0x7f6628004800 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f662800bcf0 con 0x7f663c0be2c0 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6642153640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66280039e0 0x7f6628003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6641952640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6628004800 0x7f6628004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6642954640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 0x7f6628005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6642153640 1 -- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 msgr2=0x7f6628005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6642153640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 0x7f6628005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6642153640 1 -- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6628004800 msgr2=0x7f6628004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6642153640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6628004800 0x7f6628004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6642153640 1 -- 172.21.15.5:0/1140725924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6628003520 con 0x7f66280039e0 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.733+0000 7f6642954640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f663c0be2c0 0x7f6628005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.734+0000 7f6642153640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66280039e0 0x7f6628003e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6638009ac0 tx=0x7f6628005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc97b5c1661202b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.734+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638036070 con 0x7f66280039e0 2024-05-16T21:32:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.734+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6638031400 con 0x7f66280039e0 2024-05-16T21:32:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.734+0000 7f6641151640 1 -- 172.21.15.5:0/1140725924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638009690 con 0x7f66280039e0 2024-05-16T21:32:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.735+0000 7f66443b7640 1 -- 172.21.15.5:0/1140725924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66280039e0 msgr2=0x7f6628003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.735+0000 7f66443b7640 1 --2- 172.21.15.5:0/1140725924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66280039e0 0x7f6628003e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6638009ac0 tx=0x7f6628005830 comp rx=0 tx=0).stop 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.735+0000 7f6642954640 1 -- 172.21.15.5:0/1140725924 reap_dead start 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.735+0000 7f66443b7640 1 -- 172.21.15.5:0/1140725924 shutdown_connections 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.735+0000 7f66443b7640 1 -- 172.21.15.5:0/1140725924 >> 172.21.15.5:0/1140725924 conn(0x7f663c0c17c0 msgr2=0x7f663c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.735+0000 7f66443b7640 1 -- 172.21.15.5:0/1140725924 shutdown_connections 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.735+0000 7f66443b7640 1 -- 172.21.15.5:0/1140725924 wait complete. 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.736+0000 7f66443b7640 1 Processor -- start 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.736+0000 7f66443b7640 1 -- start start 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.737+0000 7f66443b7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66280039e0 0x7f663c1e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.737+0000 7f66443b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663c145bf0 0x7f663c143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.737+0000 7f66443b7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f663c144200 0x7f663c1e7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.737+0000 7f66443b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f663c0c0c80 con 0x7f663c145bf0 2024-05-16T21:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.737+0000 7f66443b7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1526d0 con 0x7f663c144200 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.737+0000 7f66443b7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f663c1e53e0 con 0x7f66280039e0 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.737+0000 7f6641952640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663c145bf0 0x7f663c143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6641952640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663c145bf0 0x7f663c143cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58006/0 (socket says 172.21.15.5:58006) 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6641952640 1 -- 172.21.15.5:0/1817311760 learned_addr learned my addr 172.21.15.5:0/1817311760 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6642153640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66280039e0 0x7f663c1e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6642954640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f663c144200 0x7f663c1e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6641952640 1 -- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66280039e0 msgr2=0x7f663c1e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6641952640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66280039e0 0x7f663c1e4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6641952640 1 -- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f663c144200 msgr2=0x7f663c1e7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6641952640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f663c144200 0x7f663c1e7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6641952640 1 -- 172.21.15.5:0/1817311760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c146870 con 0x7f663c145bf0 2024-05-16T21:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6641952640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663c145bf0 0x7f663c143cc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f662c00f850 tx=0x7f662c00fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6632ffd640 1 -- 172.21.15.5:0/1817311760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c0052e0 con 0x7f663c145bf0 2024-05-16T21:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6632ffd640 1 -- 172.21.15.5:0/1817311760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662c018070 con 0x7f663c145bf0 2024-05-16T21:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663c0b8090 con 0x7f663c145bf0 2024-05-16T21:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f6632ffd640 1 -- 172.21.15.5:0/1817311760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c00d970 con 0x7f663c145bf0 2024-05-16T21:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.738+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663c1e46a0 con 0x7f663c145bf0 2024-05-16T21:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.739+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f663c14f220 con 0x7f663c145bf0 2024-05-16T21:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.740+0000 7f6632ffd640 1 -- 172.21.15.5:0/1817311760 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f662c00db10 con 0x7f663c145bf0 2024-05-16T21:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.740+0000 7f6632ffd640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f66200762d0 0x7f66200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.741+0000 7f6632ffd640 1 -- 172.21.15.5:0/1817311760 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f662c097580 con 0x7f663c145bf0 2024-05-16T21:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.741+0000 7f6642153640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f66200762d0 0x7f66200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.741+0000 7f6642153640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f66200762d0 0x7f66200787e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6638033000 tx=0x7f6638008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:32.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.745+0000 7f6632ffd640 1 -- 172.21.15.5:0/1817311760 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f662c060ee0 con 0x7f663c145bf0 2024-05-16T21:32:32.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.976+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f663c14bca0 con 0x7f663c145bf0 2024-05-16T21:32:32.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.977+0000 7f6632ffd640 1 -- 172.21.15.5:0/1817311760 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4342 (secure 0 0 0) 0x7f662c0607e0 con 0x7f663c145bf0 2024-05-16T21:32:32.980 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:32.980 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:21.341129+0000","modified":"2024-05-16T21:32:24.356428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-16T21:32:32.980 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f66200762d0 msgr2=0x7f66200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f66200762d0 0x7f66200787e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6638033000 tx=0x7f6638008030 comp rx=0 tx=0).stop 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663c145bf0 msgr2=0x7f663c143cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663c145bf0 0x7f663c143cc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f662c00f850 tx=0x7f662c00fd10 comp rx=0 tx=0).stop 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 shutdown_connections 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f66200762d0 0x7f66200787e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f663c144200 0x7f663c1e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663c145bf0 0x7f663c143cc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 --2- 172.21.15.5:0/1817311760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66280039e0 0x7f663c1e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 >> 172.21.15.5:0/1817311760 conn(0x7f663c0c17c0 msgr2=0x7f663c14f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 shutdown_connections 2024-05-16T21:32:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:32.979+0000 7f66443b7640 1 -- 172.21.15.5:0/1817311760 wait complete. 2024-05-16T21:32:33.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T21:32:21.341129+0000', 'modified': '2024-05-16T21:32:24.356428+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6835/134624287', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 134624287}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 134624287}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-05-16T21:32:33.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-16T21:32:33.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-16T21:32:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.410+0000 7fdb73dea640 1 Processor -- start 2024-05-16T21:32:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.410+0000 7fdb73dea640 1 -- start start 2024-05-16T21:32:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb73dea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 0x7fdb6c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb73dea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb6c0bf050 0x7fdb6c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb73dea640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb6c0c36f0 con 0x7fdb6c06da30 2024-05-16T21:32:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb73dea640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdb6c0bdc10 con 0x7fdb6c0bf050 2024-05-16T21:32:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb73dea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb6c152530 con 0x7fdb6c151fc0 2024-05-16T21:32:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb72387640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb6c0bf050 0x7fdb6c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb72387640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb6c0bf050 0x7fdb6c158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58022/0 (socket says 172.21.15.5:58022) 2024-05-16T21:32:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb72387640 1 -- 172.21.15.5:0/569954950 learned_addr learned my addr 172.21.15.5:0/569954950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb71b86640 1 --2- 172.21.15.5:0/569954950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 0x7fdb6c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb72387640 1 -- 172.21.15.5:0/569954950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 msgr2=0x7fdb6c0bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb72387640 1 --2- 172.21.15.5:0/569954950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 0x7fdb6c0bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb72387640 1 -- 172.21.15.5:0/569954950 >> v1:172.21.15.157:6789/0 conn(0x7fdb6c06da30 legacy=0x7fdb6c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.412+0000 7fdb72387640 1 -- 172.21.15.5:0/569954950 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c152810 con 0x7fdb6c0bf050 2024-05-16T21:32:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.413+0000 7fdb72387640 1 --2- 172.21.15.5:0/569954950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c158e90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009e50 tx=0x7fdb5c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8381e1dafa20acbe server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.413+0000 7fdb70b84640 1 -- 172.21.15.5:0/569954950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c036070 con 0x7fdb6c0bf050 2024-05-16T21:32:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.413+0000 7fdb70b84640 1 -- 172.21.15.5:0/569954950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c031600 con 0x7fdb6c0bf050 2024-05-16T21:32:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.413+0000 7fdb70b84640 1 -- 172.21.15.5:0/569954950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0319d0 con 0x7fdb6c0bf050 2024-05-16T21:32:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.414+0000 7fdb73dea640 1 -- 172.21.15.5:0/569954950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 msgr2=0x7fdb6c158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.414+0000 7fdb73dea640 1 --2- 172.21.15.5:0/569954950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c158e90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009e50 tx=0x7fdb5c02a680 comp rx=0 tx=0).stop 2024-05-16T21:32:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.414+0000 7fdb73dea640 1 -- 172.21.15.5:0/569954950 shutdown_connections 2024-05-16T21:32:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.414+0000 7fdb73dea640 1 --2- 172.21.15.5:0/569954950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c158e90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.414+0000 7fdb73dea640 1 --2- 172.21.15.5:0/569954950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 0x7fdb6c0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.414+0000 7fdb73dea640 1 -- 172.21.15.5:0/569954950 >> 172.21.15.5:0/569954950 conn(0x7fdb6c0c3d20 msgr2=0x7fdb6c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.414+0000 7fdb73dea640 1 -- 172.21.15.5:0/569954950 shutdown_connections 2024-05-16T21:32:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.414+0000 7fdb73dea640 1 -- 172.21.15.5:0/569954950 wait complete. 2024-05-16T21:32:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.415+0000 7fdb73dea640 1 Processor -- start 2024-05-16T21:32:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.415+0000 7fdb73dea640 1 -- start start 2024-05-16T21:32:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.416+0000 7fdb73dea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb6c06da30 0x7fdb6c1e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.416+0000 7fdb73dea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c0b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.416+0000 7fdb73dea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 0x7fdb6c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.416+0000 7fdb73dea640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c0a3050 con 0x7fdb6c0bf050 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.416+0000 7fdb73dea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c0a2ed0 con 0x7fdb6c06da30 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.416+0000 7fdb73dea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb6c06de40 con 0x7fdb6c151fc0 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c0b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c0b86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58038/0 (socket says 172.21.15.5:58038) 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 -- 172.21.15.5:0/2405597034 learned_addr learned my addr 172.21.15.5:0/2405597034 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71b86640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb6c06da30 0x7fdb6c1e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb72387640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 0x7fdb6c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 -- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 msgr2=0x7fdb6c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 0x7fdb6c14b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 -- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb6c06da30 msgr2=0x7fdb6c1e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb6c06da30 0x7fdb6c1e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 -- 172.21.15.5:0/2405597034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c0b9dd0 con 0x7fdb6c0bf050 2024-05-16T21:32:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb71385640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c0b86d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c3d0 tx=0x7fdb6000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb6a7fc640 1 -- 172.21.15.5:0/2405597034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60017070 con 0x7fdb6c0bf050 2024-05-16T21:32:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb6a7fc640 1 -- 172.21.15.5:0/2405597034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb600052d0 con 0x7fdb6c0bf050 2024-05-16T21:32:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb73dea640 1 -- 172.21.15.5:0/2405597034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c1e81a0 con 0x7fdb6c0bf050 2024-05-16T21:32:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb6a7fc640 1 -- 172.21.15.5:0/2405597034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60003830 con 0x7fdb6c0bf050 2024-05-16T21:32:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.417+0000 7fdb73dea640 1 -- 172.21.15.5:0/2405597034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c0b90c0 con 0x7fdb6c0bf050 2024-05-16T21:32:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.419+0000 7fdb6a7fc640 1 -- 172.21.15.5:0/2405597034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb6001a070 con 0x7fdb6c0bf050 2024-05-16T21:32:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.419+0000 7fdb6a7fc640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb58076300 0x7fdb58078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.420+0000 7fdb6a7fc640 1 -- 172.21.15.5:0/2405597034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb600969a0 con 0x7fdb6c0bf050 2024-05-16T21:32:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.420+0000 7fdb71b86640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb58076300 0x7fdb58078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.420+0000 7fdb7ad75740 1 Processor -- start 2024-05-16T21:32:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.420+0000 7fdb7ad75740 1 -- start start 2024-05-16T21:32:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.420+0000 7fdb71b86640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb58076300 0x7fdb58078810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb640079a0 tx=0x7fdb64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.421+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf7681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.421+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.421+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf75d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.421+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf6a2f10 con 0x55fbbf36e590 2024-05-16T21:32:33.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.421+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf692ab0 con 0x55fbbf3663b0 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.421+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55fbbf696af0 con 0x55fbbf38f270 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf75d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf75d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58050/0 (socket says 172.21.15.5:58050) 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 -- 172.21.15.5:0/3029697865 learned_addr learned my addr 172.21.15.5:0/3029697865 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb71385640 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb71b86640 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf7681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 -- 172.21.15.5:0/3029697865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 msgr2=0x55fbbf7681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf7681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 -- 172.21.15.5:0/3029697865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 msgr2=0x55fbbf72c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 -- 172.21.15.5:0/3029697865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbf6565d0 con 0x55fbbf36e590 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb72387640 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf75d2a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009e50 tx=0x7fdb5c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54827a5b328e3a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb537fe640 1 -- 172.21.15.5:0/3029697865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c036040 con 0x55fbbf36e590 2024-05-16T21:32:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb537fe640 1 -- 172.21.15.5:0/3029697865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c037040 con 0x55fbbf36e590 2024-05-16T21:32:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.422+0000 7fdb537fe640 1 -- 172.21.15.5:0/3029697865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c031880 con 0x55fbbf36e590 2024-05-16T21:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3029697865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 msgr2=0x55fbbf75d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf75d2a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009e50 tx=0x7fdb5c02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3029697865 shutdown_connections 2024-05-16T21:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf75d2a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3029697865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf7681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3029697865 >> 172.21.15.5:0/3029697865 conn(0x55fbbf3833c0 msgr2=0x55fbbf7678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3029697865 shutdown_connections 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.423+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3029697865 wait complete. 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.424+0000 7fdb7ad75740 1 -- start start 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.424+0000 7fdb7ad75740 1 Processor -- start 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf75c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf74e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf75e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf378850 con 0x55fbbf36e590 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf64ec10 con 0x55fbbf3663b0 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55fbbf72d080 con 0x55fbbf38f270 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb7ad75740 10 client.0 _ll_register_callbacks cb 0x55fbbf652150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb71385640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf74e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb71385640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf74e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58056/0 (socket says 172.21.15.5:58056) 2024-05-16T21:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.425+0000 7fdb71385640 1 -- 172.21.15.5:0/317166226 learned_addr learned my addr 172.21.15.5:0/317166226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb71b86640 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf75c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb72387640 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf75e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb71385640 1 -- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 msgr2=0x55fbbf75e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb71385640 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf75e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb71385640 1 -- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 msgr2=0x55fbbf75c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb71385640 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf75c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb71385640 1 -- 172.21.15.5:0/317166226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbf3a72d0 con 0x55fbbf36e590 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb71385640 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf74e090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000cd90 tx=0x7fdb6005f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773f61d2e763028e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb50ff9640 1 -- 172.21.15.5:0/317166226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6005f690 con 0x55fbbf36e590 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb50ff9640 1 -- 172.21.15.5:0/317166226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb6005b4f0 con 0x55fbbf36e590 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb7ad75740 1 -- 172.21.15.5:0/317166226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb5c037040 con 0x55fbbf36e590 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb50ff9640 1 -- 172.21.15.5:0/317166226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fdb6005fb80 con 0x55fbbf36e590 2024-05-16T21:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb7ad75740 10 client.4563 fetch_fsmap learned FSMap version 7 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb7ad75740 1 -- 172.21.15.5:0/317166226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55fbbf4716b0 con 0x55fbbf36e590 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb50ff9640 1 -- 172.21.15.5:0/317166226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c037040 con 0x55fbbf36e590 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.426+0000 7fdb50ff9640 1 -- 172.21.15.5:0/317166226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) ==== 2889+0+0 (secure 0 0 0) 0x7fdb6005b6f0 con 0x55fbbf36e590 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb7ad75740 10 client.4563 fetch_fsmap finished waiting for FSMap version 7 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb7ad75740 10 client.4563 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb7ad75740 20 client.4563 populate_metadata read hostname 'smithi005' 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] conn(0x55fbbf34de40 0x55fbbf782a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb7ad75740 4 client.4563 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb7ad75740 1 -- 172.21.15.5:0/317166226 --> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbbf6a4e60 con 0x55fbbf34de40 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb71b86640 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] conn(0x55fbbf34de40 0x55fbbf782a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb50ff9640 10 client.4563 ms_handle_connect on v2:172.21.15.157:6834/134624287 2024-05-16T21:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.427+0000 7fdb71b86640 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] conn(0x55fbbf34de40 0x55fbbf782a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87f409bf2d89e535 server_cookie=ab8f0e7fcbc82c85 in_seq=0 out_seq=0 2024-05-16T21:32:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.428+0000 7fdb50ff9640 1 -- 172.21.15.5:0/317166226 <== mds.0 v2:172.21.15.157:6834/134624287 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fbbf6a4e60 con 0x55fbbf34de40 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.428+0000 7fdb50ff9640 10 client.4563 handle_command_reply: tid=0 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.428+0000 7fdb7ad75740 1 client.4563 shutdown 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 -- 172.21.15.5:0/317166226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 msgr2=0x55fbbf74e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf74e090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000cd90 tx=0x7fdb6005f360 comp rx=0 tx=0).stop 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 -- 172.21.15.5:0/317166226 shutdown_connections 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] conn(0x55fbbf34de40 0x55fbbf782a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf75e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf36e590 0x55fbbf74e090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb50ff9640 0 client.4563 ms_handle_reset on v2:172.21.15.157:6834/134624287 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/317166226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf75c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 -- 172.21.15.5:0/317166226 >> 172.21.15.5:0/317166226 conn(0x55fbbf3833c0 msgr2=0x55fbbf72aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 -- 172.21.15.5:0/317166226 shutdown_connections 2024-05-16T21:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 1 -- 172.21.15.5:0/317166226 wait complete. 2024-05-16T21:32:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.429+0000 7fdb7ad75740 20 client.4563 trim_cache size 0 max 16384 2024-05-16T21:32:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.448+0000 7fdb7ad75740 1 Processor -- start 2024-05-16T21:32:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.448+0000 7fdb7ad75740 1 -- start start 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf36e590 0x55fbbf785a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf38f270 0x55fbbf785f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1f0fe0 con 0x55fbbf38f270 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1e4fd0 con 0x55fbbf3663b0 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb6c1f00f0 con 0x55fbbf36e590 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb72387640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf38f270 0x55fbbf785f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb72387640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf38f270 0x55fbbf785f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58060/0 (socket says 172.21.15.5:58060) 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb72387640 1 -- 172.21.15.5:0/3366658208 learned_addr learned my addr 172.21.15.5:0/3366658208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb71b86640 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.449+0000 7fdb71385640 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf36e590 0x55fbbf785a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb72387640 1 -- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf36e590 msgr2=0x55fbbf785a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb72387640 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf36e590 0x55fbbf785a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb72387640 1 -- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 msgr2=0x55fbbf72b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb72387640 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb72387640 1 -- 172.21.15.5:0/3366658208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbf75ea50 con 0x55fbbf38f270 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb71385640 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf36e590 0x55fbbf785a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb71b86640 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb72387640 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf38f270 0x55fbbf785f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009f40 tx=0x7fdb5c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763bdd094f6b82c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb52ffd640 1 -- 172.21.15.5:0/3366658208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c036040 con 0x55fbbf38f270 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb52ffd640 1 -- 172.21.15.5:0/3366658208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c032810 con 0x55fbbf38f270 2024-05-16T21:32:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.450+0000 7fdb52ffd640 1 -- 172.21.15.5:0/3366658208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c032c00 con 0x55fbbf38f270 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3366658208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf38f270 msgr2=0x55fbbf785f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf38f270 0x55fbbf785f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009f40 tx=0x7fdb5c02f000 comp rx=0 tx=0).stop 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3366658208 shutdown_connections 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf38f270 0x55fbbf785f70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf36e590 0x55fbbf785a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3366658208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf3663b0 0x55fbbf72b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3366658208 >> 172.21.15.5:0/3366658208 conn(0x55fbbf3833c0 msgr2=0x55fbbf75c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3366658208 shutdown_connections 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3366658208 wait complete. 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.451+0000 7fdb7ad75740 1 -- start start 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.452+0000 7fdb7ad75740 1 Processor -- start 2024-05-16T21:32:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf3663b0 0x55fbbf7e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf36e590 0x55fbbf7db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb7ad75740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf780f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf72dde0 con 0x55fbbf3663b0 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf75f940 con 0x55fbbf36e590 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb7ad75740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55fbbf75ec20 con 0x55fbbf38f270 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb7ad75740 10 client.0 _ll_register_callbacks cb 0x7fdb6005f950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf3663b0 0x55fbbf7e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf3663b0 0x55fbbf7e4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58064/0 (socket says 172.21.15.5:58064) 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 -- 172.21.15.5:0/3671289137 learned_addr learned my addr 172.21.15.5:0/3671289137 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71385640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf36e590 0x55fbbf7db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb72387640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf780f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 -- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 msgr2=0x55fbbf780f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf780f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 -- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf36e590 msgr2=0x55fbbf7db250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf36e590 0x55fbbf7db250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 -- 172.21.15.5:0/3671289137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbf780cd0 con 0x55fbbf3663b0 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71385640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf36e590 0x55fbbf7db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb72387640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf780f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb71b86640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf3663b0 0x55fbbf7e4b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55fbbf75fb80 tx=0x7fdb64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654aeae41ddc420d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.453+0000 7fdb50ff9640 1 -- 172.21.15.5:0/3671289137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64030070 con 0x55fbbf3663b0 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb50ff9640 1 -- 172.21.15.5:0/3671289137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb6402b460 con 0x55fbbf3663b0 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3671289137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb5c032810 con 0x55fbbf3663b0 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb50ff9640 1 -- 172.21.15.5:0/3671289137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fdb64037050 con 0x55fbbf3663b0 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 10 client.4569 fetch_fsmap learned FSMap version 7 2024-05-16T21:32:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3671289137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55fbbf7db7f0 con 0x55fbbf3663b0 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb50ff9640 1 -- 172.21.15.5:0/3671289137 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c032810 con 0x55fbbf3663b0 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb50ff9640 1 -- 172.21.15.5:0/3671289137 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) ==== 2889+0+0 (secure 0 0 0) 0x7fdb6403a020 con 0x55fbbf3663b0 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 10 client.4569 fetch_fsmap finished waiting for FSMap version 7 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 10 client.4569 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 20 client.4569 populate_metadata read hostname 'smithi005' 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] conn(0x55fbbf7e1920 0x55fbbf7e1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 4 client.4569 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3671289137 --> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] -- command(tid 0: {"prefix": "status"}) -- 0x55fbbf69e640 con 0x55fbbf7e1920 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.454+0000 7fdb71385640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] conn(0x55fbbf7e1920 0x55fbbf7e1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb50ff9640 10 client.4569 ms_handle_connect on v2:172.21.15.157:6834/134624287 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb71385640 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] conn(0x55fbbf7e1920 0x55fbbf7e1d30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=442e86fd0487c8ab server_cookie=bba5a0877f088b56 in_seq=0 out_seq=0 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb50ff9640 1 -- 172.21.15.5:0/3671289137 <== mds.0 v2:172.21.15.157:6834/134624287 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55fbbf69e640 con 0x55fbbf7e1920 2024-05-16T21:32:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb50ff9640 10 client.4569 handle_command_reply: tid=0 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 client.4569 shutdown 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3671289137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf3663b0 msgr2=0x55fbbf7e4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf3663b0 0x55fbbf7e4b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55fbbf75fb80 tx=0x7fdb64004730 comp rx=0 tx=0).stop 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3671289137 shutdown_connections 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:6834/134624287,v1:172.21.15.157:6835/134624287] conn(0x55fbbf7e1920 0x55fbbf7e1d30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55fbbf38f270 0x55fbbf780f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fbbf36e590 0x55fbbf7db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb50ff9640 0 client.4569 ms_handle_reset on v2:172.21.15.157:6834/134624287 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 --2- 172.21.15.5:0/3671289137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fbbf3663b0 0x55fbbf7e4b10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3671289137 >> 172.21.15.5:0/3671289137 conn(0x55fbbf3833c0 msgr2=0x55fbbf72b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3671289137 shutdown_connections 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 1 -- 172.21.15.5:0/3671289137 wait complete. 2024-05-16T21:32:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.455+0000 7fdb7ad75740 20 client.4569 trim_cache size 0 max 16384 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "4223c61e-038a-4696-b0eb-6b69d601e381", 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4279, 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 11.511530158999999, 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 7, 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 21, 2024-05-16T21:32:33.464 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 21, 2024-05-16T21:32:33.465 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 17.524927562999999 2024-05-16T21:32:33.465 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T21:32:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 -- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb58076300 msgr2=0x7fdb58078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb58076300 0x7fdb58078810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb640079a0 tx=0x7fdb64008040 comp rx=0 tx=0).stop 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 -- 172.21.15.5:0/2405597034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 msgr2=0x7fdb6c0b86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c0b86d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c3d0 tx=0x7fdb6000c890 comp rx=0 tx=0).stop 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 -- 172.21.15.5:0/2405597034 shutdown_connections 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb58076300 0x7fdb58078810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb6c151fc0 0x7fdb6c14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb6c0bf050 0x7fdb6c0b86d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 --2- 172.21.15.5:0/2405597034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb6c06da30 0x7fdb6c1e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 -- 172.21.15.5:0/2405597034 >> 172.21.15.5:0/2405597034 conn(0x7fdb6c0c3d20 msgr2=0x7fdb6c0c2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 -- 172.21.15.5:0/2405597034 shutdown_connections 2024-05-16T21:32:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.456+0000 7fdb73dea640 1 -- 172.21.15.5:0/2405597034 wait complete. 2024-05-16T21:32:33.470 INFO:teuthology.run_tasks:Running task sequential... 2024-05-16T21:32:33.480 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-16T21:32:33.480 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-16T21:32:33.480 INFO:teuthology.task.print:Enabling mgr modules 2024-05-16T21:32:33.480 INFO:teuthology.run_tasks:Running task kclient... 2024-05-16T21:32:33.514 INFO:tasks.kclient:Mounting kernel clients... 2024-05-16T21:32:33.514 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-16T21:32:33.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:33.514 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-05-16T21:32:33.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:33.573 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-05-16T21:32:33.663 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-05-16T21:32:33.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T21:32:33.668 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-16T21:32:33.668 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-16T21:32:33.668 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-16T21:32:33.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-16T21:32:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.784+0000 7fc0874b6640 1 Processor -- start 2024-05-16T21:32:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.785+0000 7fc0874b6640 1 -- start start 2024-05-16T21:32:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc0874b6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0800bc1c0 0x7fc0800a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc0874b6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc080071150 con 0x7fc08014c8e0 2024-05-16T21:32:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc0874b6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08014c120 con 0x7fc080146380 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc0874b6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc08014c450 con 0x7fc0800bc1c0 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc085a53640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc08014c8e0 0x7fc080156a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35066/0 (socket says 172.21.15.5:35066) 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc085a53640 1 -- 172.21.15.5:0/2654112390 learned_addr learned my addr 172.21.15.5:0/2654112390 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc085252640 1 --2- 172.21.15.5:0/2654112390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0800bc1c0 0x7fc0800a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc07ffff640 1 -- 172.21.15.5:0/2654112390 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797488699 0 0) 0x7fc070001490 con 0x7fc08014c8e0 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.786+0000 7fc07ffff640 1 -- 172.21.15.5:0/2654112390 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc068003520 con 0x7fc08014c8e0 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.787+0000 7fc07ffff640 1 -- 172.21.15.5:0/2654112390 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345969283 0 0) 0x7fc08014c120 con 0x7fc080146380 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.787+0000 7fc07ffff640 1 -- 172.21.15.5:0/2654112390 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc070001490 con 0x7fc080146380 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.787+0000 7fc07ffff640 1 -- 172.21.15.5:0/2654112390 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1571636436 0 0) 0x7fc068003520 con 0x7fc08014c8e0 2024-05-16T21:32:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.787+0000 7fc085252640 1 -- 172.21.15.5:0/2654112390 >> v1:172.21.15.157:6789/0 conn(0x7fc080146380 legacy=0x7fc080070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.787+0000 7fc085252640 1 -- 172.21.15.5:0/2654112390 >> v1:172.21.15.5:6789/0 conn(0x7fc08014c8e0 legacy=0x7fc080156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.787+0000 7fc085252640 1 -- 172.21.15.5:0/2654112390 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc080071e40 con 0x7fc0800bc1c0 2024-05-16T21:32:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.787+0000 7fc085252640 1 --2- 172.21.15.5:0/2654112390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0800bc1c0 0x7fc0800a0ba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc08014c2f0 tx=0x7fc07802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc4954d1f3d42d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc07ffff640 1 -- 172.21.15.5:0/2654112390 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078037070 con 0x7fc0800bc1c0 2024-05-16T21:32:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc07ffff640 1 -- 172.21.15.5:0/2654112390 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07802ac10 con 0x7fc0800bc1c0 2024-05-16T21:32:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc07ffff640 1 -- 172.21.15.5:0/2654112390 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070001c40 con 0x7fc0800bc1c0 2024-05-16T21:32:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc0874b6640 1 -- 172.21.15.5:0/2654112390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0800bc1c0 msgr2=0x7fc0800a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc0874b6640 1 --2- 172.21.15.5:0/2654112390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0800bc1c0 0x7fc0800a0ba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc08014c2f0 tx=0x7fc07802a180 comp rx=0 tx=0).stop 2024-05-16T21:32:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc0874b6640 1 -- 172.21.15.5:0/2654112390 shutdown_connections 2024-05-16T21:32:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc0874b6640 1 --2- 172.21.15.5:0/2654112390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0800bc1c0 0x7fc0800a0ba0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc0874b6640 1 -- 172.21.15.5:0/2654112390 >> 172.21.15.5:0/2654112390 conn(0x7fc0800c17c0 msgr2=0x7fc0800c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.788+0000 7fc0874b6640 1 -- 172.21.15.5:0/2654112390 shutdown_connections 2024-05-16T21:32:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.789+0000 7fc0874b6640 1 -- 172.21.15.5:0/2654112390 wait complete. 2024-05-16T21:32:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.790+0000 7fc0874b6640 1 Processor -- start 2024-05-16T21:32:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.790+0000 7fc0874b6640 1 -- start start 2024-05-16T21:32:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc0874b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0800bc1c0 0x7fc0801e2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc0874b6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc080146380 0x7fc08014b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc0874b6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08014c8e0 0x7fc08013fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc0874b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc080146790 con 0x7fc0800bc1c0 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc0874b6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc0800716b0 con 0x7fc08014c8e0 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc0874b6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc0800bd5f0 con 0x7fc080146380 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc085252640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0800bc1c0 0x7fc0801e2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc085252640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0800bc1c0 0x7fc0801e2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58076/0 (socket says 172.21.15.5:58076) 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc085252640 1 -- 172.21.15.5:0/2788598635 learned_addr learned my addr 172.21.15.5:0/2788598635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc085a53640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08014c8e0 0x7fc08013fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc084a51640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc080146380 0x7fc08014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc085252640 1 -- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc080146380 msgr2=0x7fc08014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.791+0000 7fc085252640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc080146380 0x7fc08014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc085252640 1 -- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08014c8e0 msgr2=0x7fc08013fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc085252640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08014c8e0 0x7fc08013fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc085252640 1 -- 172.21.15.5:0/2788598635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0801e2cc0 con 0x7fc0800bc1c0 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc085a53640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08014c8e0 0x7fc08013fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc085252640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0800bc1c0 0x7fc0801e2780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0780098c0 tx=0x7fc0780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc07dffb640 1 -- 172.21.15.5:0/2788598635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078037050 con 0x7fc0800bc1c0 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc07dffb640 1 -- 172.21.15.5:0/2788598635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc078043070 con 0x7fc0800bc1c0 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08014b870 con 0x7fc0800bc1c0 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc07dffb640 1 -- 172.21.15.5:0/2788598635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078006e10 con 0x7fc0800bc1c0 2024-05-16T21:32:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.792+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc080148f30 con 0x7fc0800bc1c0 2024-05-16T21:32:33.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.793+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc080149b20 con 0x7fc0800bc1c0 2024-05-16T21:32:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.794+0000 7fc07dffb640 1 -- 172.21.15.5:0/2788598635 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc07803ca10 con 0x7fc0800bc1c0 2024-05-16T21:32:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.794+0000 7fc07dffb640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc06c076300 0x7fc06c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.795+0000 7fc07dffb640 1 -- 172.21.15.5:0/2788598635 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc0780b7fd0 con 0x7fc0800bc1c0 2024-05-16T21:32:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.795+0000 7fc084a51640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc06c076300 0x7fc06c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.795+0000 7fc084a51640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc06c076300 0x7fc06c078810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc0800a43e0 tx=0x7fc074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:33.800+0000 7fc07dffb640 1 -- 172.21.15.5:0/2788598635 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc07804d020 con 0x7fc0800bc1c0 2024-05-16T21:32:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.028+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc080050940 con 0x7fc0800bc1c0 2024-05-16T21:32:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.029+0000 7fc07dffb640 1 -- 172.21.15.5:0/2788598635 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fc0780818a0 con 0x7fc0800bc1c0 2024-05-16T21:32:34.031 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.030+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc06c076300 msgr2=0x7fc06c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.030+0000 7fc0874b6640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc06c076300 0x7fc06c078810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc0800a43e0 tx=0x7fc074009040 comp rx=0 tx=0).stop 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.030+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0800bc1c0 msgr2=0x7fc0801e2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.030+0000 7fc0874b6640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0800bc1c0 0x7fc0801e2780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0780098c0 tx=0x7fc0780046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.031+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 shutdown_connections 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.031+0000 7fc0874b6640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc06c076300 0x7fc06c078810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.031+0000 7fc0874b6640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08014c8e0 0x7fc08013fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.031+0000 7fc0874b6640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc080146380 0x7fc08014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.031+0000 7fc0874b6640 1 --2- 172.21.15.5:0/2788598635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0800bc1c0 0x7fc0801e2780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.031+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 >> 172.21.15.5:0/2788598635 conn(0x7fc0800c17c0 msgr2=0x7fc080070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.031+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 shutdown_connections 2024-05-16T21:32:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:34.031+0000 7fc0874b6640 1 -- 172.21.15.5:0/2788598635 wait complete. 2024-05-16T21:32:34.044 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-16T21:32:34.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-16T21:32:34.045 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-05-16T21:32:34.045 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-16T21:32:34.045 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-16T21:32:34.045 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-16T21:32:34.045 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-16T21:32:34.045 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-16T21:32:34.045 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T21:32:34.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:34.045 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-05-16T21:32:34.101 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-16T21:32:34.101 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:32:34.102 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-05-16T21:32:34.103 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-16T21:32:34.103 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-05-16T21:32:34.103 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-16T21:32:34.103 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42616sec preferred_lft 42616sec 2024-05-16T21:32:34.103 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-05-16T21:32:34.103 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:32:34.104 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-16T21:32:34.104 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T21:32:34.104 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-05-16T21:32:34.104 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add name ceph-brx type bridge 2024-05-16T21:32:34.104 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr flush dev ceph-brx 2024-05-16T21:32:34.104 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set ceph-brx up 2024-05-16T21:32:34.105 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-16T21:32:34.105 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-05-16T21:32:34.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T21:32:34.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:34.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:34.595 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-16T21:32:34.667 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-05-16T21:32:34.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:34.670 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-05-16T21:32:34.731 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-05-16T21:32:34.731 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-16T21:32:34.731 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-16T21:32:34.731 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-16T21:32:34.731 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-16T21:32:34.733 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T21:32:34.733 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-05-16T21:32:34.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-16T21:32:34.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-16T21:32:34.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-16T21:32:34.733 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-05-16T21:32:34.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T21:32:35.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:35.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:35.538 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-05-16T21:32:35.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:35.591 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list-id 2024-05-16T21:32:35.644 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T21:32:35.644 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-05-16T21:32:35.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-16T21:32:35.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-16T21:32:35.644 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-05-16T21:32:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T21:32:35.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:35.824 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-16T21:32:35.824 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T21:32:35.825 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-05-16T21:32:35.825 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-16T21:32:35.825 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-16T21:32:35.825 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-16T21:32:35.825 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-16T21:32:35.825 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-16T21:32:35.825 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-05-16T21:32:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T21:32:36.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:36.120 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T21:32:36.120 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-05-16T21:32:36.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-05-16T21:32:36.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set dev brx.0 master ceph-brx 2024-05-16T21:32:36.121 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-05-16T21:32:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T21:32:36.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:36.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T21:32:36.323 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-16T21:32:36.372 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-16T21:32:36.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T21:32:36.372 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-16T21:32:36.420 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-16T21:32:36.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:36.421 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:32:36.682 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:32:36.683 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:32:36.683 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:32:37.413 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:32:37.413 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:32:37.413 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:32:37.413 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-05-16T21:32:37.413 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T21:32:37.460 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:32:37.460 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:32:37.460 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:32:37.460 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-05-16T21:32:37.460 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T21:32:37.460 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.157:6789,172.21.15.157:6790" 2024-05-16T21:32:37.460 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.157:6789,172.21.15.157:6790:/ 2024-05-16T21:32:37.460 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4223c61e-038a-4696-b0eb-6b69d601e381" will pass to kernel 2024-05-16T21:32:37.463 INFO:teuthology.orchestra.run.smithi181.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-16T21:32:37.463 INFO:teuthology.orchestra.run.smithi181.stdout: You just mounted a file system that supports labels which does not 2024-05-16T21:32:37.463 INFO:teuthology.orchestra.run.smithi181.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-16T21:32:37.463 INFO:teuthology.orchestra.run.smithi181.stdout: applications will generate AVC messages and not be allowed access to 2024-05-16T21:32:37.463 INFO:teuthology.orchestra.run.smithi181.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-16T21:32:37.468 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-16T21:32:37.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:37.468 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-16T21:32:37.549 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T21:32:37.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:32:37.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:37.683 INFO:teuthology.orchestra.run.smithi181.stdout:client4445 2024-05-16T21:32:37.683 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:32:37.684 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:32:37.733 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T21:32:37.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:32:37.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:37.917 INFO:teuthology.orchestra.run.smithi181.stdout:client4445 2024-05-16T21:32:37.918 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T21:32:38.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:32:38.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:38.048 INFO:teuthology.orchestra.run.smithi181.stdout:client4445 2024-05-16T21:32:38.048 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4223c61e-038a-4696-b0eb-6b69d601e381.client4445/status') 2024-05-16T21:32:38.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T21:32:38.191 INFO:teuthology.orchestra.run.smithi181.stdout:instance: client.4445 (3)172.21.15.181:0/301988599 2024-05-16T21:32:38.192 INFO:teuthology.orchestra.run.smithi181.stdout:blocklisted: false 2024-05-16T21:32:38.192 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records in 2024-05-16T21:32:38.192 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records out 2024-05-16T21:32:38.192 INFO:teuthology.orchestra.run.smithi181.stderr:70 bytes copied, 8.6031e-05 s, 814 kB/s 2024-05-16T21:32:38.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:32:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:32:38.205 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-16T21:32:38.217 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-16T21:32:38.249 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) That fscrypt can be setup and ingest files. 2024-05-16T21:32:38.249 INFO:tasks.cephfs_test_runner:test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) 2024-05-16T21:32:38.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:38.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.372+0000 7f258f74d640 1 Processor -- start 2024-05-16T21:32:38.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.372+0000 7f258f74d640 1 -- start start 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.373+0000 7f258f74d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25880be4f0 0x7f25880bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258f74d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f258814d0f0 0x7f2588156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258f74d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25880720d0 con 0x7f258814cce0 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258f74d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f25880bfa60 con 0x7f25880be4f0 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258f74d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f2588071310 con 0x7f258814d0f0 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258d4e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25880be4f0 0x7f25880bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258d4e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25880be4f0 0x7f25880bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53020/0 (socket says 172.21.15.5:53020) 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258d4e9640 1 -- 172.21.15.5:0/2846885852 learned_addr learned my addr 172.21.15.5:0/2846885852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258dcea640 1 --2- 172.21.15.5:0/2846885852 >> v2:172.21.15.157:3300/0 conn(0x7f258814d0f0 0x7f2588156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258d4e9640 1 -- 172.21.15.5:0/2846885852 >> v2:172.21.15.157:3300/0 conn(0x7f258814d0f0 msgr2=0x7f2588156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258d4e9640 1 --2- 172.21.15.5:0/2846885852 >> v2:172.21.15.157:3300/0 conn(0x7f258814d0f0 0x7f2588156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258d4e9640 1 -- 172.21.15.5:0/2846885852 >> v1:172.21.15.157:6789/0 conn(0x7f258814cce0 legacy=0x7f25880716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.374+0000 7f258d4e9640 1 -- 172.21.15.5:0/2846885852 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25880bf6f0 con 0x7f25880be4f0 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.375+0000 7f258d4e9640 1 --2- 172.21.15.5:0/2846885852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25880be4f0 0x7f25880bfef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25880a12c0 tx=0x7f258002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb8292aa84dac17 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.375+0000 7f2587fff640 1 -- 172.21.15.5:0/2846885852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580037070 con 0x7f25880be4f0 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.375+0000 7f2587fff640 1 -- 172.21.15.5:0/2846885852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2580032440 con 0x7f25880be4f0 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.375+0000 7f2587fff640 1 -- 172.21.15.5:0/2846885852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580032810 con 0x7f25880be4f0 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.376+0000 7f258f74d640 1 -- 172.21.15.5:0/2846885852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25880be4f0 msgr2=0x7f25880bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.376+0000 7f258f74d640 1 --2- 172.21.15.5:0/2846885852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25880be4f0 0x7f25880bfef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25880a12c0 tx=0x7f258002a1e0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.376+0000 7f258f74d640 1 -- 172.21.15.5:0/2846885852 shutdown_connections 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.376+0000 7f258f74d640 1 --2- 172.21.15.5:0/2846885852 >> v2:172.21.15.157:3300/0 conn(0x7f258814d0f0 0x7f2588156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.376+0000 7f258f74d640 1 --2- 172.21.15.5:0/2846885852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25880be4f0 0x7f25880bfef0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.376+0000 7f258f74d640 1 -- 172.21.15.5:0/2846885852 >> 172.21.15.5:0/2846885852 conn(0x7f25880c17c0 msgr2=0x7f25880c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.376+0000 7f258f74d640 1 -- 172.21.15.5:0/2846885852 shutdown_connections 2024-05-16T21:32:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.376+0000 7f258f74d640 1 -- 172.21.15.5:0/2846885852 wait complete. 2024-05-16T21:32:38.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.377+0000 7f258f74d640 1 Processor -- start 2024-05-16T21:32:38.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.377+0000 7f258f74d640 1 -- start start 2024-05-16T21:32:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258f74d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25880be4f0 0x7f258809ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258f74d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258814cce0 0x7f25881e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258f74d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258814d0f0 0x7f2588141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258f74d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2588071db0 con 0x7f258814cce0 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258f74d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f25880723b0 con 0x7f258814d0f0 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258f74d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f25880c0430 con 0x7f25880be4f0 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258814cce0 0x7f25881e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258814cce0 0x7f25881e7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53032/0 (socket says 172.21.15.5:53032) 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 -- 172.21.15.5:0/351552582 learned_addr learned my addr 172.21.15.5:0/351552582 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258d4e9640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25880be4f0 0x7f258809ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258dcea640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258814d0f0 0x7f2588141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 -- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25880be4f0 msgr2=0x7f258809ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25880be4f0 0x7f258809ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 -- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258814d0f0 msgr2=0x7f2588141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258814d0f0 0x7f2588141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 -- 172.21.15.5:0/351552582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25880a0470 con 0x7f258814cce0 2024-05-16T21:32:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258cce8640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258814cce0 0x7f25881e7ea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c370 tx=0x7f257c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f2585ffb640 1 -- 172.21.15.5:0/351552582 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c017070 con 0x7f258814cce0 2024-05-16T21:32:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f2585ffb640 1 -- 172.21.15.5:0/351552582 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c0052d0 con 0x7f258814cce0 2024-05-16T21:32:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258806e710 con 0x7f258814cce0 2024-05-16T21:32:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.379+0000 7f2585ffb640 1 -- 172.21.15.5:0/351552582 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c003810 con 0x7f258814cce0 2024-05-16T21:32:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.380+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258806e470 con 0x7f258814cce0 2024-05-16T21:32:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.381+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25880bbb20 con 0x7f258814cce0 2024-05-16T21:32:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.381+0000 7f2585ffb640 1 -- 172.21.15.5:0/351552582 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f257c01a070 con 0x7f258814cce0 2024-05-16T21:32:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.382+0000 7f2585ffb640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f25740762d0 0x7f25740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.382+0000 7f2585ffb640 1 -- 172.21.15.5:0/351552582 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f257c096870 con 0x7f258814cce0 2024-05-16T21:32:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.382+0000 7f258d4e9640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f25740762d0 0x7f25740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.383+0000 7f258d4e9640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f25740762d0 0x7f25740787e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2580034000 tx=0x7f258002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:38.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.387+0000 7f2585ffb640 1 -- 172.21.15.5:0/351552582 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f257c05fb80 con 0x7f258814cce0 2024-05-16T21:32:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.579+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2588050940 con 0x7f258814cce0 2024-05-16T21:32:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.580+0000 7f2585ffb640 1 -- 172.21.15.5:0/351552582 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f257c0681c0 con 0x7f258814cce0 2024-05-16T21:32:38.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:38.584 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:22.944103+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f25740762d0 msgr2=0x7f25740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f25740762d0 0x7f25740787e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2580034000 tx=0x7f258002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258814cce0 msgr2=0x7f25881e7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258814cce0 0x7f25881e7ea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c370 tx=0x7f257c00c830 comp rx=0 tx=0).stop 2024-05-16T21:32:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 shutdown_connections 2024-05-16T21:32:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f25740762d0 0x7f25740787e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258814d0f0 0x7f2588141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258814cce0 0x7f25881e7ea0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 --2- 172.21.15.5:0/351552582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25880be4f0 0x7f258809ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 >> 172.21.15.5:0/351552582 conn(0x7f25880c17c0 msgr2=0x7f2588149d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 shutdown_connections 2024-05-16T21:32:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.583+0000 7f258f74d640 1 -- 172.21.15.5:0/351552582 wait complete. 2024-05-16T21:32:38.597 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-16T21:32:10.378693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-16T21:32:19.250612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-16T21:32:20.291137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-16T21:32:38.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-16T21:32:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.709+0000 7f6cc5c2b640 1 Processor -- start 2024-05-16T21:32:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.709+0000 7f6cc5c2b640 1 -- start start 2024-05-16T21:32:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cc5c2b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cc00a9060 0x7f6cc0148910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cc5c2b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc014ed70 0x7f6cc0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cc5c2b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc00b8a30 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cc5c2b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc00b8d10 con 0x7f6cc00a9060 2024-05-16T21:32:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cc5c2b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc00b8ff0 con 0x7f6cc014ed70 2024-05-16T21:32:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cbf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cc00a9060 0x7f6cc0148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cbf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cc00a9060 0x7f6cc0148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53046/0 (socket says 172.21.15.5:53046) 2024-05-16T21:32:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cbf7fe640 1 -- 172.21.15.5:0/2269838521 learned_addr learned my addr 172.21.15.5:0/2269838521 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cbffff640 1 --2- 172.21.15.5:0/2269838521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc014ed70 0x7f6cc0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cbf7fe640 1 -- 172.21.15.5:0/2269838521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc014ed70 msgr2=0x7f6cc0158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cbf7fe640 1 --2- 172.21.15.5:0/2269838521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc014ed70 0x7f6cc0158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cbf7fe640 1 -- 172.21.15.5:0/2269838521 >> v1:172.21.15.157:6789/0 conn(0x7f6cc00ba0f0 legacy=0x7f6cc014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.710+0000 7f6cbf7fe640 1 -- 172.21.15.5:0/2269838521 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc00b92d0 con 0x7f6cc00a9060 2024-05-16T21:32:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.711+0000 7f6cbf7fe640 1 --2- 172.21.15.5:0/2269838521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00a9060 0x7f6cc0148910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009870 tx=0x7f6cb002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db9465f8691e84e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.711+0000 7f6cbe7fc640 1 -- 172.21.15.5:0/2269838521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0037070 con 0x7f6cc00a9060 2024-05-16T21:32:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.711+0000 7f6cbe7fc640 1 -- 172.21.15.5:0/2269838521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0032440 con 0x7f6cc00a9060 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.711+0000 7f6cbe7fc640 1 -- 172.21.15.5:0/2269838521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0032810 con 0x7f6cc00a9060 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.712+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/2269838521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00a9060 msgr2=0x7f6cc0148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.712+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/2269838521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00a9060 0x7f6cc0148910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009870 tx=0x7f6cb002a250 comp rx=0 tx=0).stop 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.712+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/2269838521 shutdown_connections 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.712+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/2269838521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc014ed70 0x7f6cc0158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.712+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/2269838521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00a9060 0x7f6cc0148910 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.712+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/2269838521 >> 172.21.15.5:0/2269838521 conn(0x7f6cc00c07c0 msgr2=0x7f6cc00c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.712+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/2269838521 shutdown_connections 2024-05-16T21:32:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.712+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/2269838521 wait complete. 2024-05-16T21:32:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.713+0000 7f6cc5c2b640 1 Processor -- start 2024-05-16T21:32:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.713+0000 7f6cc5c2b640 1 -- start start 2024-05-16T21:32:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.714+0000 7f6cc5c2b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00a9060 0x7f6cc01d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.714+0000 7f6cc5c2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00ba0f0 0x7f6cc01e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.714+0000 7f6cc5c2b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc014ed70 0x7f6cc0141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.714+0000 7f6cc5c2b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc008dbb0 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.714+0000 7f6cc5c2b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc008da30 con 0x7f6cc014ed70 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.714+0000 7f6cc5c2b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc00ba500 con 0x7f6cc00a9060 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00ba0f0 0x7f6cc01e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00ba0f0 0x7f6cc01e52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53056/0 (socket says 172.21.15.5:53056) 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00a9060 0x7f6cc01d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 -- 172.21.15.5:0/3702448064 learned_addr learned my addr 172.21.15.5:0/3702448064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbffff640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc014ed70 0x7f6cc0141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 -- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00a9060 msgr2=0x7f6cc01d7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00a9060 0x7f6cc01d7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 -- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc014ed70 msgr2=0x7f6cc0141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc014ed70 0x7f6cc0141980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 -- 172.21.15.5:0/3702448064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc01d8430 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cbeffd640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00ba0f0 0x7f6cc01e52a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400b3f0 tx=0x7f6cb400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6ca7fff640 1 -- 172.21.15.5:0/3702448064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4015020 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6ca7fff640 1 -- 172.21.15.5:0/3702448064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb4011830 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc01e57e0 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6ca7fff640 1 -- 172.21.15.5:0/3702448064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4011c20 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.715+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc0143180 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.716+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc00bb020 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.717+0000 7f6ca7fff640 1 -- 172.21.15.5:0/3702448064 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6cb4018020 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.718+0000 7f6ca7fff640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6cac0762d0 0x7f6cac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.718+0000 7f6ca7fff640 1 -- 172.21.15.5:0/3702448064 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6cb40973c0 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.718+0000 7f6cbf7fe640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6cac0762d0 0x7f6cac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.718+0000 7f6cbf7fe640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6cac0762d0 0x7f6cac0787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0034000 tx=0x7f6cb002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:38.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.722+0000 7f6ca7fff640 1 -- 172.21.15.5:0/3702448064 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6cb401f020 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.912+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6cc014e360 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.913+0000 7f6ca7fff640 1 -- 172.21.15.5:0/3702448064 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f6cb40606c0 con 0x7f6cc00ba0f0 2024-05-16T21:32:38.916 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-05-16T21:32:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6cac0762d0 msgr2=0x7f6cac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6cac0762d0 0x7f6cac0787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0034000 tx=0x7f6cb002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00ba0f0 msgr2=0x7f6cc01e52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00ba0f0 0x7f6cc01e52a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400b3f0 tx=0x7f6cb400b8b0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 shutdown_connections 2024-05-16T21:32:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6cac0762d0 0x7f6cac0787e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc014ed70 0x7f6cc0141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc00ba0f0 0x7f6cc01e52a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 --2- 172.21.15.5:0/3702448064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00a9060 0x7f6cc01d7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 >> 172.21.15.5:0/3702448064 conn(0x7f6cc00c07c0 msgr2=0x7f6cc0074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 shutdown_connections 2024-05-16T21:32:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:38.915+0000 7f6cc5c2b640 1 -- 172.21.15.5:0/3702448064 wait complete. 2024-05-16T21:32:38.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-16T21:32:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.040+0000 7fdbc6115640 1 Processor -- start 2024-05-16T21:32:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.040+0000 7fdbc6115640 1 -- start start 2024-05-16T21:32:39.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.041+0000 7fdbc6115640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc014e360 0x7fdbc01522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.041+0000 7fdbc6115640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdbc0148770 0x7fdbc00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.041+0000 7fdbc6115640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc00c0620 con 0x7fdbc00bf9b0 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.041+0000 7fdbc6115640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc0151e40 con 0x7fdbc0148770 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.041+0000 7fdbc6115640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc0151ad0 con 0x7fdbc014e360 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdbc00bf9b0 0x7fdbc00bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46452/0 (socket says 172.21.15.5:46452) 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbffff640 1 -- 172.21.15.5:0/1907965117 learned_addr learned my addr 172.21.15.5:0/1907965117 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbf7fe640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc014e360 0x7fdbc01522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbeffd640 1 --2- 172.21.15.5:0/1907965117 >> v2:172.21.15.157:3300/0 conn(0x7fdbc0148770 0x7fdbc00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50761818 0 0) 0x7fdbc00c0620 con 0x7fdbc00bf9b0 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdba8003520 con 0x7fdbc00bf9b0 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2398989582 0 0) 0x7fdba8003520 con 0x7fdbc00bf9b0 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc014e360 msgr2=0x7fdbc01522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:39.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc014e360 0x7fdbc01522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 >> v2:172.21.15.157:3300/0 conn(0x7fdbc0148770 msgr2=0x7fdbc00c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 --2- 172.21.15.5:0/1907965117 >> v2:172.21.15.157:3300/0 conn(0x7fdbc0148770 0x7fdbc00c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc0152810 con 0x7fdbc00bf9b0 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fdbb8001a70 con 0x7fdbc00bf9b0 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 >> v1:172.21.15.5:6789/0 conn(0x7fdbc00bf9b0 legacy=0x7fdbc00bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc014e360 0x7fdba8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba8003fd0 0x7fdba8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdba8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0151e40 con 0x7fdba8004d40 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0151ad0 con 0x7fdba8003fd0 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdba800bb50 con 0x7fdbc014e360 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbffff640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdba8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbf7fe640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc014e360 0x7fdba8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.042+0000 7fdbbeffd640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba8003fd0 0x7fdba8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.043+0000 7fdbbffff640 1 -- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc014e360 msgr2=0x7fdba8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.043+0000 7fdbbffff640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc014e360 0x7fdba8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.043+0000 7fdbbffff640 1 -- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba8003fd0 msgr2=0x7fdba8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.043+0000 7fdbbffff640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba8003fd0 0x7fdba8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.043+0000 7fdbbffff640 1 -- 172.21.15.5:0/1907965117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba8003520 con 0x7fdba8004d40 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.043+0000 7fdbbffff640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdba8005150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8002230 tx=0x7fdba8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72165835699a9d3c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800a4a0 con 0x7fdba8004d40 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb802f070 con 0x7fdba8004d40 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbbe7fc640 1 -- 172.21.15.5:0/1907965117 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb802bc70 con 0x7fdba8004d40 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbc6115640 1 -- 172.21.15.5:0/1907965117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 msgr2=0x7fdba8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbc6115640 1 --2- 172.21.15.5:0/1907965117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdba8005150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8002230 tx=0x7fdba8005830 comp rx=0 tx=0).stop 2024-05-16T21:32:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbbffff640 1 -- 172.21.15.5:0/1907965117 reap_dead start 2024-05-16T21:32:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbc6115640 1 -- 172.21.15.5:0/1907965117 shutdown_connections 2024-05-16T21:32:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbc6115640 1 -- 172.21.15.5:0/1907965117 >> 172.21.15.5:0/1907965117 conn(0x7fdbc00c17c0 msgr2=0x7fdbc00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbc6115640 1 -- 172.21.15.5:0/1907965117 shutdown_connections 2024-05-16T21:32:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.044+0000 7fdbc6115640 1 -- 172.21.15.5:0/1907965117 wait complete. 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.046+0000 7fdbc6115640 1 Processor -- start 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.046+0000 7fdbc6115640 1 -- start start 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbc6115640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdbc00a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbc6115640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbc00a51a0 0x7fdbc00a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbc6115640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc0147580 0x7fdbc0147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbc6115640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01522d0 con 0x7fdba8004d40 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbc6115640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc00c13d0 con 0x7fdbc00a51a0 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbc6115640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc0152450 con 0x7fdbc0147580 2024-05-16T21:32:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdbc00a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdbc00a23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53082/0 (socket says 172.21.15.5:53082) 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbf7fe640 1 -- 172.21.15.5:0/1856659636 learned_addr learned my addr 172.21.15.5:0/1856659636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbffff640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc0147580 0x7fdbc0147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbeffd640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbc00a51a0 0x7fdbc00a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbf7fe640 1 -- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc0147580 msgr2=0x7fdbc0147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbf7fe640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc0147580 0x7fdbc0147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbf7fe640 1 -- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbc00a51a0 msgr2=0x7fdbc00a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbf7fe640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbc00a51a0 0x7fdbc00a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.047+0000 7fdbbf7fe640 1 -- 172.21.15.5:0/1856659636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc00a1c00 con 0x7fdba8004d40 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.048+0000 7fdbbf7fe640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdbc00a23e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00119a0 tx=0x7fdbb0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.048+0000 7fdba7fff640 1 -- 172.21.15.5:0/1856659636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000faf0 con 0x7fdba8004d40 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.048+0000 7fdba7fff640 1 -- 172.21.15.5:0/1856659636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb000fc90 con 0x7fdba8004d40 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.048+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc0148190 con 0x7fdba8004d40 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.048+0000 7fdba7fff640 1 -- 172.21.15.5:0/1856659636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0014440 con 0x7fdba8004d40 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.048+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc01e5320 con 0x7fdba8004d40 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.049+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc01e4e50 con 0x7fdba8004d40 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.050+0000 7fdba7fff640 1 -- 172.21.15.5:0/1856659636 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdbb0012040 con 0x7fdba8004d40 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.050+0000 7fdba7fff640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdbac0762d0 0x7fdbac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.050+0000 7fdba7fff640 1 -- 172.21.15.5:0/1856659636 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdbb0097c20 con 0x7fdba8004d40 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.051+0000 7fdbbeffd640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdbac0762d0 0x7fdbac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.051+0000 7fdbbeffd640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdbac0762d0 0x7fdbac0787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdbc014d760 tx=0x7fdbb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.055+0000 7fdba7fff640 1 -- 172.21.15.5:0/1856659636 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdbb0019030 con 0x7fdba8004d40 2024-05-16T21:32:39.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.244+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdbc00a6d70 con 0x7fdba8004d40 2024-05-16T21:32:39.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.244+0000 7fdba7fff640 1 -- 172.21.15.5:0/1856659636 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fdbb0061580 con 0x7fdba8004d40 2024-05-16T21:32:39.247 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-05-16T21:32:39.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdbac0762d0 msgr2=0x7fdbac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdbac0762d0 0x7fdbac0787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdbc014d760 tx=0x7fdbb4008040 comp rx=0 tx=0).stop 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 msgr2=0x7fdbc00a23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdbc00a23e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00119a0 tx=0x7fdbb0011e60 comp rx=0 tx=0).stop 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 shutdown_connections 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdbac0762d0 0x7fdbac0787e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbc0147580 0x7fdbc0147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbc00a51a0 0x7fdbc00a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 --2- 172.21.15.5:0/1856659636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba8004d40 0x7fdbc00a23e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 >> 172.21.15.5:0/1856659636 conn(0x7fdbc00c17c0 msgr2=0x7fdbc01dacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 shutdown_connections 2024-05-16T21:32:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.246+0000 7fdbc6115640 1 -- 172.21.15.5:0/1856659636 wait complete. 2024-05-16T21:32:39.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-16T21:32:39.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.371+0000 7f3086f14640 1 Processor -- start 2024-05-16T21:32:39.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.371+0000 7f3086f14640 1 -- start start 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.372+0000 7f3086f14640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f308014e360 0x7f30801522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.372+0000 7f3086f14640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f30800bf9b0 0x7f30800bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.372+0000 7f3086f14640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30800c1390 con 0x7f3080148770 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.372+0000 7f3086f14640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3080151e40 con 0x7f308014e360 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.372+0000 7f3086f14640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f30800c0620 con 0x7f30800bf9b0 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.373+0000 7f3084cb0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f308014e360 0x7f30801522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.373+0000 7f3084cb0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f308014e360 0x7f30801522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53096/0 (socket says 172.21.15.5:53096) 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.373+0000 7f3084cb0640 1 -- 172.21.15.5:0/2480091986 learned_addr learned my addr 172.21.15.5:0/2480091986 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.373+0000 7f30854b1640 1 --2- 172.21.15.5:0/2480091986 >> v2:172.21.15.157:3300/0 conn(0x7f30800bf9b0 0x7f30800bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.373+0000 7f3084cb0640 1 -- 172.21.15.5:0/2480091986 >> v2:172.21.15.157:3300/0 conn(0x7f30800bf9b0 msgr2=0x7f30800bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.373+0000 7f3084cb0640 1 --2- 172.21.15.5:0/2480091986 >> v2:172.21.15.157:3300/0 conn(0x7f30800bf9b0 0x7f30800bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.373+0000 7f3084cb0640 1 -- 172.21.15.5:0/2480091986 >> v1:172.21.15.157:6789/0 conn(0x7f3080148770 legacy=0x7f30800c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.373+0000 7f3084cb0640 1 -- 172.21.15.5:0/2480091986 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3080151ad0 con 0x7f308014e360 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.374+0000 7f3084cb0640 1 --2- 172.21.15.5:0/2480091986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f308014e360 0x7f30801522d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3078009870 tx=0x7f307802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4da600a0648ae2f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.374+0000 7f307f7fe640 1 -- 172.21.15.5:0/2480091986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078037070 con 0x7f308014e360 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.374+0000 7f307f7fe640 1 -- 172.21.15.5:0/2480091986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3078032640 con 0x7f308014e360 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.374+0000 7f307f7fe640 1 -- 172.21.15.5:0/2480091986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078032a10 con 0x7f308014e360 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.375+0000 7f3086f14640 1 -- 172.21.15.5:0/2480091986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f308014e360 msgr2=0x7f30801522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.375+0000 7f3086f14640 1 --2- 172.21.15.5:0/2480091986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f308014e360 0x7f30801522d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3078009870 tx=0x7f307802a330 comp rx=0 tx=0).stop 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.375+0000 7f3086f14640 1 -- 172.21.15.5:0/2480091986 shutdown_connections 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.375+0000 7f3086f14640 1 --2- 172.21.15.5:0/2480091986 >> v2:172.21.15.157:3300/0 conn(0x7f30800bf9b0 0x7f30800bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.375+0000 7f3086f14640 1 --2- 172.21.15.5:0/2480091986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f308014e360 0x7f30801522d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.375+0000 7f3086f14640 1 -- 172.21.15.5:0/2480091986 >> 172.21.15.5:0/2480091986 conn(0x7f30800c17c0 msgr2=0x7f30800c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.375+0000 7f3086f14640 1 -- 172.21.15.5:0/2480091986 shutdown_connections 2024-05-16T21:32:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.375+0000 7f3086f14640 1 -- 172.21.15.5:0/2480091986 wait complete. 2024-05-16T21:32:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.376+0000 7f3086f14640 1 Processor -- start 2024-05-16T21:32:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.376+0000 7f3086f14640 1 -- start start 2024-05-16T21:32:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.377+0000 7f3086f14640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30800bf9b0 0x7f30801e4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.377+0000 7f3086f14640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3080148770 0x7f308006de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.377+0000 7f3086f14640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f308014e360 0x7f3080071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.377+0000 7f3086f14640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3080158cc0 con 0x7f3080148770 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.377+0000 7f3086f14640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f30800c0300 con 0x7f30800bf9b0 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.377+0000 7f3086f14640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3080158e40 con 0x7f308014e360 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.377+0000 7f307ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3080148770 0x7f308006de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3080148770 0x7f308006de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53108/0 (socket says 172.21.15.5:53108) 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307ffff640 1 -- 172.21.15.5:0/3385240243 learned_addr learned my addr 172.21.15.5:0/3385240243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f3084cb0640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30800bf9b0 0x7f30801e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f30854b1640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f308014e360 0x7f3080071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307ffff640 1 -- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f308014e360 msgr2=0x7f3080071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307ffff640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f308014e360 0x7f3080071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307ffff640 1 -- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30800bf9b0 msgr2=0x7f30801e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307ffff640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30800bf9b0 0x7f30801e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307ffff640 1 -- 172.21.15.5:0/3385240243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30801434f0 con 0x7f3080148770 2024-05-16T21:32:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307ffff640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3080148770 0x7f308006de10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f307000c760 tx=0x7f307000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307d7fa640 1 -- 172.21.15.5:0/3385240243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070003b70 con 0x7f3080148770 2024-05-16T21:32:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307d7fa640 1 -- 172.21.15.5:0/3385240243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3070003d30 con 0x7f3080148770 2024-05-16T21:32:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3080143950 con 0x7f3080148770 2024-05-16T21:32:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f307d7fa640 1 -- 172.21.15.5:0/3385240243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307000aa90 con 0x7f3080148770 2024-05-16T21:32:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.378+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3080142700 con 0x7f3080148770 2024-05-16T21:32:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.379+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3080143740 con 0x7f3080148770 2024-05-16T21:32:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.380+0000 7f307d7fa640 1 -- 172.21.15.5:0/3385240243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f307000ac30 con 0x7f3080148770 2024-05-16T21:32:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.380+0000 7f307d7fa640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3060076300 0x7f3060078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.380+0000 7f307d7fa640 1 -- 172.21.15.5:0/3385240243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3070097480 con 0x7f3080148770 2024-05-16T21:32:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.380+0000 7f3084cb0640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3060076300 0x7f3060078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.381+0000 7f3084cb0640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3060076300 0x7f3060078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3078034000 tx=0x7f307802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.385+0000 7f307d7fa640 1 -- 172.21.15.5:0/3385240243 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30800c1390 con 0x7f3080148770 2024-05-16T21:32:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.575+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3080050940 con 0x7f3080148770 2024-05-16T21:32:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.576+0000 7f307d7fa640 1 -- 172.21.15.5:0/3385240243 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3070060660 con 0x7f3080148770 2024-05-16T21:32:39.579 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-05-16T21:32:39.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.577+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3060076300 msgr2=0x7f3060078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.577+0000 7f3086f14640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3060076300 0x7f3060078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3078034000 tx=0x7f307802e000 comp rx=0 tx=0).stop 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.577+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3080148770 msgr2=0x7f308006de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.577+0000 7f3086f14640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3080148770 0x7f308006de10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f307000c760 tx=0x7f307000cc20 comp rx=0 tx=0).stop 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.578+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 shutdown_connections 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.578+0000 7f3086f14640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3060076300 0x7f3060078810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.578+0000 7f3086f14640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f308014e360 0x7f3080071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.578+0000 7f3086f14640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3080148770 0x7f308006de10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.578+0000 7f3086f14640 1 --2- 172.21.15.5:0/3385240243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30800bf9b0 0x7f30801e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.578+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 >> 172.21.15.5:0/3385240243 conn(0x7f30800c17c0 msgr2=0x7f3080140680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.578+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 shutdown_connections 2024-05-16T21:32:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.578+0000 7f3086f14640 1 -- 172.21.15.5:0/3385240243 wait complete. 2024-05-16T21:32:39.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount' 2024-05-16T21:32:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.700+0000 7fdec2467640 1 Processor -- start 2024-05-16T21:32:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.700+0000 7fdec2467640 1 -- start start 2024-05-16T21:32:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdec2467640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdec2467640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdebc0bf9b0 0x7fdebc0bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdec2467640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdebc0c1390 con 0x7fdebc148770 2024-05-16T21:32:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdec2467640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdebc151e40 con 0x7fdebc0bf9b0 2024-05-16T21:32:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdec2467640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdebc0c0620 con 0x7fdebc14e360 2024-05-16T21:32:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdec0a04640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdebc0bf9b0 0x7fdebc0bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdec0a04640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdebc0bf9b0 0x7fdebc0bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53122/0 (socket says 172.21.15.5:53122) 2024-05-16T21:32:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdec0a04640 1 -- 172.21.15.5:0/2660665463 learned_addr learned my addr 172.21.15.5:0/2660665463 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.701+0000 7fdebbfff640 1 --2- 172.21.15.5:0/2660665463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.702+0000 7fdec0a04640 1 -- 172.21.15.5:0/2660665463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 msgr2=0x7fdebc1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.702+0000 7fdec0a04640 1 --2- 172.21.15.5:0/2660665463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.702+0000 7fdec0a04640 1 -- 172.21.15.5:0/2660665463 >> v1:172.21.15.157:6789/0 conn(0x7fdebc148770 legacy=0x7fdebc0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.702+0000 7fdec0a04640 1 -- 172.21.15.5:0/2660665463 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc151ad0 con 0x7fdebc0bf9b0 2024-05-16T21:32:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.702+0000 7fdec0a04640 1 --2- 172.21.15.5:0/2660665463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc0bf9b0 0x7fdebc0bfdc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009e80 tx=0x7fdeb402a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e25b64fe35d084 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.702+0000 7fdebaffd640 1 -- 172.21.15.5:0/2660665463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4036070 con 0x7fdebc0bf9b0 2024-05-16T21:32:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdebaffd640 1 -- 172.21.15.5:0/2660665463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb4031600 con 0x7fdebc0bf9b0 2024-05-16T21:32:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdebaffd640 1 -- 172.21.15.5:0/2660665463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40319d0 con 0x7fdebc0bf9b0 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdec2467640 1 -- 172.21.15.5:0/2660665463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc0bf9b0 msgr2=0x7fdebc0bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdec2467640 1 --2- 172.21.15.5:0/2660665463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc0bf9b0 0x7fdebc0bfdc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009e80 tx=0x7fdeb402a7f0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdec2467640 1 -- 172.21.15.5:0/2660665463 shutdown_connections 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdec2467640 1 --2- 172.21.15.5:0/2660665463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc0bf9b0 0x7fdebc0bfdc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdec2467640 1 --2- 172.21.15.5:0/2660665463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdec2467640 1 -- 172.21.15.5:0/2660665463 >> 172.21.15.5:0/2660665463 conn(0x7fdebc0c17c0 msgr2=0x7fdebc0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdec2467640 1 -- 172.21.15.5:0/2660665463 shutdown_connections 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.703+0000 7fdec2467640 1 -- 172.21.15.5:0/2660665463 wait complete. 2024-05-16T21:32:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.705+0000 7fdec2467640 1 Processor -- start 2024-05-16T21:32:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.705+0000 7fdec2467640 1 -- start start 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdec2467640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdebc0bf9b0 0x7fdebc143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdec2467640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc148770 0x7fdebc0b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdec2467640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdec2467640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc158cc0 con 0x7fdebc148770 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdec2467640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc0c0300 con 0x7fdebc0bf9b0 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdec2467640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdebc158e40 con 0x7fdebc14e360 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdebb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc148770 0x7fdebc0b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdebb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc148770 0x7fdebc0b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53130/0 (socket says 172.21.15.5:53130) 2024-05-16T21:32:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdebb7fe640 1 -- 172.21.15.5:0/2435407536 learned_addr learned my addr 172.21.15.5:0/2435407536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdebbfff640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdebc0bf9b0 0x7fdebc143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.706+0000 7fdec0a04640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdebb7fe640 1 -- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 msgr2=0x7fdebc06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdebb7fe640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc06ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdebb7fe640 1 -- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdebc0bf9b0 msgr2=0x7fdebc143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdebb7fe640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdebc0bf9b0 0x7fdebc143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdebb7fe640 1 -- 172.21.15.5:0/2435407536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc06ef60 con 0x7fdebc148770 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdebbfff640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdebc0bf9b0 0x7fdebc143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdec0a04640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc06ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdebb7fe640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc148770 0x7fdebc0b7780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0741b0 tx=0x7fdeac00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdeb8ff9640 1 -- 172.21.15.5:0/2435407536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac017070 con 0x7fdebc148770 2024-05-16T21:32:39.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdeb8ff9640 1 -- 172.21.15.5:0/2435407536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeac0052d0 con 0x7fdebc148770 2024-05-16T21:32:39.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdeb8ff9640 1 -- 172.21.15.5:0/2435407536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac003830 con 0x7fdebc148770 2024-05-16T21:32:39.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdebc1e7b60 con 0x7fdebc148770 2024-05-16T21:32:39.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.707+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdebc0b6d10 con 0x7fdebc148770 2024-05-16T21:32:39.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.708+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdebc050940 con 0x7fdebc148770 2024-05-16T21:32:39.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.709+0000 7fdeb8ff9640 1 -- 172.21.15.5:0/2435407536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdeac01a070 con 0x7fdebc148770 2024-05-16T21:32:39.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.709+0000 7fdeb8ff9640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fde9c076300 0x7fde9c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:39.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.709+0000 7fdeb8ff9640 1 -- 172.21.15.5:0/2435407536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdeac096610 con 0x7fdebc148770 2024-05-16T21:32:39.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.709+0000 7fdebbfff640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fde9c076300 0x7fde9c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:39.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.710+0000 7fdebbfff640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fde9c076300 0x7fde9c078810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009af0 tx=0x7fdea4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:39.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.714+0000 7fdeb8ff9640 1 -- 172.21.15.5:0/2435407536 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdebc0c1390 con 0x7fdebc148770 2024-05-16T21:32:39.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:39.979+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]} v 0) -- 0x7fdebc0bf790 con 0x7fdebc148770 2024-05-16T21:32:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.014+0000 7fdeb8ff9640 1 -- 172.21.15.5:0/2435407536 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]}]=0 v41) ==== 144+0+0 (secure 0 0 0) 0x7fdeac05f9b0 con 0x7fdebc148770 2024-05-16T21:32:40.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fde9c076300 msgr2=0x7fde9c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fde9c076300 0x7fde9c078810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009af0 tx=0x7fdea4008040 comp rx=0 tx=0).stop 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc148770 msgr2=0x7fdebc0b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc148770 0x7fdebc0b7780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0741b0 tx=0x7fdeac00c820 comp rx=0 tx=0).stop 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 shutdown_connections 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fde9c076300 0x7fde9c078810 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdebc14e360 0x7fdebc06ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc148770 0x7fdebc0b7780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 --2- 172.21.15.5:0/2435407536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdebc0bf9b0 0x7fdebc143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 >> 172.21.15.5:0/2435407536 conn(0x7fdebc0c17c0 msgr2=0x7fdebc140710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 shutdown_connections 2024-05-16T21:32:40.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.016+0000 7fdec2467640 1 -- 172.21.15.5:0/2435407536 wait complete. 2024-05-16T21:32:40.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-16T21:32:40.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.142+0000 7fc1f4669640 1 Processor -- start 2024-05-16T21:32:40.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.142+0000 7fc1f4669640 1 -- start start 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f4669640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1ec14ed70 0x7fc1ec159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f4669640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec0ba800 con 0x7fc1ec148910 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f4669640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec0b8a30 con 0x7fc1ec0a9060 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f4669640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc1ec0b8d10 con 0x7fc1ec14ed70 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f2c06640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1ec14ed70 0x7fc1ec159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f2c06640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1ec14ed70 0x7fc1ec159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53140/0 (socket says 172.21.15.5:53140) 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f2c06640 1 -- 172.21.15.5:0/4136699254 learned_addr learned my addr 172.21.15.5:0/4136699254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f2c06640 1 -- 172.21.15.5:0/4136699254 >> v1:172.21.15.157:6789/0 conn(0x7fc1ec0a9060 legacy=0x7fc1ec0ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f2c06640 1 -- 172.21.15.5:0/4136699254 >> v1:172.21.15.5:6789/0 conn(0x7fc1ec148910 legacy=0x7fc1ec14e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.144+0000 7fc1f2c06640 1 -- 172.21.15.5:0/4136699254 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec0b8ff0 con 0x7fc1ec14ed70 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.145+0000 7fc1f2c06640 1 --2- 172.21.15.5:0/4136699254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec14ed70 0x7fc1ec159dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009e50 tx=0x7fc1dc02a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbd85f9ca590dfe server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.145+0000 7fc1f1403640 1 -- 172.21.15.5:0/4136699254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc037070 con 0x7fc1ec14ed70 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.145+0000 7fc1f1403640 1 -- 172.21.15.5:0/4136699254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1dc032630 con 0x7fc1ec14ed70 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.145+0000 7fc1f1403640 1 -- 172.21.15.5:0/4136699254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc02e050 con 0x7fc1ec14ed70 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.146+0000 7fc1f4669640 1 -- 172.21.15.5:0/4136699254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec14ed70 msgr2=0x7fc1ec159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.146+0000 7fc1f4669640 1 --2- 172.21.15.5:0/4136699254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec14ed70 0x7fc1ec159dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009e50 tx=0x7fc1dc02a840 comp rx=0 tx=0).stop 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.146+0000 7fc1f4669640 1 -- 172.21.15.5:0/4136699254 shutdown_connections 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.146+0000 7fc1f4669640 1 --2- 172.21.15.5:0/4136699254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec14ed70 0x7fc1ec159dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.146+0000 7fc1f4669640 1 -- 172.21.15.5:0/4136699254 >> 172.21.15.5:0/4136699254 conn(0x7fc1ec0c07c0 msgr2=0x7fc1ec0c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.146+0000 7fc1f4669640 1 -- 172.21.15.5:0/4136699254 shutdown_connections 2024-05-16T21:32:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.146+0000 7fc1f4669640 1 -- 172.21.15.5:0/4136699254 wait complete. 2024-05-16T21:32:40.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.147+0000 7fc1f4669640 1 Processor -- start 2024-05-16T21:32:40.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.147+0000 7fc1f4669640 1 -- start start 2024-05-16T21:32:40.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f4669640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec0a9060 0x7fc1ec1d95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f4669640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1ec148910 0x7fc1ec0c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f4669640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1ec14ed70 0x7fc1ec149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f4669640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec08d580 con 0x7fc1ec0a9060 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f4669640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec08d400 con 0x7fc1ec148910 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f4669640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec08da30 con 0x7fc1ec14ed70 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec0a9060 0x7fc1ec1d95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec0a9060 0x7fc1ec1d95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53148/0 (socket says 172.21.15.5:53148) 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 -- 172.21.15.5:0/355095992 learned_addr learned my addr 172.21.15.5:0/355095992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f1c04640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1ec148910 0x7fc1ec0c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2c06640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1ec14ed70 0x7fc1ec149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 -- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1ec14ed70 msgr2=0x7fc1ec149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1ec14ed70 0x7fc1ec149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 -- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1ec148910 msgr2=0x7fc1ec0c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1ec148910 0x7fc1ec0c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 -- 172.21.15.5:0/355095992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec0c2790 con 0x7fc1ec0a9060 2024-05-16T21:32:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f2405640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec0a9060 0x7fc1ec1d95d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400c430 tx=0x7fc1e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1eaffd640 1 -- 172.21.15.5:0/355095992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4017070 con 0x7fc1ec0a9060 2024-05-16T21:32:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1eaffd640 1 -- 172.21.15.5:0/355095992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e40052d0 con 0x7fc1ec0a9060 2024-05-16T21:32:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec1494c0 con 0x7fc1ec0a9060 2024-05-16T21:32:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.149+0000 7fc1eaffd640 1 -- 172.21.15.5:0/355095992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4003830 con 0x7fc1ec0a9060 2024-05-16T21:32:40.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.150+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec14a040 con 0x7fc1ec0a9060 2024-05-16T21:32:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.151+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ec0ba9e0 con 0x7fc1ec0a9060 2024-05-16T21:32:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.151+0000 7fc1eaffd640 1 -- 172.21.15.5:0/355095992 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc1e401a070 con 0x7fc1ec0a9060 2024-05-16T21:32:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.152+0000 7fc1eaffd640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1d80762d0 0x7fc1d80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.152+0000 7fc1eaffd640 1 -- 172.21.15.5:0/355095992 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc1e40969b0 con 0x7fc1ec0a9060 2024-05-16T21:32:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.152+0000 7fc1f1c04640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1d80762d0 0x7fc1d80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.152+0000 7fc1f1c04640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1d80762d0 0x7fc1d80787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec1e1e80 tx=0x7fc1e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.156+0000 7fc1eaffd640 1 -- 172.21.15.5:0/355095992 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc1e4060300 con 0x7fc1ec0a9060 2024-05-16T21:32:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.348+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc1ec050940 con 0x7fc1ec0a9060 2024-05-16T21:32:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.351+0000 7fc1eaffd640 1 -- 172.21.15.5:0/355095992 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fc1e40682f0 con 0x7fc1ec0a9060 2024-05-16T21:32:40.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1d80762d0 msgr2=0x7fc1d80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1d80762d0 0x7fc1d80787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec1e1e80 tx=0x7fc1e0009040 comp rx=0 tx=0).stop 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec0a9060 msgr2=0x7fc1ec1d95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec0a9060 0x7fc1ec1d95d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400c430 tx=0x7fc1e400c8f0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 shutdown_connections 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc1d80762d0 0x7fc1d80787e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1ec14ed70 0x7fc1ec149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1ec148910 0x7fc1ec0c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 --2- 172.21.15.5:0/355095992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ec0a9060 0x7fc1ec1d95d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 >> 172.21.15.5:0/355095992 conn(0x7fc1ec0c07c0 msgr2=0x7fc1ec0ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 shutdown_connections 2024-05-16T21:32:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:40.353+0000 7fc1f4669640 1 -- 172.21.15.5:0/355095992 wait complete. 2024-05-16T21:32:40.367 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-16T21:32:40.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:32:40.430 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:32:40.629 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:32:40.746 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-16T21:32:40.746 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:32:40.746 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:32:40.794 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:32:40.794 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:32:40.887 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:32:40.887 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:32:40.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-16T21:32:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.060+0000 7f527e20c640 1 Processor -- start 2024-05-16T21:32:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.060+0000 7f527e20c640 1 -- start start 2024-05-16T21:32:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f527e20c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5278151fc0 0x7f52780bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f527e20c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f527806da30 0x7f52780be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f527e20c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52780c36f0 con 0x7f527806de40 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f527e20c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f52780bdc10 con 0x7f5278151fc0 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f527e20c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5278152530 con 0x7f527806da30 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f52777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5278151fc0 0x7f52780bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f52777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5278151fc0 0x7f52780bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53154/0 (socket says 172.21.15.5:53154) 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f52777fe640 1 -- 172.21.15.5:0/817348859 learned_addr learned my addr 172.21.15.5:0/817348859 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f5276ffd640 1 --2- 172.21.15.5:0/817348859 >> v2:172.21.15.157:3300/0 conn(0x7f527806da30 0x7f52780be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f52777fe640 1 -- 172.21.15.5:0/817348859 >> v2:172.21.15.157:3300/0 conn(0x7f527806da30 msgr2=0x7f52780be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f52777fe640 1 --2- 172.21.15.5:0/817348859 >> v2:172.21.15.157:3300/0 conn(0x7f527806da30 0x7f52780be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.061+0000 7f52777fe640 1 -- 172.21.15.5:0/817348859 >> v1:172.21.15.157:6789/0 conn(0x7f527806de40 legacy=0x7f527814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.062+0000 7f52777fe640 1 -- 172.21.15.5:0/817348859 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5278152810 con 0x7f5278151fc0 2024-05-16T21:32:41.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.062+0000 7f52777fe640 1 --2- 172.21.15.5:0/817348859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5278151fc0 0x7f52780bd6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52780c3290 tx=0x7f526802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fb620e65d9890f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.062+0000 7f52767fc640 1 -- 172.21.15.5:0/817348859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268037070 con 0x7f5278151fc0 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f52767fc640 1 -- 172.21.15.5:0/817348859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5268032440 con 0x7f5278151fc0 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f52767fc640 1 -- 172.21.15.5:0/817348859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268032810 con 0x7f5278151fc0 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f527e20c640 1 -- 172.21.15.5:0/817348859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5278151fc0 msgr2=0x7f52780bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f527e20c640 1 --2- 172.21.15.5:0/817348859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5278151fc0 0x7f52780bd6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52780c3290 tx=0x7f526802a200 comp rx=0 tx=0).stop 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f527e20c640 1 -- 172.21.15.5:0/817348859 shutdown_connections 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f527e20c640 1 --2- 172.21.15.5:0/817348859 >> v2:172.21.15.157:3300/0 conn(0x7f527806da30 0x7f52780be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f527e20c640 1 --2- 172.21.15.5:0/817348859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5278151fc0 0x7f52780bd6d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f527e20c640 1 -- 172.21.15.5:0/817348859 >> 172.21.15.5:0/817348859 conn(0x7f52780c3d20 msgr2=0x7f52780c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f527e20c640 1 -- 172.21.15.5:0/817348859 shutdown_connections 2024-05-16T21:32:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.063+0000 7f527e20c640 1 -- 172.21.15.5:0/817348859 wait complete. 2024-05-16T21:32:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.065+0000 7f527e20c640 1 Processor -- start 2024-05-16T21:32:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.065+0000 7f527e20c640 1 -- start start 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f527e20c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f527806da30 0x7f527814c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f527e20c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527806de40 0x7f52780b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f527e20c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5278151fc0 0x7f527814b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f527e20c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f52780a3050 con 0x7f527806de40 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f527e20c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f52780a2ed0 con 0x7f5278151fc0 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f527e20c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f52780bee80 con 0x7f527806da30 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5276ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527806de40 0x7f52780b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5276ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527806de40 0x7f52780b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53164/0 (socket says 172.21.15.5:53164) 2024-05-16T21:32:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5276ffd640 1 -- 172.21.15.5:0/1323618631 learned_addr learned my addr 172.21.15.5:0/1323618631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f52777fe640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f527806da30 0x7f527814c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5276ffd640 1 -- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f527806da30 msgr2=0x7f527814c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5276ffd640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f527806da30 0x7f527814c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5277fff640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5278151fc0 0x7f527814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5276ffd640 1 -- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5278151fc0 msgr2=0x7f527814b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5276ffd640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5278151fc0 0x7f527814b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.066+0000 7f5276ffd640 1 -- 172.21.15.5:0/1323618631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527814c9d0 con 0x7f527806de40 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.067+0000 7f5276ffd640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527806de40 0x7f52780b7610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f526c00d600 tx=0x7f526c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.067+0000 7f525ffff640 1 -- 172.21.15.5:0/1323618631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0125f0 con 0x7f527806de40 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.067+0000 7f525ffff640 1 -- 172.21.15.5:0/1323618631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c019070 con 0x7f527806de40 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.067+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527814df60 con 0x7f527806de40 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.067+0000 7f525ffff640 1 -- 172.21.15.5:0/1323618631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0129b0 con 0x7f527806de40 2024-05-16T21:32:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.067+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52780b85d0 con 0x7f527806de40 2024-05-16T21:32:41.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.068+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5278050940 con 0x7f527806de40 2024-05-16T21:32:41.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.069+0000 7f525ffff640 1 -- 172.21.15.5:0/1323618631 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f526c012b50 con 0x7f527806de40 2024-05-16T21:32:41.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.069+0000 7f525ffff640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f52640762d0 0x7f52640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.069+0000 7f525ffff640 1 -- 172.21.15.5:0/1323618631 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f526c097a80 con 0x7f527806de40 2024-05-16T21:32:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.070+0000 7f52777fe640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f52640762d0 0x7f52640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.070+0000 7f52777fe640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f52640762d0 0x7f52640787e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5268034000 tx=0x7f526802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.074+0000 7f525ffff640 1 -- 172.21.15.5:0/1323618631 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f526c061360 con 0x7f527806de40 2024-05-16T21:32:41.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.280+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f527806eb40 con 0x7f527806de40 2024-05-16T21:32:41.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.280+0000 7f525ffff640 1 -- 172.21.15.5:0/1323618631 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f526c060c60 con 0x7f527806de40 2024-05-16T21:32:41.283 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-05-16T21:32:41.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f52640762d0 msgr2=0x7f52640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f52640762d0 0x7f52640787e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5268034000 tx=0x7f526802e000 comp rx=0 tx=0).stop 2024-05-16T21:32:41.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527806de40 msgr2=0x7f52780b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527806de40 0x7f52780b7610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f526c00d600 tx=0x7f526c00dac0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 shutdown_connections 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f52640762d0 0x7f52640787e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5278151fc0 0x7f527814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527806de40 0x7f52780b7610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 --2- 172.21.15.5:0/1323618631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f527806da30 0x7f527814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 >> 172.21.15.5:0/1323618631 conn(0x7f52780c3d20 msgr2=0x7f52780bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.282+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 shutdown_connections 2024-05-16T21:32:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.283+0000 7f527e20c640 1 -- 172.21.15.5:0/1323618631 wait complete. 2024-05-16T21:32:41.297 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-16T21:32:41.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:41.297 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-16T21:32:41.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-05-16T21:32:41.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:32:41.391 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-16T21:32:41.449 INFO:tasks.cephfs.cephfs_test_case:[] 2024-05-16T21:32:41.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.558+0000 7f41f8496640 1 Processor -- start 2024-05-16T21:32:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.558+0000 7f41f8496640 1 -- start start 2024-05-16T21:32:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.559+0000 7f41f8496640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41f014e440 0x7f41f00b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.559+0000 7f41f8496640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f00b8a20 0x7f41f00b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.559+0000 7f41f8496640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00ba950 con 0x7f41f00bd770 2024-05-16T21:32:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.559+0000 7f41f8496640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f41f014e9b0 con 0x7f41f014e440 2024-05-16T21:32:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.559+0000 7f41f8496640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f41f014ec90 con 0x7f41f00b8a20 2024-05-16T21:32:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f6232640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41f014e440 0x7f41f00b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f6a33640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f00b8a20 0x7f41f00b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f6232640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41f014e440 0x7f41f00b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:49396/0 (socket says 172.21.15.5:49396) 2024-05-16T21:32:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f6232640 1 -- 172.21.15.5:0/1531286666 learned_addr learned my addr 172.21.15.5:0/1531286666 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f5a31640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f41f00bd770 0x7f41f00ba240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:39570/0 (socket says 172.21.15.5:39570) 2024-05-16T21:32:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f6232640 1 -- 172.21.15.5:0/1531286666 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f00b8a20 msgr2=0x7f41f00b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f6232640 1 --2- 172.21.15.5:0/1531286666 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f00b8a20 0x7f41f00b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f6232640 1 -- 172.21.15.5:0/1531286666 >> v1:172.21.15.157:6789/0 conn(0x7f41f00bd770 legacy=0x7f41f00ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.560+0000 7f41f6232640 1 -- 172.21.15.5:0/1531286666 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f014ef70 con 0x7f41f014e440 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.561+0000 7f41f6232640 1 --2- 172.21.15.5:0/1531286666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f014e440 0x7f41f00b99c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009870 tx=0x7f41e802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2afc9da3b1b2b6c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.561+0000 7f41f5230640 1 -- 172.21.15.5:0/1531286666 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8037070 con 0x7f41f014e440 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.561+0000 7f41f5230640 1 -- 172.21.15.5:0/1531286666 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e802ae50 con 0x7f41f014e440 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.561+0000 7f41f5230640 1 -- 172.21.15.5:0/1531286666 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8032860 con 0x7f41f014e440 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.562+0000 7f41f8496640 1 -- 172.21.15.5:0/1531286666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f014e440 msgr2=0x7f41f00b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.562+0000 7f41f8496640 1 --2- 172.21.15.5:0/1531286666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f014e440 0x7f41f00b99c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009870 tx=0x7f41e802a300 comp rx=0 tx=0).stop 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.562+0000 7f41f8496640 1 -- 172.21.15.5:0/1531286666 shutdown_connections 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.562+0000 7f41f8496640 1 --2- 172.21.15.5:0/1531286666 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f00b8a20 0x7f41f00b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.562+0000 7f41f8496640 1 --2- 172.21.15.5:0/1531286666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f014e440 0x7f41f00b99c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.562+0000 7f41f8496640 1 -- 172.21.15.5:0/1531286666 >> 172.21.15.5:0/1531286666 conn(0x7f41f00c0390 msgr2=0x7f41f00c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.562+0000 7f41f8496640 1 -- 172.21.15.5:0/1531286666 shutdown_connections 2024-05-16T21:32:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.562+0000 7f41f8496640 1 -- 172.21.15.5:0/1531286666 wait complete. 2024-05-16T21:32:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.564+0000 7f41f8496640 1 Processor -- start 2024-05-16T21:32:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.564+0000 7f41f8496640 1 -- start start 2024-05-16T21:32:41.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f8496640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b8a20 0x7f41f0146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f8496640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f00bd770 0x7f41f01d5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f8496640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f014e440 0x7f41f0141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f8496640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f41f008d720 con 0x7f41f00b8a20 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f8496640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f41f00b9370 con 0x7f41f00bd770 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f8496640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f41f00bdb80 con 0x7f41f014e440 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b8a20 0x7f41f0146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b8a20 0x7f41f0146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53174/0 (socket says 172.21.15.5:53174) 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 -- 172.21.15.5:0/267743086 learned_addr learned my addr 172.21.15.5:0/267743086 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f5a31640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f00bd770 0x7f41f01d5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6a33640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f014e440 0x7f41f0141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 -- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f014e440 msgr2=0x7f41f0141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f014e440 0x7f41f0141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 -- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f00bd770 msgr2=0x7f41f01d5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f00bd770 0x7f41f01d5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 -- 172.21.15.5:0/267743086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f01d44a0 con 0x7f41f00b8a20 2024-05-16T21:32:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f6232640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b8a20 0x7f41f0146d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41e8000c00 tx=0x7f41e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41eeffd640 1 -- 172.21.15.5:0/267743086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8041070 con 0x7f41f00b8a20 2024-05-16T21:32:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41eeffd640 1 -- 172.21.15.5:0/267743086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e803c660 con 0x7f41f00b8a20 2024-05-16T21:32:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f01d4df0 con 0x7f41f00b8a20 2024-05-16T21:32:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41eeffd640 1 -- 172.21.15.5:0/267743086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8037040 con 0x7f41f00b8a20 2024-05-16T21:32:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.566+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f01e4840 con 0x7f41f00b8a20 2024-05-16T21:32:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.567+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f01e4370 con 0x7f41f00b8a20 2024-05-16T21:32:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.567+0000 7f41eeffd640 1 -- 172.21.15.5:0/267743086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f41e8044070 con 0x7f41f00b8a20 2024-05-16T21:32:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.568+0000 7f41eeffd640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f41dc076300 0x7f41dc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.568+0000 7f41eeffd640 1 -- 172.21.15.5:0/267743086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f41e80b7c60 con 0x7f41f00b8a20 2024-05-16T21:32:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.568+0000 7f41f5a31640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f41dc076300 0x7f41dc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.568+0000 7f41f5a31640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f41dc076300 0x7f41dc078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f41f014bc10 tx=0x7f41e4007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.573+0000 7f41eeffd640 1 -- 172.21.15.5:0/267743086 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f41e8081530 con 0x7f41f00b8a20 2024-05-16T21:32:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.798+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41f0050940 con 0x7f41f00b8a20 2024-05-16T21:32:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.799+0000 7f41eeffd640 1 -- 172.21.15.5:0/267743086 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4342 (secure 0 0 0) 0x7f41e8080e30 con 0x7f41f00b8a20 2024-05-16T21:32:41.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:41.802 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:21.341129+0000","modified":"2024-05-16T21:32:24.356428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-16T21:32:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-05-16T21:32:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.800+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f41dc076300 msgr2=0x7f41dc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.800+0000 7f41f8496640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f41dc076300 0x7f41dc078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f41f014bc10 tx=0x7f41e4007ca0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b8a20 msgr2=0x7f41f0146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b8a20 0x7f41f0146d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41e8000c00 tx=0x7f41e80046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 shutdown_connections 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f41dc076300 0x7f41dc078810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41f014e440 0x7f41f0141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41f00bd770 0x7f41f01d5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 --2- 172.21.15.5:0/267743086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b8a20 0x7f41f0146d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 >> 172.21.15.5:0/267743086 conn(0x7f41f00c0390 msgr2=0x7f41f00ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 shutdown_connections 2024-05-16T21:32:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.801+0000 7f41f8496640 1 -- 172.21.15.5:0/267743086 wait complete. 2024-05-16T21:32:41.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.924+0000 7fa011e89640 1 Processor -- start 2024-05-16T21:32:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.924+0000 7fa011e89640 1 -- start start 2024-05-16T21:32:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa011e89640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa00c0bd6d0 0x7fa00c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa011e89640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 0x7fa00c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa011e89640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa00c06e140 con 0x7fa00c151fc0 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa011e89640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa00c0c36f0 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa011e89640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c152530 con 0x7fa00c0bee80 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa00c151fc0 0x7fa00c06da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46476/0 (socket says 172.21.15.5:46476) 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00b7fe640 1 -- 172.21.15.5:0/3543121433 learned_addr learned my addr 172.21.15.5:0/3543121433 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00affd640 1 --2- 172.21.15.5:0/3543121433 >> v2:172.21.15.157:3300/0 conn(0x7fa00c0bd6d0 0x7fa00c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00bfff640 1 --2- 172.21.15.5:0/3543121433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 0x7fa00c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00a7fc640 1 -- 172.21.15.5:0/3543121433 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160333908 0 0) 0x7f9ffc001110 con 0x7fa00c151fc0 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00a7fc640 1 -- 172.21.15.5:0/3543121433 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ff4003520 con 0x7fa00c151fc0 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00affd640 1 -- 172.21.15.5:0/3543121433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 msgr2=0x7fa00c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00affd640 1 --2- 172.21.15.5:0/3543121433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 0x7fa00c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00affd640 1 -- 172.21.15.5:0/3543121433 >> v1:172.21.15.5:6789/0 conn(0x7fa00c151fc0 legacy=0x7fa00c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00a7fc640 1 -- 172.21.15.5:0/3543121433 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2898791379 0 0) 0x7f9ff4003520 con 0x7fa00c151fc0 2024-05-16T21:32:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00affd640 1 -- 172.21.15.5:0/3543121433 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c152810 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.925+0000 7fa00affd640 1 --2- 172.21.15.5:0/3543121433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0be940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0000097a0 tx=0x7fa00002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbea58bbbd29aee2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa00a7fc640 1 -- 172.21.15.5:0/3543121433 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000037070 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa00a7fc640 1 -- 172.21.15.5:0/3543121433 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00002aba0 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa00a7fc640 1 -- 172.21.15.5:0/3543121433 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0018c0 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa011e89640 1 -- 172.21.15.5:0/3543121433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c0bd6d0 msgr2=0x7fa00c0be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa011e89640 1 --2- 172.21.15.5:0/3543121433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0be940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0000097a0 tx=0x7fa00002a110 comp rx=0 tx=0).stop 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa011e89640 1 -- 172.21.15.5:0/3543121433 shutdown_connections 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa011e89640 1 --2- 172.21.15.5:0/3543121433 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 0x7fa00c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa011e89640 1 --2- 172.21.15.5:0/3543121433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0be940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa011e89640 1 -- 172.21.15.5:0/3543121433 >> 172.21.15.5:0/3543121433 conn(0x7fa00c0c3d20 msgr2=0x7fa00c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa011e89640 1 -- 172.21.15.5:0/3543121433 shutdown_connections 2024-05-16T21:32:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.926+0000 7fa011e89640 1 -- 172.21.15.5:0/3543121433 wait complete. 2024-05-16T21:32:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.928+0000 7fa011e89640 1 Processor -- start 2024-05-16T21:32:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.928+0000 7fa011e89640 1 -- start start 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa011e89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa011e89640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 0x7fa00c1e7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa011e89640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c151fc0 0x7fa00c0b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa011e89640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c0bdae0 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa011e89640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c0c0070 con 0x7fa00c151fc0 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa011e89640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c0a2ed0 con 0x7fa00c0bee80 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa00b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa00b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0b8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53176/0 (socket says 172.21.15.5:53176) 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.929+0000 7fa00b7fe640 1 -- 172.21.15.5:0/4108673648 learned_addr learned my addr 172.21.15.5:0/4108673648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00bfff640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c151fc0 0x7fa00c0b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00affd640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 0x7fa00c1e7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00b7fe640 1 -- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 msgr2=0x7fa00c1e7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00b7fe640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 0x7fa00c1e7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00b7fe640 1 -- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c151fc0 msgr2=0x7fa00c0b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00b7fe640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c151fc0 0x7fa00c0b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00b7fe640 1 -- 172.21.15.5:0/4108673648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c14eab0 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00bfff640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c151fc0 0x7fa00c0b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa00b7fe640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0b8000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00c490 tx=0x7f9ffc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7f9ff3fff640 1 -- 172.21.15.5:0/4108673648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc005ce0 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7f9ff3fff640 1 -- 172.21.15.5:0/4108673648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc007070 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c0ba270 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7f9ff3fff640 1 -- 172.21.15.5:0/4108673648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc007460 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.930+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c0b9c60 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.931+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00c1e7fd0 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.932+0000 7f9ff3fff640 1 -- 172.21.15.5:0/4108673648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ffc007600 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.932+0000 7f9ff3fff640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9ff80762d0 0x7f9ff80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.932+0000 7f9ff3fff640 1 -- 172.21.15.5:0/4108673648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9ffc097320 con 0x7fa00c0bd6d0 2024-05-16T21:32:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.933+0000 7fa00affd640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9ff80762d0 0x7f9ff80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.933+0000 7fa00affd640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9ff80762d0 0x7f9ff80787e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa000034000 tx=0x7fa00002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:41.937+0000 7f9ff3fff640 1 -- 172.21.15.5:0/4108673648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa00c06e140 con 0x7fa00c0bd6d0 2024-05-16T21:32:42.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.171+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa00c050940 con 0x7fa00c0bd6d0 2024-05-16T21:32:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.171+0000 7f9ff3fff640 1 -- 172.21.15.5:0/4108673648 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4342 (secure 0 0 0) 0x7f9ffc060c80 con 0x7fa00c0bd6d0 2024-05-16T21:32:42.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:42.173 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:21.341129+0000","modified":"2024-05-16T21:32:24.356428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-16T21:32:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-05-16T21:32:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9ff80762d0 msgr2=0x7f9ff80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9ff80762d0 0x7f9ff80787e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa000034000 tx=0x7fa00002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa00c0bd6d0 msgr2=0x7fa00c0b8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0b8000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00c490 tx=0x7f9ffc00c950 comp rx=0 tx=0).stop 2024-05-16T21:32:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 shutdown_connections 2024-05-16T21:32:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9ff80762d0 0x7f9ff80787e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa00c151fc0 0x7fa00c0b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa00c0bee80 0x7fa00c1e7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 --2- 172.21.15.5:0/4108673648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa00c0bd6d0 0x7fa00c0b8000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 >> 172.21.15.5:0/4108673648 conn(0x7fa00c0c3d20 msgr2=0x7fa00c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 shutdown_connections 2024-05-16T21:32:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.173+0000 7fa011e89640 1 -- 172.21.15.5:0/4108673648 wait complete. 2024-05-16T21:32:42.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.295+0000 7f1df01ea640 1 Processor -- start 2024-05-16T21:32:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.295+0000 7f1df01ea640 1 -- start start 2024-05-16T21:32:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1df01ea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1de80bf050 0x7f1de8159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1df01ea640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de806e140 con 0x7f1de8151fc0 2024-05-16T21:32:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1df01ea640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de80c36f0 con 0x7f1de80bd6d0 2024-05-16T21:32:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1df01ea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1de8152530 con 0x7f1de80bf050 2024-05-16T21:32:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1dedf86640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1de8151fc0 0x7f1de806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46482/0 (socket says 172.21.15.5:46482) 2024-05-16T21:32:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1dedf86640 1 -- 172.21.15.5:0/941665827 learned_addr learned my addr 172.21.15.5:0/941665827 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1dee787640 1 --2- 172.21.15.5:0/941665827 >> v2:172.21.15.157:3300/0 conn(0x7f1de80bf050 0x7f1de8159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 608000397 0 0) 0x7f1de4001110 con 0x7f1de8151fc0 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd4003520 con 0x7f1de8151fc0 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741169467 0 0) 0x7f1de80c36f0 con 0x7f1de80bd6d0 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de4001110 con 0x7f1de80bd6d0 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 776151618 0 0) 0x7f1dd4003520 con 0x7f1de8151fc0 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 >> v2:172.21.15.157:3300/0 conn(0x7f1de80bf050 msgr2=0x7f1de8159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 --2- 172.21.15.5:0/941665827 >> v2:172.21.15.157:3300/0 conn(0x7f1de80bf050 0x7f1de8159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 >> v1:172.21.15.157:6789/0 conn(0x7f1de80bd6d0 legacy=0x7f1de80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de8152810 con 0x7f1de8151fc0 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f1de40018e0 con 0x7f1de8151fc0 2024-05-16T21:32:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 >> v1:172.21.15.5:6789/0 conn(0x7f1de8151fc0 legacy=0x7f1de806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd4003c30 0x7f1dd4004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dd4004800 0x7f1dd4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4005280 0x7f1dd400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1de8152530 con 0x7f1dd4003c30 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd400c230 con 0x7f1dd4004800 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd400c430 con 0x7f1dd4005280 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.297+0000 7f1dedf86640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd4003c30 0x7f1dd4004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.298+0000 7f1ded785640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dd4004800 0x7f1dd4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.298+0000 7f1dee787640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4005280 0x7f1dd400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.298+0000 7f1dedf86640 1 -- 172.21.15.5:0/941665827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4005280 msgr2=0x7f1dd400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.298+0000 7f1dedf86640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4005280 0x7f1dd400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.298+0000 7f1dedf86640 1 -- 172.21.15.5:0/941665827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dd4004800 msgr2=0x7f1dd4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.298+0000 7f1dedf86640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dd4004800 0x7f1dd4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.298+0000 7f1dee787640 1 -- 172.21.15.5:0/941665827 reap_dead start 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.298+0000 7f1dedf86640 1 -- 172.21.15.5:0/941665827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd4003520 con 0x7f1dd4003c30 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1dedf86640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd4003c30 0x7f1dd4004080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1de400c490 tx=0x7f1dd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc520110e66a8fd server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4036070 con 0x7f1dd4003c30 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de4005af0 con 0x7f1dd4003c30 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1decf84640 1 -- 172.21.15.5:0/941665827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de400c0e0 con 0x7f1dd4003c30 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1df01ea640 1 -- 172.21.15.5:0/941665827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd4003c30 msgr2=0x7f1dd4004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1df01ea640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd4003c30 0x7f1dd4004080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1de400c490 tx=0x7f1dd4005830 comp rx=0 tx=0).stop 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1df01ea640 1 -- 172.21.15.5:0/941665827 shutdown_connections 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1df01ea640 1 --2- 172.21.15.5:0/941665827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd4003c30 0x7f1dd4004080 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.299+0000 7f1df01ea640 1 -- 172.21.15.5:0/941665827 >> 172.21.15.5:0/941665827 conn(0x7f1de80c3d20 msgr2=0x7f1de80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.300+0000 7f1df01ea640 1 -- 172.21.15.5:0/941665827 shutdown_connections 2024-05-16T21:32:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.300+0000 7f1df01ea640 1 -- 172.21.15.5:0/941665827 wait complete. 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.301+0000 7f1df01ea640 1 Processor -- start 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.301+0000 7f1df01ea640 1 -- start start 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1df01ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4003c30 0x7f1de81e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1df01ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1de80b7fb0 0x7f1de814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1df01ea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1de814e710 0x7f1de81e4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1df01ea640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1de80a2ed0 con 0x7f1de80b7fb0 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1df01ea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1de80bdae0 con 0x7f1de814e710 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1df01ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1de80a3050 con 0x7f1dd4003c30 2024-05-16T21:32:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1ded785640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1de80b7fb0 0x7f1de814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1ded785640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1de80b7fb0 0x7f1de814e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53196/0 (socket says 172.21.15.5:53196) 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1ded785640 1 -- 172.21.15.5:0/2312314813 learned_addr learned my addr 172.21.15.5:0/2312314813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.302+0000 7f1dedf86640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4003c30 0x7f1de81e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1ded785640 1 -- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4003c30 msgr2=0x7f1de81e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1dee787640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1de814e710 0x7f1de81e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1ded785640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4003c30 0x7f1de81e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1ded785640 1 -- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1de814e710 msgr2=0x7f1de81e4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1ded785640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1de814e710 0x7f1de81e4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1ded785640 1 -- 172.21.15.5:0/2312314813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de81e7da0 con 0x7f1de80b7fb0 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1ded785640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1de80b7fb0 0x7f1de814e1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800f7a0 tx=0x7f1dd800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1dde7fc640 1 -- 172.21.15.5:0/2312314813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800fe50 con 0x7f1de80b7fb0 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1dde7fc640 1 -- 172.21.15.5:0/2312314813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd8018070 con 0x7f1de80b7fb0 2024-05-16T21:32:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de80b6a80 con 0x7f1de80b7fb0 2024-05-16T21:32:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1dde7fc640 1 -- 172.21.15.5:0/2312314813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800d730 con 0x7f1de80b7fb0 2024-05-16T21:32:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.303+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de81518e0 con 0x7f1de80b7fb0 2024-05-16T21:32:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.304+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de8050940 con 0x7f1de80b7fb0 2024-05-16T21:32:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.305+0000 7f1dde7fc640 1 -- 172.21.15.5:0/2312314813 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1dd800d8d0 con 0x7f1de80b7fb0 2024-05-16T21:32:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.305+0000 7f1dde7fc640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1dcc0762d0 0x7f1dcc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.305+0000 7f1dde7fc640 1 -- 172.21.15.5:0/2312314813 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1dd8097350 con 0x7f1de80b7fb0 2024-05-16T21:32:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.305+0000 7f1dedf86640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1dcc0762d0 0x7f1dcc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.306+0000 7f1dedf86640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1dcc0762d0 0x7f1dcc0787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1de4033000 tx=0x7f1de402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.310+0000 7f1dde7fc640 1 -- 172.21.15.5:0/2312314813 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1dd8060d40 con 0x7f1de80b7fb0 2024-05-16T21:32:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.502+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1de80b9fd0 con 0x7f1de80b7fb0 2024-05-16T21:32:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.503+0000 7f1dde7fc640 1 -- 172.21.15.5:0/2312314813 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f1dd8060640 con 0x7f1de80b7fb0 2024-05-16T21:32:42.505 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:42.505 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:22.944103+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1dcc0762d0 msgr2=0x7f1dcc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1dcc0762d0 0x7f1dcc0787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1de4033000 tx=0x7f1de402e000 comp rx=0 tx=0).stop 2024-05-16T21:32:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1de80b7fb0 msgr2=0x7f1de814e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1de80b7fb0 0x7f1de814e1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800f7a0 tx=0x7f1dd800fc60 comp rx=0 tx=0).stop 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 shutdown_connections 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1dcc0762d0 0x7f1dcc0787e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1de814e710 0x7f1de81e4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1de80b7fb0 0x7f1de814e1d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 --2- 172.21.15.5:0/2312314813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dd4003c30 0x7f1de81e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.505+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 >> 172.21.15.5:0/2312314813 conn(0x7f1de80c3d20 msgr2=0x7f1de80be840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.506+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 shutdown_connections 2024-05-16T21:32:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.506+0000 7f1df01ea640 1 -- 172.21.15.5:0/2312314813 wait complete. 2024-05-16T21:32:42.519 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-16T21:32:42.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.629+0000 7f6df9c51640 1 Processor -- start 2024-05-16T21:32:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.629+0000 7f6df9c51640 1 -- start start 2024-05-16T21:32:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df9c51640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6df414e360 0x7f6df41522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df9c51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df4148770 0x7f6df40c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df9c51640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6df40bf9b0 0x7f6df40bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df9c51640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6df4151e40 con 0x7f6df40bf9b0 2024-05-16T21:32:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df9c51640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6df40c0620 con 0x7f6df414e360 2024-05-16T21:32:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df9c51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6df4151ad0 con 0x7f6df4148770 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6df40bf9b0 0x7f6df40bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6df40bf9b0 0x7f6df40bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53206/0 (socket says 172.21.15.5:53206) 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df3fff640 1 -- 172.21.15.5:0/1842412448 learned_addr learned my addr 172.21.15.5:0/1842412448 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df3fff640 1 -- 172.21.15.5:0/1842412448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df4148770 msgr2=0x7f6df40c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df3fff640 1 --2- 172.21.15.5:0/1842412448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df4148770 0x7f6df40c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df3fff640 1 -- 172.21.15.5:0/1842412448 >> v2:172.21.15.157:3300/0 conn(0x7f6df414e360 msgr2=0x7f6df41522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df37fe640 1 --2- 172.21.15.5:0/1842412448 >> v2:172.21.15.157:3300/0 conn(0x7f6df414e360 0x7f6df41522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df3fff640 1 --2- 172.21.15.5:0/1842412448 >> v2:172.21.15.157:3300/0 conn(0x7f6df414e360 0x7f6df41522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.630+0000 7f6df3fff640 1 -- 172.21.15.5:0/1842412448 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df4152810 con 0x7f6df40bf9b0 2024-05-16T21:32:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.631+0000 7f6df3fff640 1 --2- 172.21.15.5:0/1842412448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df40bfdc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6df40741b0 tx=0x7f6dec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d60bcfd3ead1c09 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.631+0000 7f6df27fc640 1 -- 172.21.15.5:0/1842412448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec036070 con 0x7f6df40bf9b0 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.631+0000 7f6df27fc640 1 -- 172.21.15.5:0/1842412448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dec031600 con 0x7f6df40bf9b0 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.631+0000 7f6df27fc640 1 -- 172.21.15.5:0/1842412448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0319d0 con 0x7f6df40bf9b0 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 -- 172.21.15.5:0/1842412448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 msgr2=0x7f6df40bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1842412448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df40bfdc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6df40741b0 tx=0x7f6dec02a730 comp rx=0 tx=0).stop 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 -- 172.21.15.5:0/1842412448 shutdown_connections 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1842412448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df40bfdc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1842412448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df4148770 0x7f6df40c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1842412448 >> v2:172.21.15.157:3300/0 conn(0x7f6df414e360 0x7f6df41522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 -- 172.21.15.5:0/1842412448 >> 172.21.15.5:0/1842412448 conn(0x7f6df40c17c0 msgr2=0x7f6df40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 -- 172.21.15.5:0/1842412448 shutdown_connections 2024-05-16T21:32:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.632+0000 7f6df9c51640 1 -- 172.21.15.5:0/1842412448 wait complete. 2024-05-16T21:32:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.634+0000 7f6df9c51640 1 Processor -- start 2024-05-16T21:32:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.634+0000 7f6df9c51640 1 -- start start 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df9c51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df41e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df9c51640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6df4148770 0x7f6df4150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df9c51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df414e360 0x7f6df40a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df9c51640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6df40c1340 con 0x7f6df40bf9b0 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df9c51640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6df40c11c0 con 0x7f6df4148770 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df9c51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6df409fd50 con 0x7f6df414e360 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df41e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df41e4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53216/0 (socket says 172.21.15.5:53216) 2024-05-16T21:32:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df37fe640 1 -- 172.21.15.5:0/1365822269 learned_addr learned my addr 172.21.15.5:0/1365822269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df3fff640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df414e360 0x7f6df40a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df2ffd640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6df4148770 0x7f6df4150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df37fe640 1 -- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df414e360 msgr2=0x7f6df40a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df37fe640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df414e360 0x7f6df40a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df37fe640 1 -- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6df4148770 msgr2=0x7f6df4150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df37fe640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6df4148770 0x7f6df4150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df37fe640 1 -- 172.21.15.5:0/1365822269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df4151400 con 0x7f6df40bf9b0 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.635+0000 7f6df2ffd640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6df4148770 0x7f6df4150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.636+0000 7f6df37fe640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df41e4b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c7f0 tx=0x7f6de400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.636+0000 7f6ddbfff640 1 -- 172.21.15.5:0/1365822269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4015070 con 0x7f6df40bf9b0 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.636+0000 7f6ddbfff640 1 -- 172.21.15.5:0/1365822269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de4004220 con 0x7f6df40bf9b0 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.636+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df41e40f0 con 0x7f6df40bf9b0 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.636+0000 7f6ddbfff640 1 -- 172.21.15.5:0/1365822269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4007620 con 0x7f6df40bf9b0 2024-05-16T21:32:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.636+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df41e4390 con 0x7f6df40bf9b0 2024-05-16T21:32:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.637+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df4050940 con 0x7f6df40bf9b0 2024-05-16T21:32:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.638+0000 7f6ddbfff640 1 -- 172.21.15.5:0/1365822269 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6de40079d0 con 0x7f6df40bf9b0 2024-05-16T21:32:42.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.638+0000 7f6ddbfff640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6de00762d0 0x7f6de00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:42.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.638+0000 7f6ddbfff640 1 -- 172.21.15.5:0/1365822269 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6de4097470 con 0x7f6df40bf9b0 2024-05-16T21:32:42.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.638+0000 7f6df2ffd640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6de00762d0 0x7f6de00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:42.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.639+0000 7f6df2ffd640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6de00762d0 0x7f6de00787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6df406f850 tx=0x7f6de8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:42.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.643+0000 7f6ddbfff640 1 -- 172.21.15.5:0/1365822269 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6de4060810 con 0x7f6df40bf9b0 2024-05-16T21:32:42.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.874+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6df40bf790 con 0x7f6df40bf9b0 2024-05-16T21:32:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.875+0000 7f6ddbfff640 1 -- 172.21.15.5:0/1365822269 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4342 (secure 0 0 0) 0x7f6de4064b10 con 0x7f6df40bf9b0 2024-05-16T21:32:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:42.877 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:21.341129+0000","modified":"2024-05-16T21:32:24.356428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-16T21:32:42.877 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-05-16T21:32:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6de00762d0 msgr2=0x7f6de00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6de00762d0 0x7f6de00787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6df406f850 tx=0x7f6de8008040 comp rx=0 tx=0).stop 2024-05-16T21:32:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 msgr2=0x7f6df41e4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df41e4b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c7f0 tx=0x7f6de400ccb0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 shutdown_connections 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6de00762d0 0x7f6de00787e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6df414e360 0x7f6df40a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6df4148770 0x7f6df4150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 --2- 172.21.15.5:0/1365822269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df40bf9b0 0x7f6df41e4b90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.877+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 >> 172.21.15.5:0/1365822269 conn(0x7f6df40c17c0 msgr2=0x7f6df40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.878+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 shutdown_connections 2024-05-16T21:32:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:42.878+0000 7f6df9c51640 1 -- 172.21.15.5:0/1365822269 wait complete. 2024-05-16T21:32:42.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:43.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.000+0000 7fee0f9c7640 1 Processor -- start 2024-05-16T21:32:43.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.000+0000 7fee0f9c7640 1 -- start start 2024-05-16T21:32:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0f9c7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee08151fc0 0x7fee080bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0f9c7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee080bf050 0x7fee08158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0f9c7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee080c36f0 con 0x7fee0806da30 2024-05-16T21:32:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0f9c7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fee080bdc10 con 0x7fee08151fc0 2024-05-16T21:32:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0f9c7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fee08152530 con 0x7fee080bf050 2024-05-16T21:32:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0d763640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee08151fc0 0x7fee080bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0d763640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee08151fc0 0x7fee080bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53224/0 (socket says 172.21.15.5:53224) 2024-05-16T21:32:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0d763640 1 -- 172.21.15.5:0/688954216 learned_addr learned my addr 172.21.15.5:0/688954216 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0df64640 1 --2- 172.21.15.5:0/688954216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee080bf050 0x7fee08158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0d763640 1 -- 172.21.15.5:0/688954216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee080bf050 msgr2=0x7fee08158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0d763640 1 --2- 172.21.15.5:0/688954216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee080bf050 0x7fee08158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0d763640 1 -- 172.21.15.5:0/688954216 >> v1:172.21.15.157:6789/0 conn(0x7fee0806da30 legacy=0x7fee080be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.001+0000 7fee0d763640 1 -- 172.21.15.5:0/688954216 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee08152810 con 0x7fee08151fc0 2024-05-16T21:32:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.002+0000 7fee0d763640 1 --2- 172.21.15.5:0/688954216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee08151fc0 0x7fee080bd6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee0402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8c91d3a343bf66 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.002+0000 7fedfffff640 1 -- 172.21.15.5:0/688954216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04037070 con 0x7fee08151fc0 2024-05-16T21:32:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.002+0000 7fedfffff640 1 -- 172.21.15.5:0/688954216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04032440 con 0x7fee08151fc0 2024-05-16T21:32:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.002+0000 7fedfffff640 1 -- 172.21.15.5:0/688954216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04032810 con 0x7fee08151fc0 2024-05-16T21:32:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.003+0000 7fee0f9c7640 1 -- 172.21.15.5:0/688954216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee08151fc0 msgr2=0x7fee080bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.003+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/688954216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee08151fc0 0x7fee080bd6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee0402a1c0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.003+0000 7fee0f9c7640 1 -- 172.21.15.5:0/688954216 shutdown_connections 2024-05-16T21:32:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.003+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/688954216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee080bf050 0x7fee08158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.003+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/688954216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee08151fc0 0x7fee080bd6d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.003+0000 7fee0f9c7640 1 -- 172.21.15.5:0/688954216 >> 172.21.15.5:0/688954216 conn(0x7fee080c3d20 msgr2=0x7fee080c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.003+0000 7fee0f9c7640 1 -- 172.21.15.5:0/688954216 shutdown_connections 2024-05-16T21:32:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.003+0000 7fee0f9c7640 1 -- 172.21.15.5:0/688954216 wait complete. 2024-05-16T21:32:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.005+0000 7fee0f9c7640 1 Processor -- start 2024-05-16T21:32:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.005+0000 7fee0f9c7640 1 -- start start 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0f9c7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0806da30 0x7fee080a2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0f9c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee080bf050 0x7fee080b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0f9c7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee08151fc0 0x7fee0814b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0f9c7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee080a3050 con 0x7fee080bf050 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0f9c7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fee080a2ed0 con 0x7fee08151fc0 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0f9c7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fee0806de40 con 0x7fee0806da30 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0cf62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee080bf050 0x7fee080b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0cf62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee080bf050 0x7fee080b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53232/0 (socket says 172.21.15.5:53232) 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0cf62640 1 -- 172.21.15.5:0/3393625266 learned_addr learned my addr 172.21.15.5:0/3393625266 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0df64640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee08151fc0 0x7fee0814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0d763640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0806da30 0x7fee080a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0cf62640 1 -- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0806da30 msgr2=0x7fee080a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0cf62640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0806da30 0x7fee080a2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0cf62640 1 -- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee08151fc0 msgr2=0x7fee0814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0cf62640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee08151fc0 0x7fee0814b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.006+0000 7fee0cf62640 1 -- 172.21.15.5:0/3393625266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee080b8b80 con 0x7fee080bf050 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.007+0000 7fee0cf62640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee080bf050 0x7fee080b8640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fedf800c340 tx=0x7fedf800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.007+0000 7fedfdffb640 1 -- 172.21.15.5:0/3393625266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8017070 con 0x7fee080bf050 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.007+0000 7fedfdffb640 1 -- 172.21.15.5:0/3393625266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf80052d0 con 0x7fee080bf050 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.007+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0814f1c0 con 0x7fee080bf050 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.007+0000 7fedfdffb640 1 -- 172.21.15.5:0/3393625266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8003810 con 0x7fee080bf050 2024-05-16T21:32:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.007+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee080ba410 con 0x7fee080bf050 2024-05-16T21:32:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.008+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee08050940 con 0x7fee080bf050 2024-05-16T21:32:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.009+0000 7fedfdffb640 1 -- 172.21.15.5:0/3393625266 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fedf801a070 con 0x7fee080bf050 2024-05-16T21:32:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.009+0000 7fedfdffb640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fedec0762d0 0x7fedec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.009+0000 7fedfdffb640 1 -- 172.21.15.5:0/3393625266 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fedf8096830 con 0x7fee080bf050 2024-05-16T21:32:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.009+0000 7fee0d763640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fedec0762d0 0x7fedec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.010+0000 7fee0d763640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fedec0762d0 0x7fedec0787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fee04034000 tx=0x7fee0402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.014+0000 7fedfdffb640 1 -- 172.21.15.5:0/3393625266 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fedf805fb40 con 0x7fee080bf050 2024-05-16T21:32:43.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.245+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee0806eb40 con 0x7fee080bf050 2024-05-16T21:32:43.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.245+0000 7fedfdffb640 1 -- 172.21.15.5:0/3393625266 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4342 (secure 0 0 0) 0x7fedf8068180 con 0x7fee080bf050 2024-05-16T21:32:43.247 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:43.248 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/206290202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":206290202},{"type":"v1","addr":"172.21.15.5:6834","nonce":206290202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2982407821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2982407821},{"type":"v1","addr":"172.21.15.5:6835","nonce":2982407821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:21.341129+0000","modified":"2024-05-16T21:32:24.356428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/134624287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":134624287},{"type":"v1","addr":"172.21.15.157:6835","nonce":134624287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-16T21:32:43.248 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-05-16T21:32:43.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fedec0762d0 msgr2=0x7fedec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fedec0762d0 0x7fedec0787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fee04034000 tx=0x7fee0402e000 comp rx=0 tx=0).stop 2024-05-16T21:32:43.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee080bf050 msgr2=0x7fee080b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee080bf050 0x7fee080b8640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fedf800c340 tx=0x7fedf800c800 comp rx=0 tx=0).stop 2024-05-16T21:32:43.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 shutdown_connections 2024-05-16T21:32:43.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fedec0762d0 0x7fedec0787e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee08151fc0 0x7fee0814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee080bf050 0x7fee080b8640 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 --2- 172.21.15.5:0/3393625266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee0806da30 0x7fee080a2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 >> 172.21.15.5:0/3393625266 conn(0x7fee080c3d20 msgr2=0x7fee080be840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:43.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 shutdown_connections 2024-05-16T21:32:43.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.247+0000 7fee0f9c7640 1 -- 172.21.15.5:0/3393625266 wait complete. 2024-05-16T21:32:43.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.370+0000 7f3b65b8d640 1 Processor -- start 2024-05-16T21:32:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.370+0000 7f3b65b8d640 1 -- start start 2024-05-16T21:32:43.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b65b8d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b600b8d70 0x7f3b600b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b65b8d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6014ece0 con 0x7f3b6014e530 2024-05-16T21:32:43.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b65b8d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6014efc0 con 0x7f3b600bd440 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b65b8d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3b600b88e0 con 0x7f3b600b8d70 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b5f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3b6014e530 0x7f3b600ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46486/0 (socket says 172.21.15.5:46486) 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b5f7fe640 1 -- 172.21.15.5:0/3356261844 learned_addr learned my addr 172.21.15.5:0/3356261844 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b5ffff640 1 --2- 172.21.15.5:0/3356261844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b600b8d70 0x7f3b600b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b5e7fc640 1 -- 172.21.15.5:0/3356261844 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909932259 0 0) 0x7f3b6014ece0 con 0x7f3b6014e530 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b5e7fc640 1 -- 172.21.15.5:0/3356261844 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b48003520 con 0x7f3b6014e530 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.371+0000 7f3b5e7fc640 1 -- 172.21.15.5:0/3356261844 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176759719 0 0) 0x7f3b6014efc0 con 0x7f3b600bd440 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.372+0000 7f3b5e7fc640 1 -- 172.21.15.5:0/3356261844 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b6014ece0 con 0x7f3b600bd440 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.372+0000 7f3b5e7fc640 1 -- 172.21.15.5:0/3356261844 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3667441604 0 0) 0x7f3b48003520 con 0x7f3b6014e530 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.372+0000 7f3b5ffff640 1 -- 172.21.15.5:0/3356261844 >> v1:172.21.15.157:6789/0 conn(0x7f3b600bd440 legacy=0x7f3b600bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.372+0000 7f3b5ffff640 1 -- 172.21.15.5:0/3356261844 >> v1:172.21.15.5:6789/0 conn(0x7f3b6014e530 legacy=0x7f3b600ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.372+0000 7f3b5ffff640 1 -- 172.21.15.5:0/3356261844 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6014f2a0 con 0x7f3b600b8d70 2024-05-16T21:32:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.372+0000 7f3b5ffff640 1 --2- 172.21.15.5:0/3356261844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b600b8d70 0x7f3b600b9180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009dc0 tx=0x7f3b5802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc416f7ae6f8f8d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b5e7fc640 1 -- 172.21.15.5:0/3356261844 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50001870 con 0x7f3b600b8d70 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b5e7fc640 1 -- 172.21.15.5:0/3356261844 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b58007540 con 0x7f3b600b8d70 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b5e7fc640 1 -- 172.21.15.5:0/3356261844 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b580078f0 con 0x7f3b600b8d70 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b65b8d640 1 -- 172.21.15.5:0/3356261844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b600b8d70 msgr2=0x7f3b600b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b65b8d640 1 --2- 172.21.15.5:0/3356261844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b600b8d70 0x7f3b600b9180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009dc0 tx=0x7f3b5802a660 comp rx=0 tx=0).stop 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b65b8d640 1 -- 172.21.15.5:0/3356261844 shutdown_connections 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b65b8d640 1 --2- 172.21.15.5:0/3356261844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b600b8d70 0x7f3b600b9180 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b65b8d640 1 -- 172.21.15.5:0/3356261844 >> 172.21.15.5:0/3356261844 conn(0x7f3b600c0570 msgr2=0x7f3b600c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b65b8d640 1 -- 172.21.15.5:0/3356261844 shutdown_connections 2024-05-16T21:32:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.373+0000 7f3b65b8d640 1 -- 172.21.15.5:0/3356261844 wait complete. 2024-05-16T21:32:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.375+0000 7f3b65b8d640 1 Processor -- start 2024-05-16T21:32:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.375+0000 7f3b65b8d640 1 -- start start 2024-05-16T21:32:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b65b8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b600b8d70 0x7f3b601dac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b65b8d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b600bd440 0x7f3b6014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b65b8d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b6014e530 0x7f3b6013f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b65b8d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6014e940 con 0x7f3b600b8d70 2024-05-16T21:32:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b65b8d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3b600b96c0 con 0x7f3b600bd440 2024-05-16T21:32:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b65b8d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6014eac0 con 0x7f3b6014e530 2024-05-16T21:32:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b600b8d70 0x7f3b601dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b600b8d70 0x7f3b601dac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53238/0 (socket says 172.21.15.5:53238) 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.376+0000 7f3b5f7fe640 1 -- 172.21.15.5:0/2113328058 learned_addr learned my addr 172.21.15.5:0/2113328058 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b5effd640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b600bd440 0x7f3b6014c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b5ffff640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b6014e530 0x7f3b6013f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b5f7fe640 1 -- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b6014e530 msgr2=0x7f3b6013f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b5f7fe640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b6014e530 0x7f3b6013f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b5f7fe640 1 -- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b600bd440 msgr2=0x7f3b6014c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b5f7fe640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b600bd440 0x7f3b6014c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b5f7fe640 1 -- 172.21.15.5:0/2113328058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b601db190 con 0x7f3b600b8d70 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b5f7fe640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b600b8d70 0x7f3b601dac50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b50001540 tx=0x7f3b5000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b47fff640 1 -- 172.21.15.5:0/2113328058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50017070 con 0x7f3b600b8d70 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b47fff640 1 -- 172.21.15.5:0/2113328058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b50007480 con 0x7f3b600b8d70 2024-05-16T21:32:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b47fff640 1 -- 172.21.15.5:0/2113328058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b500059c0 con 0x7f3b600b8d70 2024-05-16T21:32:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6014cd60 con 0x7f3b600b8d70 2024-05-16T21:32:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.377+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6014db50 con 0x7f3b600b8d70 2024-05-16T21:32:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.378+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b600baa30 con 0x7f3b600b8d70 2024-05-16T21:32:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.379+0000 7f3b47fff640 1 -- 172.21.15.5:0/2113328058 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3b5001a070 con 0x7f3b600b8d70 2024-05-16T21:32:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.379+0000 7f3b47fff640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3b4c0762d0 0x7f3b4c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.380+0000 7f3b47fff640 1 -- 172.21.15.5:0/2113328058 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3b500969b0 con 0x7f3b600b8d70 2024-05-16T21:32:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.380+0000 7f3b5effd640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3b4c0762d0 0x7f3b4c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.380+0000 7f3b5effd640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3b4c0762d0 0x7f3b4c0787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b601e9170 tx=0x7f3b54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.384+0000 7f3b47fff640 1 -- 172.21.15.5:0/2113328058 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3b600baa30 con 0x7f3b600b8d70 2024-05-16T21:32:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.575+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b60050940 con 0x7f3b600b8d70 2024-05-16T21:32:43.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.576+0000 7f3b47fff640 1 -- 172.21.15.5:0/2113328058 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f3b50060310 con 0x7f3b600b8d70 2024-05-16T21:32:43.578 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:43.578 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:22.944103+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:19.250612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:20.291137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3b4c0762d0 msgr2=0x7f3b4c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3b4c0762d0 0x7f3b4c0787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b601e9170 tx=0x7f3b54009040 comp rx=0 tx=0).stop 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b600b8d70 msgr2=0x7f3b601dac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b600b8d70 0x7f3b601dac50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b50001540 tx=0x7f3b5000c960 comp rx=0 tx=0).stop 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 shutdown_connections 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3b4c0762d0 0x7f3b4c0787e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b6014e530 0x7f3b6013f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b600bd440 0x7f3b6014c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 --2- 172.21.15.5:0/2113328058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b600b8d70 0x7f3b601dac50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 >> 172.21.15.5:0/2113328058 conn(0x7f3b600c0570 msgr2=0x7f3b600ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 shutdown_connections 2024-05-16T21:32:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.578+0000 7f3b65b8d640 1 -- 172.21.15.5:0/2113328058 wait complete. 2024-05-16T21:32:43.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-16T21:32:43.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.702+0000 7f8377d7e640 1 Processor -- start 2024-05-16T21:32:43.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.702+0000 7f8377d7e640 1 -- start start 2024-05-16T21:32:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.703+0000 7f8377d7e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8370151fc0 0x7f83700bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.703+0000 7f8377d7e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f837006da30 0x7f83700be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.703+0000 7f8377d7e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83700c36f0 con 0x7f837006de40 2024-05-16T21:32:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.703+0000 7f8377d7e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f83700bdc10 con 0x7f837006da30 2024-05-16T21:32:43.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.703+0000 7f8377d7e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8370152530 con 0x7f8370151fc0 2024-05-16T21:32:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f8375319640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f837006da30 0x7f83700be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f8375b1a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8370151fc0 0x7f83700bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f837631b640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f837006de40 0x7f837014e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:39622/0 (socket says 172.21.15.5:39622) 2024-05-16T21:32:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f837631b640 1 -- 172.21.15.5:0/2322741367 learned_addr learned my addr 172.21.15.5:0/2322741367 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f8375319640 1 -- 172.21.15.5:0/2322741367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8370151fc0 msgr2=0x7f83700bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f8375319640 1 --2- 172.21.15.5:0/2322741367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8370151fc0 0x7f83700bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f8375319640 1 -- 172.21.15.5:0/2322741367 >> v1:172.21.15.157:6789/0 conn(0x7f837006de40 legacy=0x7f837014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f8374b18640 1 -- 172.21.15.5:0/2322741367 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361373552 0 0) 0x7f83700c36f0 con 0x7f837006de40 2024-05-16T21:32:43.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.704+0000 7f8375319640 1 -- 172.21.15.5:0/2322741367 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8370152810 con 0x7f837006da30 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.705+0000 7f8375319640 1 --2- 172.21.15.5:0/2322741367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837006da30 0x7f83700be940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f83600097a0 tx=0x7f836002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43ba48dbe723f65 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.705+0000 7f8374b18640 1 -- 172.21.15.5:0/2322741367 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360037070 con 0x7f837006da30 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.705+0000 7f8374b18640 1 -- 172.21.15.5:0/2322741367 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8360032440 con 0x7f837006da30 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.705+0000 7f8374b18640 1 -- 172.21.15.5:0/2322741367 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360032810 con 0x7f837006da30 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.705+0000 7f8377d7e640 1 -- 172.21.15.5:0/2322741367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837006da30 msgr2=0x7f83700be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.705+0000 7f8377d7e640 1 --2- 172.21.15.5:0/2322741367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837006da30 0x7f83700be940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f83600097a0 tx=0x7f836002a180 comp rx=0 tx=0).stop 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.706+0000 7f8377d7e640 1 -- 172.21.15.5:0/2322741367 shutdown_connections 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.706+0000 7f8377d7e640 1 --2- 172.21.15.5:0/2322741367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837006da30 0x7f83700be940 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.706+0000 7f8377d7e640 1 --2- 172.21.15.5:0/2322741367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8370151fc0 0x7f83700bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.706+0000 7f8377d7e640 1 -- 172.21.15.5:0/2322741367 >> 172.21.15.5:0/2322741367 conn(0x7f83700c3d20 msgr2=0x7f83700c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.706+0000 7f8377d7e640 1 -- 172.21.15.5:0/2322741367 shutdown_connections 2024-05-16T21:32:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.706+0000 7f8377d7e640 1 -- 172.21.15.5:0/2322741367 wait complete. 2024-05-16T21:32:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.707+0000 7f8377d7e640 1 Processor -- start 2024-05-16T21:32:43.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.707+0000 7f8377d7e640 1 -- start start 2024-05-16T21:32:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8377d7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f837006da30 0x7f837014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8377d7e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f837006de40 0x7f83701e3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8377d7e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8370151fc0 0x7f83700b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8377d7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f83700a3050 con 0x7f837006da30 2024-05-16T21:32:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8377d7e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f83700a2ed0 con 0x7f8370151fc0 2024-05-16T21:32:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8377d7e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83700bee80 con 0x7f837006de40 2024-05-16T21:32:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8375b1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f837006da30 0x7f837014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8375b1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f837006da30 0x7f837014ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53242/0 (socket says 172.21.15.5:53242) 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8375b1a640 1 -- 172.21.15.5:0/3122731104 learned_addr learned my addr 172.21.15.5:0/3122731104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f8375319640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f837006de40 0x7f83701e3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.708+0000 7f837631b640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8370151fc0 0x7f83700b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f8375b1a640 1 -- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f837006de40 msgr2=0x7f83701e3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f8375b1a640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f837006de40 0x7f83701e3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f8375b1a640 1 -- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8370151fc0 msgr2=0x7f83700b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f8375b1a640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8370151fc0 0x7f83700b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f8375b1a640 1 -- 172.21.15.5:0/3122731104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700b7920 con 0x7f837006da30 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f8375b1a640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f837006da30 0x7f837014ce40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f836c00e870 tx=0x7f836c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f83667fc640 1 -- 172.21.15.5:0/3122731104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c017070 con 0x7f837006da30 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f83667fc640 1 -- 172.21.15.5:0/3122731104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836c00c940 con 0x7f837006da30 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f83667fc640 1 -- 172.21.15.5:0/3122731104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c00cd30 con 0x7f837006da30 2024-05-16T21:32:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837014d380 con 0x7f837006da30 2024-05-16T21:32:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.709+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837014dda0 con 0x7f837006da30 2024-05-16T21:32:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.710+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f837014dfe0 con 0x7f837006da30 2024-05-16T21:32:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.711+0000 7f83667fc640 1 -- 172.21.15.5:0/3122731104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f836c01a070 con 0x7f837006da30 2024-05-16T21:32:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.711+0000 7f83667fc640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83540762d0 0x7f83540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.711+0000 7f83667fc640 1 -- 172.21.15.5:0/3122731104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f836c0978a0 con 0x7f837006da30 2024-05-16T21:32:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.711+0000 7f8375319640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83540762d0 0x7f83540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.712+0000 7f8375319640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83540762d0 0x7f83540787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8360034000 tx=0x7f836002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.716+0000 7f83667fc640 1 -- 172.21.15.5:0/3122731104 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f837014dfe0 con 0x7f837006da30 2024-05-16T21:32:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.947+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8370050940 con 0x7f837006da30 2024-05-16T21:32:43.950 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-05-16T21:32:43.948+0000 7fcd599bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-16T21:32:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.949+0000 7f83667fc640 1 -- 172.21.15.5:0/3122731104 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f836c060aa0 con 0x7f837006da30 2024-05-16T21:32:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-16T21:32:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83540762d0 msgr2=0x7f83540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83540762d0 0x7f83540787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8360034000 tx=0x7f836002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f837006da30 msgr2=0x7f837014ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f837006da30 0x7f837014ce40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f836c00e870 tx=0x7f836c00ed30 comp rx=0 tx=0).stop 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 shutdown_connections 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83540762d0 0x7f83540787e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8370151fc0 0x7f83700b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f837006de40 0x7f83701e3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 --2- 172.21.15.5:0/3122731104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f837006da30 0x7f837014ce40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 >> 172.21.15.5:0/3122731104 conn(0x7f83700c3d20 msgr2=0x7f83700c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 shutdown_connections 2024-05-16T21:32:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:43.952+0000 7f8377d7e640 1 -- 172.21.15.5:0/3122731104 wait complete. 2024-05-16T21:32:43.957 INFO:tasks.ceph.mds.b.smithi157.stderr: -4915> 2024-05-16T21:32:26.932+0000 7f9867278640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T21:32:43.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-16T21:32:44.010 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-05-16T21:32:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.091+0000 7fa0693ee640 1 Processor -- start 2024-05-16T21:32:44.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.091+0000 7fa0693ee640 1 -- start start 2024-05-16T21:32:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.092+0000 7fa0693ee640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa0640b4aa0 0x7fa0640b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa0693ee640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa06414e720 0x7fa06414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa0693ee640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06406fed0 con 0x7fa06414f070 2024-05-16T21:32:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa0693ee640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa064071f40 con 0x7fa06414e720 2024-05-16T21:32:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa0693ee640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa0640bbe50 con 0x7fa0640b4aa0 2024-05-16T21:32:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa05bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa06414e720 0x7fa06414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa0637fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa06414f070 0x7fa06406e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46498/0 (socket says 172.21.15.5:46498) 2024-05-16T21:32:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa05bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa06414e720 0x7fa06414eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53246/0 (socket says 172.21.15.5:53246) 2024-05-16T21:32:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa0637fe640 1 -- 172.21.15.5:0/2040582248 learned_addr learned my addr 172.21.15.5:0/2040582248 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa062ffd640 1 --2- 172.21.15.5:0/2040582248 >> v2:172.21.15.157:3300/0 conn(0x7fa0640b4aa0 0x7fa0640b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa05bfff640 1 -- 172.21.15.5:0/2040582248 >> v2:172.21.15.157:3300/0 conn(0x7fa0640b4aa0 msgr2=0x7fa0640b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa05bfff640 1 --2- 172.21.15.5:0/2040582248 >> v2:172.21.15.157:3300/0 conn(0x7fa0640b4aa0 0x7fa0640b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa05bfff640 1 -- 172.21.15.5:0/2040582248 >> v1:172.21.15.5:6789/0 conn(0x7fa06414f070 legacy=0x7fa06406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa05bfff640 1 -- 172.21.15.5:0/2040582248 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0640bb0e0 con 0x7fa06414e720 2024-05-16T21:32:44.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.093+0000 7fa0627fc640 1 -- 172.21.15.5:0/2040582248 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016075205 0 0) 0x7fa05c001490 con 0x7fa06414f070 2024-05-16T21:32:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.094+0000 7fa05bfff640 1 --2- 172.21.15.5:0/2040582248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa06414e720 0x7fa06414eb30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0097a0 tx=0x7fa04c02b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ef25c88b774221 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.094+0000 7fa0627fc640 1 -- 172.21.15.5:0/2040582248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c038070 con 0x7fa06414e720 2024-05-16T21:32:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.094+0000 7fa0627fc640 1 -- 172.21.15.5:0/2040582248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c033640 con 0x7fa06414e720 2024-05-16T21:32:44.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.094+0000 7fa0627fc640 1 -- 172.21.15.5:0/2040582248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c033a10 con 0x7fa06414e720 2024-05-16T21:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.095+0000 7fa0693ee640 1 -- 172.21.15.5:0/2040582248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa06414e720 msgr2=0x7fa06414eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.095+0000 7fa0693ee640 1 --2- 172.21.15.5:0/2040582248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa06414e720 0x7fa06414eb30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0097a0 tx=0x7fa04c02b3f0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.095+0000 7fa0693ee640 1 -- 172.21.15.5:0/2040582248 shutdown_connections 2024-05-16T21:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.095+0000 7fa0693ee640 1 --2- 172.21.15.5:0/2040582248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa06414e720 0x7fa06414eb30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.095+0000 7fa0693ee640 1 --2- 172.21.15.5:0/2040582248 >> v2:172.21.15.157:3300/0 conn(0x7fa0640b4aa0 0x7fa0640b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.095+0000 7fa0693ee640 1 -- 172.21.15.5:0/2040582248 >> 172.21.15.5:0/2040582248 conn(0x7fa0640a1ac0 msgr2=0x7fa0640bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.095+0000 7fa0693ee640 1 -- 172.21.15.5:0/2040582248 shutdown_connections 2024-05-16T21:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.095+0000 7fa0693ee640 1 -- 172.21.15.5:0/2040582248 wait complete. 2024-05-16T21:32:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.097+0000 7fa0693ee640 1 Processor -- start 2024-05-16T21:32:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.097+0000 7fa0693ee640 1 -- start start 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa0693ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640b4aa0 0x7fa064142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa0693ee640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06414e720 0x7fa0640bd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa0693ee640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa06414f070 0x7fa0641416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa0693ee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa06414f480 con 0x7fa0640b4aa0 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa0693ee640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa0640bab60 con 0x7fa06414e720 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa0693ee640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa0640b9ee0 con 0x7fa06414f070 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640b4aa0 0x7fa064142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640b4aa0 0x7fa064142e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53254/0 (socket says 172.21.15.5:53254) 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 -- 172.21.15.5:0/3551608652 learned_addr learned my addr 172.21.15.5:0/3551608652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa05bfff640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06414e720 0x7fa0640bd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa0637fe640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa06414f070 0x7fa0641416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 -- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa06414f070 msgr2=0x7fa0641416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa06414f070 0x7fa0641416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 -- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06414e720 msgr2=0x7fa0640bd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06414e720 0x7fa0640bd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 -- 172.21.15.5:0/3551608652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa064143380 con 0x7fa0640b4aa0 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa0637fe640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa06414f070 0x7fa0641416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.098+0000 7fa062ffd640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640b4aa0 0x7fa064142e40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa054010a80 tx=0x7fa054010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.099+0000 7fa05b7fe640 1 -- 172.21.15.5:0/3551608652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05401e070 con 0x7fa0640b4aa0 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.099+0000 7fa05b7fe640 1 -- 172.21.15.5:0/3551608652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa054011450 con 0x7fa0640b4aa0 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.099+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa064148de0 con 0x7fa0640b4aa0 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.099+0000 7fa05b7fe640 1 -- 172.21.15.5:0/3551608652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054011820 con 0x7fa0640b4aa0 2024-05-16T21:32:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.099+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0641493a0 con 0x7fa0640b4aa0 2024-05-16T21:32:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.100+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa064050940 con 0x7fa0640b4aa0 2024-05-16T21:32:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.101+0000 7fa05b7fe640 1 -- 172.21.15.5:0/3551608652 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa054021070 con 0x7fa0640b4aa0 2024-05-16T21:32:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.101+0000 7fa05b7fe640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa044076300 0x7fa044078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.101+0000 7fa05b7fe640 1 -- 172.21.15.5:0/3551608652 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7fa054099740 con 0x7fa0640b4aa0 2024-05-16T21:32:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.101+0000 7fa05bfff640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa044076300 0x7fa044078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.102+0000 7fa05bfff640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa044076300 0x7fa044078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa04c035000 tx=0x7fa04c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.106+0000 7fa05b7fe640 1 -- 172.21.15.5:0/3551608652 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa054062960 con 0x7fa0640b4aa0 2024-05-16T21:32:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.346+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa0640ba940 con 0x7fa0640b4aa0 2024-05-16T21:32:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.951+0000 7fa05b7fe640 1 -- 172.21.15.5:0/3551608652 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fa054066c60 con 0x7fa0640b4aa0 2024-05-16T21:32:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa044076300 msgr2=0x7fa044078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa044076300 0x7fa044078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa04c035000 tx=0x7fa04c02f000 comp rx=0 tx=0).stop 2024-05-16T21:32:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640b4aa0 msgr2=0x7fa064142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640b4aa0 0x7fa064142e40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa054010a80 tx=0x7fa054010f40 comp rx=0 tx=0).stop 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 shutdown_connections 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa044076300 0x7fa044078810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa06414f070 0x7fa0641416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06414e720 0x7fa0640bd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 --2- 172.21.15.5:0/3551608652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0640b4aa0 0x7fa064142e40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 >> 172.21.15.5:0/3551608652 conn(0x7fa0640a1ac0 msgr2=0x7fa064143b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.953+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 shutdown_connections 2024-05-16T21:32:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:44.954+0000 7fa0693ee640 1 -- 172.21.15.5:0/3551608652 wait complete. 2024-05-16T21:32:44.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-16T21:32:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.084+0000 7f4055176640 1 Processor -- start 2024-05-16T21:32:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.084+0000 7f4055176640 1 -- start start 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.085+0000 7f4055176640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40500bfb00 0x7f4050152240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.085+0000 7f4055176640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40500ba4d0 con 0x7f40500b95e0 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.085+0000 7f4055176640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40500ba7b0 con 0x7f40500bf6f0 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.085+0000 7f4055176640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f40500baa90 con 0x7f40500bfb00 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.085+0000 7f404e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f40500b95e0 0x7f4050151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46504/0 (socket says 172.21.15.5:46504) 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.085+0000 7f404e59c640 1 -- 172.21.15.5:0/735376364 learned_addr learned my addr 172.21.15.5:0/735376364 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404f59e640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40500bfb00 0x7f4050152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033063940 0 0) 0x7f40500ba4d0 con 0x7f40500b95e0 2024-05-16T21:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f403c003520 con 0x7f40500b95e0 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3811506745 0 0) 0x7f403c003520 con 0x7f40500b95e0 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40500bfb00 msgr2=0x7f4050152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40500bfb00 0x7f4050152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 >> v1:172.21.15.157:6789/0 conn(0x7f40500bf6f0 legacy=0x7f40500b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40500bff10 con 0x7f40500b95e0 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f40380016f0 con 0x7f40500b95e0 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 >> v1:172.21.15.5:6789/0 conn(0x7f40500b95e0 legacy=0x7f4050151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40500bfb00 0x7f403c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f403c004000 0x7f403c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f403c004d40 0x7f403c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40500baa90 con 0x7f403c004000 2024-05-16T21:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f403c00bc00 con 0x7f403c004d40 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f403c00be00 con 0x7f40500bfb00 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404e59c640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f403c004000 0x7f403c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404ed9d640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40500bfb00 0x7f403c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404f59e640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f403c004d40 0x7f403c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404e59c640 1 -- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40500bfb00 msgr2=0x7f403c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404e59c640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40500bfb00 0x7f403c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404e59c640 1 -- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f403c004d40 msgr2=0x7f403c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404e59c640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f403c004d40 0x7f403c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.086+0000 7f404e59c640 1 -- 172.21.15.5:0/735376364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c003520 con 0x7f403c004000 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.087+0000 7f404e59c640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f403c004000 0x7f403c004800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f403800c210 tx=0x7f403c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e371868dd6af08d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.087+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038007d10 con 0x7f403c004000 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.087+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4038005ad0 con 0x7f403c004000 2024-05-16T21:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.087+0000 7f404dd9b640 1 -- 172.21.15.5:0/735376364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038007070 con 0x7f403c004000 2024-05-16T21:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.088+0000 7f4055176640 1 -- 172.21.15.5:0/735376364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f403c004000 msgr2=0x7f403c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.088+0000 7f4055176640 1 --2- 172.21.15.5:0/735376364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f403c004000 0x7f403c004800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f403800c210 tx=0x7f403c005830 comp rx=0 tx=0).stop 2024-05-16T21:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.088+0000 7f404f59e640 1 -- 172.21.15.5:0/735376364 reap_dead start 2024-05-16T21:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.088+0000 7f4055176640 1 -- 172.21.15.5:0/735376364 shutdown_connections 2024-05-16T21:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.088+0000 7f4055176640 1 -- 172.21.15.5:0/735376364 >> 172.21.15.5:0/735376364 conn(0x7f40500c0570 msgr2=0x7f40500c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.088+0000 7f4055176640 1 -- 172.21.15.5:0/735376364 shutdown_connections 2024-05-16T21:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.088+0000 7f4055176640 1 -- 172.21.15.5:0/735376364 wait complete. 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.090+0000 7f4055176640 1 Processor -- start 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.090+0000 7f4055176640 1 -- start start 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f4055176640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f403c004000 0x7f40501e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f4055176640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4050146770 0x7f40500c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f4055176640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40501d9ac0 0x7f40501d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f4055176640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40501523c0 con 0x7f40501d9ac0 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f4055176640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4050152240 con 0x7f4050146770 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f4055176640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4050152540 con 0x7f403c004000 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40501d9ac0 0x7f40501d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40501d9ac0 0x7f40501d9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53278/0 (socket says 172.21.15.5:53278) 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404f59e640 1 -- 172.21.15.5:0/4125745814 learned_addr learned my addr 172.21.15.5:0/4125745814 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404ed9d640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f403c004000 0x7f40501e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404e59c640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4050146770 0x7f40500c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404f59e640 1 -- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f403c004000 msgr2=0x7f40501e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404f59e640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f403c004000 0x7f40501e4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404f59e640 1 -- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4050146770 msgr2=0x7f40500c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404f59e640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4050146770 0x7f40500c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404f59e640 1 -- 172.21.15.5:0/4125745814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40501e7d10 con 0x7f40501d9ac0 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404ed9d640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f403c004000 0x7f40501e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.091+0000 7f404e59c640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4050146770 0x7f40500c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.092+0000 7f404f59e640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40501d9ac0 0x7f40501d9ed0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40500b8a30 tx=0x7f404000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.092+0000 7f40477fe640 1 -- 172.21.15.5:0/4125745814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404000fe10 con 0x7f40501d9ac0 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.092+0000 7f40477fe640 1 -- 172.21.15.5:0/4125745814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404001d070 con 0x7f40501d9ac0 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.092+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40501e7ff0 con 0x7f40501d9ac0 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.092+0000 7f40477fe640 1 -- 172.21.15.5:0/4125745814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040015670 con 0x7f40501d9ac0 2024-05-16T21:32:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.092+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40501da410 con 0x7f40501d9ac0 2024-05-16T21:32:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.093+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40500c2760 con 0x7f40501d9ac0 2024-05-16T21:32:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.094+0000 7f40477fe640 1 -- 172.21.15.5:0/4125745814 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4040015810 con 0x7f40501d9ac0 2024-05-16T21:32:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.094+0000 7f40477fe640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f40300762d0 0x7f40300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.094+0000 7f40477fe640 1 -- 172.21.15.5:0/4125745814 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f4040098010 con 0x7f40501d9ac0 2024-05-16T21:32:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.094+0000 7f404ed9d640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f40300762d0 0x7f40300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.095+0000 7f404ed9d640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f40300762d0 0x7f40300787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4048000c00 tx=0x7f4048009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.099+0000 7f40477fe640 1 -- 172.21.15.5:0/4125745814 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4040010040 con 0x7f40501d9ac0 2024-05-16T21:32:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:45.295+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f405014bdd0 con 0x7f40501d9ac0 2024-05-16T21:32:46.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.030+0000 7f40477fe640 1 -- 172.21.15.5:0/4125745814 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f4040061910 con 0x7f40501d9ac0 2024-05-16T21:32:46.033 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-05-16T21:32:46.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.036+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f40300762d0 msgr2=0x7f40300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:46.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.036+0000 7f4055176640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f40300762d0 0x7f40300787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4048000c00 tx=0x7f4048009040 comp rx=0 tx=0).stop 2024-05-16T21:32:46.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.036+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40501d9ac0 msgr2=0x7f40501d9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:46.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.036+0000 7f4055176640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40501d9ac0 0x7f40501d9ed0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40500b8a30 tx=0x7f404000f580 comp rx=0 tx=0).stop 2024-05-16T21:32:46.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.038+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 shutdown_connections 2024-05-16T21:32:46.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.038+0000 7f4055176640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f40300762d0 0x7f40300787e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.038+0000 7f4055176640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40501d9ac0 0x7f40501d9ed0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.038+0000 7f4055176640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4050146770 0x7f40500c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.038+0000 7f4055176640 1 --2- 172.21.15.5:0/4125745814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f403c004000 0x7f40501e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.038+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 >> 172.21.15.5:0/4125745814 conn(0x7f40500c0570 msgr2=0x7f40500a8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:46.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.038+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 shutdown_connections 2024-05-16T21:32:46.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.038+0000 7f4055176640 1 -- 172.21.15.5:0/4125745814 wait complete. 2024-05-16T21:32:46.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-16T21:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.176+0000 7ff0d0326640 1 Processor -- start 2024-05-16T21:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.176+0000 7ff0d0326640 1 -- start start 2024-05-16T21:32:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.177+0000 7ff0d0326640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff0c8151fc0 0x7ff0c80bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.177+0000 7ff0d0326640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0c80bf050 0x7ff0c8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.177+0000 7ff0d0326640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c80c36f0 con 0x7ff0c806da30 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.177+0000 7ff0d0326640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c80bdc10 con 0x7ff0c80bf050 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.177+0000 7ff0d0326640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c8152530 con 0x7ff0c8151fc0 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.177+0000 7ff0ce8c3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0c80bf050 0x7ff0c8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.177+0000 7ff0ce8c3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0c80bf050 0x7ff0c8158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53292/0 (socket says 172.21.15.5:53292) 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.177+0000 7ff0ce8c3640 1 -- 172.21.15.5:0/2343239589 learned_addr learned my addr 172.21.15.5:0/2343239589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.178+0000 7ff0ce0c2640 1 --2- 172.21.15.5:0/2343239589 >> v2:172.21.15.157:3300/0 conn(0x7ff0c8151fc0 0x7ff0c80bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.178+0000 7ff0ce8c3640 1 -- 172.21.15.5:0/2343239589 >> v2:172.21.15.157:3300/0 conn(0x7ff0c8151fc0 msgr2=0x7ff0c80bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.178+0000 7ff0ce8c3640 1 --2- 172.21.15.5:0/2343239589 >> v2:172.21.15.157:3300/0 conn(0x7ff0c8151fc0 0x7ff0c80bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.178+0000 7ff0ce8c3640 1 -- 172.21.15.5:0/2343239589 >> v1:172.21.15.157:6789/0 conn(0x7ff0c806da30 legacy=0x7ff0c80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.178+0000 7ff0ce8c3640 1 -- 172.21.15.5:0/2343239589 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c8152810 con 0x7ff0c80bf050 2024-05-16T21:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.178+0000 7ff0ce8c3640 1 --2- 172.21.15.5:0/2343239589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c80bf050 0x7ff0c8158e90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff0c808d300 tx=0x7ff0c002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c12916c1dc8ed50 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0cd0c0640 1 -- 172.21.15.5:0/2343239589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0036070 con 0x7ff0c80bf050 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0cd0c0640 1 -- 172.21.15.5:0/2343239589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c0031600 con 0x7ff0c80bf050 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0cd0c0640 1 -- 172.21.15.5:0/2343239589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00319d0 con 0x7ff0c80bf050 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0d0326640 1 -- 172.21.15.5:0/2343239589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c80bf050 msgr2=0x7ff0c8158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0d0326640 1 --2- 172.21.15.5:0/2343239589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c80bf050 0x7ff0c8158e90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff0c808d300 tx=0x7ff0c002a730 comp rx=0 tx=0).stop 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0d0326640 1 -- 172.21.15.5:0/2343239589 shutdown_connections 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0d0326640 1 --2- 172.21.15.5:0/2343239589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c80bf050 0x7ff0c8158e90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0d0326640 1 --2- 172.21.15.5:0/2343239589 >> v2:172.21.15.157:3300/0 conn(0x7ff0c8151fc0 0x7ff0c80bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0d0326640 1 -- 172.21.15.5:0/2343239589 >> 172.21.15.5:0/2343239589 conn(0x7ff0c80c3d20 msgr2=0x7ff0c80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0d0326640 1 -- 172.21.15.5:0/2343239589 shutdown_connections 2024-05-16T21:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.179+0000 7ff0d0326640 1 -- 172.21.15.5:0/2343239589 wait complete. 2024-05-16T21:32:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.181+0000 7ff0d0326640 1 Processor -- start 2024-05-16T21:32:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.181+0000 7ff0d0326640 1 -- start start 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0d0326640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c806da30 0x7ff0c80b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0d0326640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0c80bf050 0x7ff0c80a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0d0326640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0c8151fc0 0x7ff0c81e81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0d0326640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c80a3050 con 0x7ff0c806da30 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0d0326640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c80a2ed0 con 0x7ff0c8151fc0 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0d0326640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c806de40 con 0x7ff0c80bf050 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce0c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c806da30 0x7ff0c80b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce0c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c806da30 0x7ff0c80b95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53300/0 (socket says 172.21.15.5:53300) 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce0c2640 1 -- 172.21.15.5:0/4225422123 learned_addr learned my addr 172.21.15.5:0/4225422123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce0c2640 1 -- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0c80bf050 msgr2=0x7ff0c80a2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce0c2640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0c80bf050 0x7ff0c80a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce0c2640 1 -- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0c8151fc0 msgr2=0x7ff0c81e81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce8c3640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0c8151fc0 0x7ff0c81e81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce0c2640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0c8151fc0 0x7ff0c81e81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce0c2640 1 -- 172.21.15.5:0/4225422123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c80a2a50 con 0x7ff0c806da30 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.182+0000 7ff0ce8c3640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0c8151fc0 0x7ff0c81e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.183+0000 7ff0ce0c2640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c806da30 0x7ff0c80b95f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400d620 tx=0x7ff0c400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.183+0000 7ff0beffd640 1 -- 172.21.15.5:0/4225422123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400b620 con 0x7ff0c806da30 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.183+0000 7ff0beffd640 1 -- 172.21.15.5:0/4225422123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c4019070 con 0x7ff0c806da30 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.183+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c81e86f0 con 0x7ff0c806da30 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.183+0000 7ff0beffd640 1 -- 172.21.15.5:0/4225422123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400ba00 con 0x7ff0c806da30 2024-05-16T21:32:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.183+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c81e7c90 con 0x7ff0c806da30 2024-05-16T21:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.184+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c80ba270 con 0x7ff0c806da30 2024-05-16T21:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.185+0000 7ff0beffd640 1 -- 172.21.15.5:0/4225422123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff0c400bba0 con 0x7ff0c806da30 2024-05-16T21:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.185+0000 7ff0beffd640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff0ac0762d0 0x7ff0ac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.185+0000 7ff0beffd640 1 -- 172.21.15.5:0/4225422123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7ff0c4097870 con 0x7ff0c806da30 2024-05-16T21:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.186+0000 7ff0cd8c1640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff0ac0762d0 0x7ff0ac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.186+0000 7ff0cd8c1640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff0ac0762d0 0x7ff0ac0787e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8000f60 tx=0x7ff0b80079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.190+0000 7ff0beffd640 1 -- 172.21.15.5:0/4225422123 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff0c80ba270 con 0x7ff0c806da30 2024-05-16T21:32:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:46.385+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff0c8050940 con 0x7ff0c806da30 2024-05-16T21:32:47.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.042+0000 7ff0beffd640 1 -- 172.21.15.5:0/4225422123 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7ff0c40613c0 con 0x7ff0c806da30 2024-05-16T21:32:47.044 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-05-16T21:32:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.047+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff0ac0762d0 msgr2=0x7ff0ac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.047+0000 7ff0d0326640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff0ac0762d0 0x7ff0ac0787e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8000f60 tx=0x7ff0b80079b0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.047+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c806da30 msgr2=0x7ff0c80b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.047+0000 7ff0d0326640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c806da30 0x7ff0c80b95f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400d620 tx=0x7ff0c400dae0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.048+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 shutdown_connections 2024-05-16T21:32:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.048+0000 7ff0d0326640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff0ac0762d0 0x7ff0ac0787e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.048+0000 7ff0d0326640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0c8151fc0 0x7ff0c81e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.048+0000 7ff0d0326640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0c80bf050 0x7ff0c80a2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.048+0000 7ff0d0326640 1 --2- 172.21.15.5:0/4225422123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0c806da30 0x7ff0c80b95f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.048+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 >> 172.21.15.5:0/4225422123 conn(0x7ff0c80c3d20 msgr2=0x7ff0c80be840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.048+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 shutdown_connections 2024-05-16T21:32:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.049+0000 7ff0d0326640 1 -- 172.21.15.5:0/4225422123 wait complete. 2024-05-16T21:32:47.066 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-16T21:32:47.067 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-16T21:32:47.067 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-16T21:32:47.067 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T21:32:47.067 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-16T21:32:47.067 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-16T21:32:47.067 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-16T21:32:47.067 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T21:32:47.068 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-16T21:32:47.068 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-16T21:32:47.068 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-16T21:32:47.068 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T21:32:47.078 INFO:tasks.ceph.mds.a:Stopped 2024-05-16T21:32:47.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-16T21:32:47.079 INFO:tasks.ceph.mds.c:Stopped 2024-05-16T21:32:47.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-16T21:32:47.082 INFO:tasks.ceph.mds.b:Stopped 2024-05-16T21:32:47.082 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-16T21:32:47.121 INFO:tasks.ceph.mds.a:Started 2024-05-16T21:32:47.121 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:47.122 INFO:tasks.ceph.mds.c:Started 2024-05-16T21:32:47.122 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:47.125 INFO:tasks.ceph.mds.b:Started 2024-05-16T21:32:47.125 DEBUG:teuthology.parallel:result is None 2024-05-16T21:32:47.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-16T21:32:47.223 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-05-16T21:32:47.224 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-05-16T21:32:47.226 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-05-16T21:32:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.255+0000 7f6da1a84640 1 Processor -- start 2024-05-16T21:32:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.255+0000 7f6da1a84640 1 -- start start 2024-05-16T21:32:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6da1a84640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d9c0bd440 0x7f6d9c0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6da1a84640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d9c0bdd90 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6da1a84640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d9c14ece0 con 0x7f6d9c14e530 2024-05-16T21:32:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6da1a84640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6d9c0b88e0 con 0x7f6d9c0bd440 2024-05-16T21:32:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6d9affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d9c0bd440 0x7f6d9c0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6d9bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6d9c0b8d70 0x7f6d9c0b9180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33986/0 (socket says 172.21.15.5:33986) 2024-05-16T21:32:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6d9affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d9c0bd440 0x7f6d9c0bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44478/0 (socket says 172.21.15.5:44478) 2024-05-16T21:32:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6d9bfff640 1 -- 172.21.15.5:0/3701520148 learned_addr learned my addr 172.21.15.5:0/3701520148 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6d9affd640 1 -- 172.21.15.5:0/3701520148 >> v1:172.21.15.157:6789/0 conn(0x7f6d9c14e530 legacy=0x7f6d9c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6d9affd640 1 -- 172.21.15.5:0/3701520148 >> v1:172.21.15.5:6789/0 conn(0x7f6d9c0b8d70 legacy=0x7f6d9c0b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6d9a7fc640 1 -- 172.21.15.5:0/3701520148 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218090139 0 0) 0x7f6d9c0bdd90 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.256+0000 7f6d9affd640 1 -- 172.21.15.5:0/3701520148 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9c14efc0 con 0x7f6d9c0bd440 2024-05-16T21:32:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.257+0000 7f6d9affd640 1 --2- 172.21.15.5:0/3701520148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0bd440 0x7f6d9c0bd850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0097a0 tx=0x7f6d8c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7620a331d8f383de server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.257+0000 7f6d9a7fc640 1 -- 172.21.15.5:0/3701520148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c037070 con 0x7f6d9c0bd440 2024-05-16T21:32:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.257+0000 7f6d9a7fc640 1 -- 172.21.15.5:0/3701520148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8c032440 con 0x7f6d9c0bd440 2024-05-16T21:32:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.257+0000 7f6d9a7fc640 1 -- 172.21.15.5:0/3701520148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c032810 con 0x7f6d9c0bd440 2024-05-16T21:32:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.258+0000 7f6da1a84640 1 -- 172.21.15.5:0/3701520148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0bd440 msgr2=0x7f6d9c0bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.258+0000 7f6da1a84640 1 --2- 172.21.15.5:0/3701520148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0bd440 0x7f6d9c0bd850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0097a0 tx=0x7f6d8c02a180 comp rx=0 tx=0).stop 2024-05-16T21:32:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.258+0000 7f6da1a84640 1 -- 172.21.15.5:0/3701520148 shutdown_connections 2024-05-16T21:32:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.258+0000 7f6da1a84640 1 --2- 172.21.15.5:0/3701520148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0bd440 0x7f6d9c0bd850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.258+0000 7f6da1a84640 1 -- 172.21.15.5:0/3701520148 >> 172.21.15.5:0/3701520148 conn(0x7f6d9c0c0570 msgr2=0x7f6d9c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.258+0000 7f6da1a84640 1 -- 172.21.15.5:0/3701520148 shutdown_connections 2024-05-16T21:32:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.258+0000 7f6da1a84640 1 -- 172.21.15.5:0/3701520148 wait complete. 2024-05-16T21:32:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.259+0000 7f6da1a84640 1 Processor -- start 2024-05-16T21:32:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.260+0000 7f6da1a84640 1 -- start start 2024-05-16T21:32:47.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6da1a84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0b8d70 0x7f6d9c140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6da1a84640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d9c0bd440 0x7f6d9c1e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6da1a84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d9c14e530 0x7f6d9c143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6da1a84640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c14e940 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6da1a84640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c0bbb70 con 0x7f6d9c0bd440 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6da1a84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6d9c14eac0 con 0x7f6d9c14e530 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0b8d70 0x7f6d9c140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0b8d70 0x7f6d9c140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44488/0 (socket says 172.21.15.5:44488) 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 -- 172.21.15.5:0/3140635921 learned_addr learned my addr 172.21.15.5:0/3140635921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9affd640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d9c0bd440 0x7f6d9c1e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9bfff640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d9c14e530 0x7f6d9c143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 -- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d9c14e530 msgr2=0x7f6d9c143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d9c14e530 0x7f6d9c143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 -- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d9c0bd440 msgr2=0x7f6d9c1e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d9c0bd440 0x7f6d9c1e45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 -- 172.21.15.5:0/3140635921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9c140ed0 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.261+0000 7f6d9b7fe640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0b8d70 0x7f6d9c140990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400b3e0 tx=0x7f6d8400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.262+0000 7f6d93fff640 1 -- 172.21.15.5:0/3140635921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84015020 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.262+0000 7f6d93fff640 1 -- 172.21.15.5:0/3140635921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d84011850 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.262+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9c1e4b20 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.262+0000 7f6d93fff640 1 -- 172.21.15.5:0/3140635921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84011c40 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.262+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9c1e4100 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.263+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9c1e42d0 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.263+0000 7f6d93fff640 1 -- 172.21.15.5:0/3140635921 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d84018020 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.264+0000 7f6d93fff640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6d7c0762d0 0x7f6d7c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.264+0000 7f6d93fff640 1 -- 172.21.15.5:0/3140635921 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f6d840970e0 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.264+0000 7f6d9affd640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6d7c0762d0 0x7f6d7c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.264+0000 7f6d9affd640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6d7c0762d0 0x7f6d7c0787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c034000 tx=0x7f6d8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:47.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.269+0000 7f6d93fff640 1 -- 172.21.15.5:0/3140635921 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6d84060cb0 con 0x7f6d9c0b8d70 2024-05-16T21:32:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:47.474+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6d9c068d10 con 0x7f6d9c0b8d70 2024-05-16T21:32:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.052+0000 7f6d93fff640 1 -- 172.21.15.5:0/3140635921 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f6d9c068d10 con 0x7f6d9c0b8d70 2024-05-16T21:32:48.054 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-05-16T21:32:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6d7c0762d0 msgr2=0x7f6d7c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6d7c0762d0 0x7f6d7c0787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c034000 tx=0x7f6d8c02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0b8d70 msgr2=0x7f6d9c140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0b8d70 0x7f6d9c140990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400b3e0 tx=0x7f6d8400b8a0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 shutdown_connections 2024-05-16T21:32:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6d7c0762d0 0x7f6d7c0787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d9c14e530 0x7f6d9c143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d9c0bd440 0x7f6d9c1e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 --2- 172.21.15.5:0/3140635921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d9c0b8d70 0x7f6d9c140990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 >> 172.21.15.5:0/3140635921 conn(0x7f6d9c0c0570 msgr2=0x7f6d9c068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 shutdown_connections 2024-05-16T21:32:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.055+0000 7f6da1a84640 1 -- 172.21.15.5:0/3140635921 wait complete. 2024-05-16T21:32:48.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-16T21:32:48.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.185+0000 7f921866e640 1 Processor -- start 2024-05-16T21:32:48.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.185+0000 7f921866e640 1 -- start start 2024-05-16T21:32:48.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.186+0000 7f921866e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 0x7f921014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.186+0000 7f921866e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f921014fad0 0x7f921014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.186+0000 7f921866e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92100bb890 con 0x7f9210074b00 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.186+0000 7f921866e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f92100bb470 con 0x7f921014fad0 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.186+0000 7f921866e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f92100bbb30 con 0x7f92100be3f0 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.186+0000 7f9216c0b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f921014fad0 0x7f921014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.186+0000 7f9216c0b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f921014fad0 0x7f921014fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44500/0 (socket says 172.21.15.5:44500) 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.186+0000 7f9216c0b640 1 -- 172.21.15.5:0/1484849583 learned_addr learned my addr 172.21.15.5:0/1484849583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.187+0000 7f9215c09640 1 --2- 172.21.15.5:0/1484849583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 0x7f921014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.187+0000 7f9216c0b640 1 -- 172.21.15.5:0/1484849583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 msgr2=0x7f921014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.187+0000 7f9216c0b640 1 --2- 172.21.15.5:0/1484849583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 0x7f921014cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.187+0000 7f9216c0b640 1 -- 172.21.15.5:0/1484849583 >> v1:172.21.15.157:6789/0 conn(0x7f9210074b00 legacy=0x7f921006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.187+0000 7f9216c0b640 1 -- 172.21.15.5:0/1484849583 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92100bbe10 con 0x7f921014fad0 2024-05-16T21:32:48.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.187+0000 7f9216c0b640 1 --2- 172.21.15.5:0/1484849583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f921014fee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9208009e50 tx=0x7f920802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18a97697d8e286c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f9215408640 1 -- 172.21.15.5:0/1484849583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208036070 con 0x7f921014fad0 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f9215408640 1 -- 172.21.15.5:0/1484849583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208031600 con 0x7f921014fad0 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f9215408640 1 -- 172.21.15.5:0/1484849583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92080319d0 con 0x7f921014fad0 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f921866e640 1 -- 172.21.15.5:0/1484849583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 msgr2=0x7f921014fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f921866e640 1 --2- 172.21.15.5:0/1484849583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f921014fee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9208009e50 tx=0x7f920802a680 comp rx=0 tx=0).stop 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f921866e640 1 -- 172.21.15.5:0/1484849583 shutdown_connections 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f921866e640 1 --2- 172.21.15.5:0/1484849583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f921014fee0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f921866e640 1 --2- 172.21.15.5:0/1484849583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 0x7f921014cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f921866e640 1 -- 172.21.15.5:0/1484849583 >> 172.21.15.5:0/1484849583 conn(0x7f92100bd0f0 msgr2=0x7f92100bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f921866e640 1 -- 172.21.15.5:0/1484849583 shutdown_connections 2024-05-16T21:32:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.188+0000 7f921866e640 1 -- 172.21.15.5:0/1484849583 wait complete. 2024-05-16T21:32:48.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.190+0000 7f921866e640 1 Processor -- start 2024-05-16T21:32:48.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.190+0000 7f921866e640 1 -- start start 2024-05-16T21:32:48.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f921866e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9210074b00 0x7f921014ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f921866e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 0x7f921014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f921866e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f92101d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f921866e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f92100bc3d0 con 0x7f921014fad0 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f921866e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9210150420 con 0x7f9210074b00 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f921866e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f921014d060 con 0x7f92100be3f0 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9216c0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f92101d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9216c0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f92101d79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44514/0 (socket says 172.21.15.5:44514) 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9216c0b640 1 -- 172.21.15.5:0/2282055912 learned_addr learned my addr 172.21.15.5:0/2282055912 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f921640a640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9210074b00 0x7f921014ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9215c09640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 0x7f921014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9216c0b640 1 -- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 msgr2=0x7f921014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9216c0b640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 0x7f921014dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9216c0b640 1 -- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9210074b00 msgr2=0x7f921014ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9216c0b640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9210074b00 0x7f921014ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.191+0000 7f9216c0b640 1 -- 172.21.15.5:0/2282055912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921014f470 con 0x7f921014fad0 2024-05-16T21:32:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.192+0000 7f9216c0b640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f92101d79c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9208034040 tx=0x7f9208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.192+0000 7f9206ffd640 1 -- 172.21.15.5:0/2282055912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208036050 con 0x7f921014fad0 2024-05-16T21:32:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.192+0000 7f9206ffd640 1 -- 172.21.15.5:0/2282055912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208042070 con 0x7f921014fad0 2024-05-16T21:32:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.192+0000 7f9206ffd640 1 -- 172.21.15.5:0/2282055912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208009510 con 0x7f921014fad0 2024-05-16T21:32:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.192+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921014e220 con 0x7f921014fad0 2024-05-16T21:32:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.192+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92101e5c90 con 0x7f921014fad0 2024-05-16T21:32:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.193+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92100a4de0 con 0x7f921014fad0 2024-05-16T21:32:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.194+0000 7f9206ffd640 1 -- 172.21.15.5:0/2282055912 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9208007bd0 con 0x7f921014fad0 2024-05-16T21:32:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.194+0000 7f9206ffd640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f91f4076300 0x7f91f4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.194+0000 7f9206ffd640 1 -- 172.21.15.5:0/2282055912 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f92080b7f20 con 0x7f921014fad0 2024-05-16T21:32:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.194+0000 7f921640a640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f91f4076300 0x7f91f4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.195+0000 7f921640a640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f91f4076300 0x7f91f4078810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92100bba60 tx=0x7f920c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.199+0000 7f9206ffd640 1 -- 172.21.15.5:0/2282055912 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9208081580 con 0x7f921014fad0 2024-05-16T21:32:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.464+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9210050940 con 0x7f921014fad0 2024-05-16T21:32:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.465+0000 7f9206ffd640 1 -- 172.21.15.5:0/2282055912 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+5491 (secure 0 0 0) 0x7f9208085880 con 0x7f921014fad0 2024-05-16T21:32:48.467 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:48.467 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T21:32:48.467 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-05-16T21:32:48.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.467 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-05-16T21:32:48.467 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0ZmWOztIxAALEzX4EJJcrGCP7ZoZ/HKgA==", 2024-05-16T21:32:48.467 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0ZmQxKaMBAAj7Rge1mcAmfVKbNfu7fwRg==", 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-05-16T21:32:48.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0Zmqx5zKxAAcFLKr5c1bAYjCHYue1BIIw==", 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAye0ZmdkSvFxAA5+pykmX9PyzAFWdUwe/dCg==", 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA1e0ZmHAEzFxAAR/4LYW0ce5/kt+sQIGtRCQ==", 2024-05-16T21:32:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4e0ZmiV+2FxAA7jAztuHwMHlMMRORi+es0Q==", 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7e0ZmMrfwFhAA3/m/SekhouAzfw647Cgcrg==", 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA/e0ZmeRy4IhAA/JFx42eT7j6uAHRIsP35Tw==", 2024-05-16T21:32:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBCe0ZmF6NJIRAAdbIwZRW9OCyVwbiycii3ug==", 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBFe0ZmzhyfHxAAX8zeKuN/kboQKumY+LNXag==", 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBIe0ZmXi2qHRAAiIb4iVEEqACfG78J7II+Dg==", 2024-05-16T21:32:48.474 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxe0ZmPwp5BBAApGZXcUeCgiYeu7NGIhsvXg==", 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-05-16T21:32:48.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAve0ZmkNmeNRAABD/29oilXgiBr5doZhyjnQ==", 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBOe0ZmZV/aAhAAjMqxuUQdrS1nVlTPSaEAIQ==", 2024-05-16T21:32:48.476 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBOe0ZmJmjaAhAA3XflwSzfm6ryBrsFGH/KJg==", 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBOe0Zmy2/aAhAA8mRuf0mT2TC7dNMYvVnoMg==", 2024-05-16T21:32:48.477 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBOe0ZmPXfaAhAAVB8YFH3z/txPsyVFXRolBg==", 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-16T21:32:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBOe0ZmzIDaAhAA2Np4zXbi1lLpmPwe7WCIDw==", 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBOe0Zmi4jaAhAA/hLeAPAf2cTxa7ZfyfIJ1Q==", 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0ZmkHgyIBAAkoin2vsL2eoaz/QSlB72Pw==", 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-05-16T21:32:48.480 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0Zm7jz5GhAAWjyGahKoqSjedU6is2lhBQ==", 2024-05-16T21:32:48.481 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:32:48.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-05-16T21:32:48.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-05-16T21:32:48.481 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:32:48.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:48.481 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-05-16T21:32:48.481 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T21:32:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f91f4076300 msgr2=0x7f91f4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f91f4076300 0x7f91f4078810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92100bba60 tx=0x7f920c009040 comp rx=0 tx=0).stop 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 msgr2=0x7f92101d79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f92101d79c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9208034040 tx=0x7f9208004a40 comp rx=0 tx=0).stop 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 shutdown_connections 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f91f4076300 0x7f91f4078810 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f921014fad0 0x7f92101d79c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92100be3f0 0x7f921014dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 --2- 172.21.15.5:0/2282055912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9210074b00 0x7f921014ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 >> 172.21.15.5:0/2282055912 conn(0x7f92100bd0f0 msgr2=0x7f92100ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 shutdown_connections 2024-05-16T21:32:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.467+0000 7f921866e640 1 -- 172.21.15.5:0/2282055912 wait complete. 2024-05-16T21:32:48.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-16T21:32:48.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.595+0000 7fda20746640 1 Processor -- start 2024-05-16T21:32:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.595+0000 7fda20746640 1 -- start start 2024-05-16T21:32:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda20746640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fda180bf050 0x7fda18159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda20746640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1806e140 con 0x7fda180bd6d0 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda20746640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda180c36f0 con 0x7fda18151fc0 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda20746640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fda18152530 con 0x7fda180bf050 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda1dce1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fda180bd6d0 0x7fda180be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33990/0 (socket says 172.21.15.5:33990) 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda1dce1640 1 -- 172.21.15.5:0/3126903899 learned_addr learned my addr 172.21.15.5:0/3126903899 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda1ece3640 1 --2- 172.21.15.5:0/3126903899 >> v2:172.21.15.157:3300/0 conn(0x7fda180bf050 0x7fda18159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda1d4e0640 1 -- 172.21.15.5:0/3126903899 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185341203 0 0) 0x7fda08001110 con 0x7fda180bd6d0 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.596+0000 7fda1d4e0640 1 -- 172.21.15.5:0/3126903899 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda04003520 con 0x7fda180bd6d0 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.597+0000 7fda1d4e0640 1 -- 172.21.15.5:0/3126903899 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725402355 0 0) 0x7fda180c36f0 con 0x7fda18151fc0 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.597+0000 7fda1d4e0640 1 -- 172.21.15.5:0/3126903899 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda08001110 con 0x7fda18151fc0 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.597+0000 7fda1ece3640 1 -- 172.21.15.5:0/3126903899 >> v1:172.21.15.157:6789/0 conn(0x7fda18151fc0 legacy=0x7fda1806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.597+0000 7fda1ece3640 1 -- 172.21.15.5:0/3126903899 >> v1:172.21.15.5:6789/0 conn(0x7fda180bd6d0 legacy=0x7fda180be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.597+0000 7fda1ece3640 1 -- 172.21.15.5:0/3126903899 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda18152810 con 0x7fda180bf050 2024-05-16T21:32:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.597+0000 7fda1ece3640 1 --2- 172.21.15.5:0/3126903899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 0x7fda18159ea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda10009d90 tx=0x7fda1002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=919ea69fc7226b2a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda1d4e0640 1 -- 172.21.15.5:0/3126903899 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10007740 con 0x7fda180bf050 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda1d4e0640 1 -- 172.21.15.5:0/3126903899 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda100078e0 con 0x7fda180bf050 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda1d4e0640 1 -- 172.21.15.5:0/3126903899 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10007c90 con 0x7fda180bf050 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda20746640 1 -- 172.21.15.5:0/3126903899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 msgr2=0x7fda18159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda20746640 1 --2- 172.21.15.5:0/3126903899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 0x7fda18159ea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda10009d90 tx=0x7fda1002a6f0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda20746640 1 -- 172.21.15.5:0/3126903899 shutdown_connections 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda20746640 1 --2- 172.21.15.5:0/3126903899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 0x7fda18159ea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda20746640 1 -- 172.21.15.5:0/3126903899 >> 172.21.15.5:0/3126903899 conn(0x7fda180c3d20 msgr2=0x7fda180c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda20746640 1 -- 172.21.15.5:0/3126903899 shutdown_connections 2024-05-16T21:32:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.598+0000 7fda20746640 1 -- 172.21.15.5:0/3126903899 wait complete. 2024-05-16T21:32:48.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.600+0000 7fda20746640 1 Processor -- start 2024-05-16T21:32:48.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.600+0000 7fda20746640 1 -- start start 2024-05-16T21:32:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda20746640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda180bd6d0 0x7fda1814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda20746640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 0x7fda18146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda20746640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda18151fc0 0x7fda181473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda20746640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda180a2ed0 con 0x7fda180bd6d0 2024-05-16T21:32:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda20746640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fda180bdae0 con 0x7fda180bf050 2024-05-16T21:32:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda20746640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fda180a3050 con 0x7fda18151fc0 2024-05-16T21:32:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1e4e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda180bd6d0 0x7fda1814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1e4e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda180bd6d0 0x7fda1814dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44516/0 (socket says 172.21.15.5:44516) 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1e4e2640 1 -- 172.21.15.5:0/2264262417 learned_addr learned my addr 172.21.15.5:0/2264262417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1dce1640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 0x7fda18146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1ece3640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda18151fc0 0x7fda181473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1e4e2640 1 -- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda18151fc0 msgr2=0x7fda181473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1e4e2640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda18151fc0 0x7fda181473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1e4e2640 1 -- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 msgr2=0x7fda18146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1e4e2640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 0x7fda18146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.601+0000 7fda1e4e2640 1 -- 172.21.15.5:0/2264262417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1814e2a0 con 0x7fda180bd6d0 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.602+0000 7fda1dce1640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 0x7fda18146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.602+0000 7fda1e4e2640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda180bd6d0 0x7fda1814dd60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c460 tx=0x7fda1400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.602+0000 7fda0effd640 1 -- 172.21.15.5:0/2264262417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140052d0 con 0x7fda180bd6d0 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.602+0000 7fda0effd640 1 -- 172.21.15.5:0/2264262417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda14005490 con 0x7fda180bd6d0 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.602+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda18146650 con 0x7fda180bd6d0 2024-05-16T21:32:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.602+0000 7fda0effd640 1 -- 172.21.15.5:0/2264262417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14012870 con 0x7fda180bd6d0 2024-05-16T21:32:48.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.602+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda181e7b40 con 0x7fda180bd6d0 2024-05-16T21:32:48.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.603+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda18146820 con 0x7fda180bd6d0 2024-05-16T21:32:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.603+0000 7fda0effd640 1 -- 172.21.15.5:0/2264262417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda14012a10 con 0x7fda180bd6d0 2024-05-16T21:32:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.604+0000 7fda0effd640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9fc0762d0 0x7fd9fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.604+0000 7fda0effd640 1 -- 172.21.15.5:0/2264262417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fda14096e60 con 0x7fda180bd6d0 2024-05-16T21:32:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.604+0000 7fda1dce1640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9fc0762d0 0x7fd9fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.605+0000 7fda1dce1640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9fc0762d0 0x7fd9fc0787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda08000c00 tx=0x7fda08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.609+0000 7fda0effd640 1 -- 172.21.15.5:0/2264262417 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fda14060b00 con 0x7fda180bd6d0 2024-05-16T21:32:48.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.880+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fda180bed90 con 0x7fda180bd6d0 2024-05-16T21:32:48.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.883+0000 7fda0effd640 1 -- 172.21.15.5:0/2264262417 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fda14060400 con 0x7fda180bd6d0 2024-05-16T21:32:48.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9fc0762d0 msgr2=0x7fd9fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9fc0762d0 0x7fd9fc0787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda08000c00 tx=0x7fda08009040 comp rx=0 tx=0).stop 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda180bd6d0 msgr2=0x7fda1814dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda180bd6d0 0x7fda1814dd60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c460 tx=0x7fda1400c920 comp rx=0 tx=0).stop 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 shutdown_connections 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9fc0762d0 0x7fd9fc0787e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda18151fc0 0x7fda181473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda180bf050 0x7fda18146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 --2- 172.21.15.5:0/2264262417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda180bd6d0 0x7fda1814dd60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 >> 172.21.15.5:0/2264262417 conn(0x7fda180c3d20 msgr2=0x7fda180c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 shutdown_connections 2024-05-16T21:32:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:48.885+0000 7fda20746640 1 -- 172.21.15.5:0/2264262417 wait complete. 2024-05-16T21:32:48.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-16T21:32:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.009+0000 7fc6db484640 1 Processor -- start 2024-05-16T21:32:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.009+0000 7fc6db484640 1 -- start start 2024-05-16T21:32:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.010+0000 7fc6db484640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6d40b8d70 0x7fc6d40b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.010+0000 7fc6db484640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d414ece0 con 0x7fc6d40bd440 2024-05-16T21:32:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.010+0000 7fc6db484640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d414efc0 con 0x7fc6d414e530 2024-05-16T21:32:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.010+0000 7fc6db484640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc6d40b88e0 con 0x7fc6d40b8d70 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.011+0000 7fc6d9a21640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6d40b8d70 0x7fc6d40b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.011+0000 7fc6d8a1f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc6d40bd440 0x7fc6d40bd850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34000/0 (socket says 172.21.15.5:34000) 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.011+0000 7fc6d8a1f640 1 -- 172.21.15.5:0/3530183003 learned_addr learned my addr 172.21.15.5:0/3530183003 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.011+0000 7fc6d9a21640 1 -- 172.21.15.5:0/3530183003 >> v1:172.21.15.157:6789/0 conn(0x7fc6d414e530 legacy=0x7fc6d40ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.011+0000 7fc6d9a21640 1 -- 172.21.15.5:0/3530183003 >> v1:172.21.15.5:6789/0 conn(0x7fc6d40bd440 legacy=0x7fc6d40bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.011+0000 7fc6d9a21640 1 -- 172.21.15.5:0/3530183003 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d414f2a0 con 0x7fc6d40b8d70 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.012+0000 7fc6d9a21640 1 --2- 172.21.15.5:0/3530183003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d40b9180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009d90 tx=0x7fc6cc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b9a5639b4e82e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.012+0000 7fc6cbfff640 1 -- 172.21.15.5:0/3530183003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc007740 con 0x7fc6d40b8d70 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.012+0000 7fc6cbfff640 1 -- 172.21.15.5:0/3530183003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6cc0078e0 con 0x7fc6d40b8d70 2024-05-16T21:32:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.012+0000 7fc6cbfff640 1 -- 172.21.15.5:0/3530183003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc007cb0 con 0x7fc6d40b8d70 2024-05-16T21:32:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.013+0000 7fc6db484640 1 -- 172.21.15.5:0/3530183003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 msgr2=0x7fc6d40b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.013+0000 7fc6db484640 1 --2- 172.21.15.5:0/3530183003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d40b9180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009d90 tx=0x7fc6cc02a6f0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.013+0000 7fc6db484640 1 -- 172.21.15.5:0/3530183003 shutdown_connections 2024-05-16T21:32:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.013+0000 7fc6db484640 1 --2- 172.21.15.5:0/3530183003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d40b9180 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.013+0000 7fc6db484640 1 -- 172.21.15.5:0/3530183003 >> 172.21.15.5:0/3530183003 conn(0x7fc6d40c0570 msgr2=0x7fc6d40c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.013+0000 7fc6db484640 1 -- 172.21.15.5:0/3530183003 shutdown_connections 2024-05-16T21:32:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.013+0000 7fc6db484640 1 -- 172.21.15.5:0/3530183003 wait complete. 2024-05-16T21:32:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.014+0000 7fc6db484640 1 Processor -- start 2024-05-16T21:32:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.014+0000 7fc6db484640 1 -- start start 2024-05-16T21:32:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.015+0000 7fc6db484640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d414bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.015+0000 7fc6db484640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d40bd440 0x7fc6d414a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.015+0000 7fc6db484640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d414e530 0x7fc6d4073ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.015+0000 7fc6db484640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d414e940 con 0x7fc6d40b8d70 2024-05-16T21:32:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.015+0000 7fc6db484640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d40b96c0 con 0x7fc6d414e530 2024-05-16T21:32:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.015+0000 7fc6db484640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d414eac0 con 0x7fc6d40bd440 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d414bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d414bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44538/0 (socket says 172.21.15.5:44538) 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 -- 172.21.15.5:0/2790783418 learned_addr learned my addr 172.21.15.5:0/2790783418 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9a21640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d414e530 0x7fc6d4073ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d8a1f640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d40bd440 0x7fc6d414a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 -- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d40bd440 msgr2=0x7fc6d414a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d40bd440 0x7fc6d414a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 -- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d414e530 msgr2=0x7fc6d4073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d414e530 0x7fc6d4073ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 -- 172.21.15.5:0/2790783418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d414b880 con 0x7fc6d40b8d70 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9a21640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d414e530 0x7fc6d4073ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6d9220640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d414bd30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c3f0 tx=0x7fc6d000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6c9ffb640 1 -- 172.21.15.5:0/2790783418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0017070 con 0x7fc6d40b8d70 2024-05-16T21:32:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6c9ffb640 1 -- 172.21.15.5:0/2790783418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d00052d0 con 0x7fc6d40b8d70 2024-05-16T21:32:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6c9ffb640 1 -- 172.21.15.5:0/2790783418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0003640 con 0x7fc6d40b8d70 2024-05-16T21:32:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d4074530 con 0x7fc6d40b8d70 2024-05-16T21:32:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.016+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d4149060 con 0x7fc6d40b8d70 2024-05-16T21:32:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.017+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d4069b80 con 0x7fc6d40b8d70 2024-05-16T21:32:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.018+0000 7fc6c9ffb640 1 -- 172.21.15.5:0/2790783418 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc6d001a070 con 0x7fc6d40b8d70 2024-05-16T21:32:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.018+0000 7fc6c9ffb640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6b8076300 0x7fc6b8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.019+0000 7fc6c9ffb640 1 -- 172.21.15.5:0/2790783418 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fc6d00964e0 con 0x7fc6d40b8d70 2024-05-16T21:32:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.019+0000 7fc6d8a1f640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6b8076300 0x7fc6b8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.019+0000 7fc6d8a1f640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6b8076300 0x7fc6b8078810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4146500 tx=0x7fc6c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.023+0000 7fc6c9ffb640 1 -- 172.21.15.5:0/2790783418 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc6d005faa0 con 0x7fc6d40b8d70 2024-05-16T21:32:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.294+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fc6d4050940 con 0x7fc6d40b8d70 2024-05-16T21:32:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.296+0000 7fc6c9ffb640 1 -- 172.21.15.5:0/2790783418 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fc6d00680e0 con 0x7fc6d40b8d70 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6b8076300 msgr2=0x7fc6b8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6b8076300 0x7fc6b8078810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4146500 tx=0x7fc6c4009040 comp rx=0 tx=0).stop 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 msgr2=0x7fc6d414bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d414bd30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c3f0 tx=0x7fc6d000c8b0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 shutdown_connections 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6b8076300 0x7fc6b8078810 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d414e530 0x7fc6d4073ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d40bd440 0x7fc6d414a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 --2- 172.21.15.5:0/2790783418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d40b8d70 0x7fc6d414bd30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 >> 172.21.15.5:0/2790783418 conn(0x7fc6d40c0570 msgr2=0x7fc6d40c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 shutdown_connections 2024-05-16T21:32:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.299+0000 7fc6db484640 1 -- 172.21.15.5:0/2790783418 wait complete. 2024-05-16T21:32:49.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-16T21:32:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.422+0000 7f938b661640 1 Processor -- start 2024-05-16T21:32:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.422+0000 7f938b661640 1 -- start start 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.423+0000 7f938b661640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9384148770 0x7f93840c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.423+0000 7f938b661640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93840bf9b0 0x7f93840bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.423+0000 7f938b661640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93840c0620 con 0x7f938414e360 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f938b661640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9384151e40 con 0x7f93840bf9b0 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f938b661640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9384151ad0 con 0x7f9384148770 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f9389bfe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93840bf9b0 0x7f93840bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f9389bfe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93840bf9b0 0x7f93840bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44552/0 (socket says 172.21.15.5:44552) 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f9389bfe640 1 -- 172.21.15.5:0/2033193371 learned_addr learned my addr 172.21.15.5:0/2033193371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f9388bfc640 1 --2- 172.21.15.5:0/2033193371 >> v2:172.21.15.157:3300/0 conn(0x7f9384148770 0x7f93840c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f9389bfe640 1 -- 172.21.15.5:0/2033193371 >> v2:172.21.15.157:3300/0 conn(0x7f9384148770 msgr2=0x7f93840c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f9389bfe640 1 --2- 172.21.15.5:0/2033193371 >> v2:172.21.15.157:3300/0 conn(0x7f9384148770 0x7f93840c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f9389bfe640 1 -- 172.21.15.5:0/2033193371 >> v1:172.21.15.157:6789/0 conn(0x7f938414e360 legacy=0x7f93841522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.424+0000 7f9389bfe640 1 -- 172.21.15.5:0/2033193371 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93840c0300 con 0x7f93840bf9b0 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.425+0000 7f9389bfe640 1 --2- 172.21.15.5:0/2033193371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93840bf9b0 0x7f93840bfdc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9374009e50 tx=0x7f937402a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6eddd0fd90e0ea server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.425+0000 7f9383fff640 1 -- 172.21.15.5:0/2033193371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374036070 con 0x7f93840bf9b0 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.425+0000 7f9383fff640 1 -- 172.21.15.5:0/2033193371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9374031600 con 0x7f93840bf9b0 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.425+0000 7f9383fff640 1 -- 172.21.15.5:0/2033193371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93740319d0 con 0x7f93840bf9b0 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.426+0000 7f938b661640 1 -- 172.21.15.5:0/2033193371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93840bf9b0 msgr2=0x7f93840bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.426+0000 7f938b661640 1 --2- 172.21.15.5:0/2033193371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93840bf9b0 0x7f93840bfdc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9374009e50 tx=0x7f937402a7f0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.426+0000 7f938b661640 1 -- 172.21.15.5:0/2033193371 shutdown_connections 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.426+0000 7f938b661640 1 --2- 172.21.15.5:0/2033193371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93840bf9b0 0x7f93840bfdc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.426+0000 7f938b661640 1 --2- 172.21.15.5:0/2033193371 >> v2:172.21.15.157:3300/0 conn(0x7f9384148770 0x7f93840c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.426+0000 7f938b661640 1 -- 172.21.15.5:0/2033193371 >> 172.21.15.5:0/2033193371 conn(0x7f93840c17c0 msgr2=0x7f93840c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.426+0000 7f938b661640 1 -- 172.21.15.5:0/2033193371 shutdown_connections 2024-05-16T21:32:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.426+0000 7f938b661640 1 -- 172.21.15.5:0/2033193371 wait complete. 2024-05-16T21:32:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.427+0000 7f938b661640 1 Processor -- start 2024-05-16T21:32:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.427+0000 7f938b661640 1 -- start start 2024-05-16T21:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f938b661640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93840bf9b0 0x7f9384071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f938b661640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9384148770 0x7f9384143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f938b661640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938414e360 0x7f93841441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f938b661640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9384158cc0 con 0x7f938414e360 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f938b661640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f93840c13d0 con 0x7f93840bf9b0 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f938b661640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9384158e40 con 0x7f9384148770 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f9389bfe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938414e360 0x7f93841441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f9389bfe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938414e360 0x7f93841441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44558/0 (socket says 172.21.15.5:44558) 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.428+0000 7f9389bfe640 1 -- 172.21.15.5:0/4010645162 learned_addr learned my addr 172.21.15.5:0/4010645162 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f93893fd640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93840bf9b0 0x7f9384071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9388bfc640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9384148770 0x7f9384143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9389bfe640 1 -- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9384148770 msgr2=0x7f9384143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9389bfe640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9384148770 0x7f9384143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9389bfe640 1 -- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93840bf9b0 msgr2=0x7f9384071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9389bfe640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93840bf9b0 0x7f9384071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9389bfe640 1 -- 172.21.15.5:0/4010645162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9384071a60 con 0x7f938414e360 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9389bfe640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938414e360 0x7f93841441e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f937402ade0 tx=0x7f9374004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9381ffb640 1 -- 172.21.15.5:0/4010645162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374036040 con 0x7f938414e360 2024-05-16T21:32:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9381ffb640 1 -- 172.21.15.5:0/4010645162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9374041070 con 0x7f938414e360 2024-05-16T21:32:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93840b8830 con 0x7f938414e360 2024-05-16T21:32:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f9381ffb640 1 -- 172.21.15.5:0/4010645162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374009510 con 0x7f938414e360 2024-05-16T21:32:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.429+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9384151200 con 0x7f938414e360 2024-05-16T21:32:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.431+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938414f280 con 0x7f938414e360 2024-05-16T21:32:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.431+0000 7f9381ffb640 1 -- 172.21.15.5:0/4010645162 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93740079e0 con 0x7f938414e360 2024-05-16T21:32:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.431+0000 7f9381ffb640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93700762d0 0x7f93700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.432+0000 7f9381ffb640 1 -- 172.21.15.5:0/4010645162 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f93740b7aa0 con 0x7f938414e360 2024-05-16T21:32:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.432+0000 7f93893fd640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93700762d0 0x7f93700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.432+0000 7f93893fd640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93700762d0 0x7f93700787e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f937c001720 tx=0x7f937c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.436+0000 7f9381ffb640 1 -- 172.21.15.5:0/4010645162 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93840b8830 con 0x7f938414e360 2024-05-16T21:32:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.702+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f9384050940 con 0x7f938414e360 2024-05-16T21:32:49.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.704+0000 7f9381ffb640 1 -- 172.21.15.5:0/4010645162 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f9374081100 con 0x7f938414e360 2024-05-16T21:32:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93700762d0 msgr2=0x7f93700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93700762d0 0x7f93700787e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f937c001720 tx=0x7f937c009040 comp rx=0 tx=0).stop 2024-05-16T21:32:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938414e360 msgr2=0x7f93841441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938414e360 0x7f93841441e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f937402ade0 tx=0x7f9374004a40 comp rx=0 tx=0).stop 2024-05-16T21:32:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 shutdown_connections 2024-05-16T21:32:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93700762d0 0x7f93700787e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938414e360 0x7f93841441e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9384148770 0x7f9384143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 --2- 172.21.15.5:0/4010645162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93840bf9b0 0x7f9384071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 >> 172.21.15.5:0/4010645162 conn(0x7f93840c17c0 msgr2=0x7f93840a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 shutdown_connections 2024-05-16T21:32:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.706+0000 7f938b661640 1 -- 172.21.15.5:0/4010645162 wait complete. 2024-05-16T21:32:49.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-16T21:32:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.829+0000 7fc5a4c6e640 1 Processor -- start 2024-05-16T21:32:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.829+0000 7fc5a4c6e640 1 -- start start 2024-05-16T21:32:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc5a4c6e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a006c6e0 0x7fc5a0074a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc5a4c6e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5a01519c0 0x7fc5a014ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc5a4c6e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5a00bf010 0x7fc5a00730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc5a4c6e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a014f480 con 0x7fc5a00bf010 2024-05-16T21:32:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc5a4c6e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a006cfe0 con 0x7fc5a01519c0 2024-05-16T21:32:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc5a4c6e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a006cd00 con 0x7fc5a006c6e0 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5a00bf010 0x7fc5a00730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5a00bf010 0x7fc5a00730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44574/0 (socket says 172.21.15.5:44574) 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59ed9d640 1 -- 172.21.15.5:0/2124714706 learned_addr learned my addr 172.21.15.5:0/2124714706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59dd9b640 1 --2- 172.21.15.5:0/2124714706 >> v2:172.21.15.157:3300/0 conn(0x7fc5a01519c0 0x7fc5a014ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59e59c640 1 --2- 172.21.15.5:0/2124714706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a006c6e0 0x7fc5a0074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59ed9d640 1 -- 172.21.15.5:0/2124714706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a006c6e0 msgr2=0x7fc5a0074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59ed9d640 1 --2- 172.21.15.5:0/2124714706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a006c6e0 0x7fc5a0074a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59ed9d640 1 -- 172.21.15.5:0/2124714706 >> v2:172.21.15.157:3300/0 conn(0x7fc5a01519c0 msgr2=0x7fc5a014ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59ed9d640 1 --2- 172.21.15.5:0/2124714706 >> v2:172.21.15.157:3300/0 conn(0x7fc5a01519c0 0x7fc5a014ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59ed9d640 1 -- 172.21.15.5:0/2124714706 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a0074210 con 0x7fc5a00bf010 2024-05-16T21:32:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.831+0000 7fc59dd9b640 1 --2- 172.21.15.5:0/2124714706 >> v2:172.21.15.157:3300/0 conn(0x7fc5a01519c0 0x7fc5a014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.832+0000 7fc59ed9d640 1 --2- 172.21.15.5:0/2124714706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a00bf010 0x7fc5a00730b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc5a006f150 tx=0x7fc59002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2629001b02e8833f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.832+0000 7fc59d59a640 1 -- 172.21.15.5:0/2124714706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590036070 con 0x7fc5a00bf010 2024-05-16T21:32:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.832+0000 7fc59d59a640 1 -- 172.21.15.5:0/2124714706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc590031600 con 0x7fc5a00bf010 2024-05-16T21:32:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.832+0000 7fc59d59a640 1 -- 172.21.15.5:0/2124714706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5900319d0 con 0x7fc5a00bf010 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/2124714706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a00bf010 msgr2=0x7fc5a00730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/2124714706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a00bf010 0x7fc5a00730b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc5a006f150 tx=0x7fc59002a730 comp rx=0 tx=0).stop 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/2124714706 shutdown_connections 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/2124714706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a00bf010 0x7fc5a00730b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/2124714706 >> v2:172.21.15.157:3300/0 conn(0x7fc5a01519c0 0x7fc5a014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/2124714706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a006c6e0 0x7fc5a0074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/2124714706 >> 172.21.15.5:0/2124714706 conn(0x7fc5a00bd0f0 msgr2=0x7fc5a00bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/2124714706 shutdown_connections 2024-05-16T21:32:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.833+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/2124714706 wait complete. 2024-05-16T21:32:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.835+0000 7fc5a4c6e640 1 Processor -- start 2024-05-16T21:32:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.835+0000 7fc5a4c6e640 1 -- start start 2024-05-16T21:32:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc5a4c6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a006c6e0 0x7fc5a014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc5a4c6e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a00bf010 0x7fc5a01e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc5a4c6e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a01519c0 0x7fc5a0150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc5a4c6e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00be460 con 0x7fc5a006c6e0 2024-05-16T21:32:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc5a4c6e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a0151dd0 con 0x7fc5a00bf010 2024-05-16T21:32:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc5a4c6e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a00be5e0 con 0x7fc5a01519c0 2024-05-16T21:32:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a006c6e0 0x7fc5a014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a006c6e0 0x7fc5a014fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44584/0 (socket says 172.21.15.5:44584) 2024-05-16T21:32:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 -- 172.21.15.5:0/952628214 learned_addr learned my addr 172.21.15.5:0/952628214 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59dd9b640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a00bf010 0x7fc5a01e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59ed9d640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a01519c0 0x7fc5a0150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 -- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a01519c0 msgr2=0x7fc5a0150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a01519c0 0x7fc5a0150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 -- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a00bf010 msgr2=0x7fc5a01e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a00bf010 0x7fc5a01e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 -- 172.21.15.5:0/952628214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a0150060 con 0x7fc5a006c6e0 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59dd9b640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a00bf010 0x7fc5a01e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc59e59c640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a006c6e0 0x7fc5a014fb20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc59800d800 tx=0x7fc59800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc596ffd640 1 -- 172.21.15.5:0/952628214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598018030 con 0x7fc5a006c6e0 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc596ffd640 1 -- 172.21.15.5:0/952628214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5980096a0 con 0x7fc5a006c6e0 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc596ffd640 1 -- 172.21.15.5:0/952628214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598009870 con 0x7fc5a006c6e0 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.836+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a01e4f10 con 0x7fc5a006c6e0 2024-05-16T21:32:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.837+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a01e41d0 con 0x7fc5a006c6e0 2024-05-16T21:32:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.837+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a0069b50 con 0x7fc5a006c6e0 2024-05-16T21:32:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.838+0000 7fc596ffd640 1 -- 172.21.15.5:0/952628214 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc59801b070 con 0x7fc5a006c6e0 2024-05-16T21:32:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.839+0000 7fc596ffd640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc580076300 0x7fc580078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.839+0000 7fc596ffd640 1 -- 172.21.15.5:0/952628214 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fc5980974f0 con 0x7fc5a006c6e0 2024-05-16T21:32:49.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.839+0000 7fc59dd9b640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc580076300 0x7fc580078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:49.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.839+0000 7fc59dd9b640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc580076300 0x7fc580078810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5a014a6f0 tx=0x7fc588008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:49.843+0000 7fc596ffd640 1 -- 172.21.15.5:0/952628214 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc5980611a0 con 0x7fc5a006c6e0 2024-05-16T21:32:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.108+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fc5a00bcb60 con 0x7fc5a006c6e0 2024-05-16T21:32:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.110+0000 7fc596ffd640 1 -- 172.21.15.5:0/952628214 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fc598060aa0 con 0x7fc5a006c6e0 2024-05-16T21:32:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc580076300 msgr2=0x7fc580078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc580076300 0x7fc580078810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5a014a6f0 tx=0x7fc588008040 comp rx=0 tx=0).stop 2024-05-16T21:32:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a006c6e0 msgr2=0x7fc5a014fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a006c6e0 0x7fc5a014fb20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc59800d800 tx=0x7fc59800dcc0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 shutdown_connections 2024-05-16T21:32:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc580076300 0x7fc580078810 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5a01519c0 0x7fc5a0150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a00bf010 0x7fc5a01e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 --2- 172.21.15.5:0/952628214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a006c6e0 0x7fc5a014fb20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 >> 172.21.15.5:0/952628214 conn(0x7fc5a00bd0f0 msgr2=0x7fc5a00bb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 shutdown_connections 2024-05-16T21:32:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.112+0000 7fc5a4c6e640 1 -- 172.21.15.5:0/952628214 wait complete. 2024-05-16T21:32:50.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-16T21:32:50.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.235+0000 7fd07fd3f640 1 Processor -- start 2024-05-16T21:32:50.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.235+0000 7fd07fd3f640 1 -- start start 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.236+0000 7fd07fd3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0780be4f0 0x7fd0780bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07fd3f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd07814d0f0 0x7fd078156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07fd3f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0780720d0 con 0x7fd07814cce0 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07fd3f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd0780bfa60 con 0x7fd07814d0f0 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07fd3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd078071310 con 0x7fd0780be4f0 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07e2dc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd07814d0f0 0x7fd078156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07dadb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0780be4f0 0x7fd0780bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07d2da640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd07814cce0 0x7fd0780716a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:44148/0 (socket says 172.21.15.5:44148) 2024-05-16T21:32:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07d2da640 1 -- 172.21.15.5:0/3523884791 learned_addr learned my addr 172.21.15.5:0/3523884791 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07dadb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0780be4f0 0x7fd0780bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:52546/0 (socket says 172.21.15.5:52546) 2024-05-16T21:32:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07e2dc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd07814d0f0 0x7fd078156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:56088/0 (socket says 172.21.15.5:56088) 2024-05-16T21:32:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07dadb640 1 -- 172.21.15.5:0/3523884791 >> v2:172.21.15.157:3300/0 conn(0x7fd07814d0f0 msgr2=0x7fd078156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07dadb640 1 --2- 172.21.15.5:0/3523884791 >> v2:172.21.15.157:3300/0 conn(0x7fd07814d0f0 0x7fd078156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07dadb640 1 -- 172.21.15.5:0/3523884791 >> v1:172.21.15.157:6789/0 conn(0x7fd07814cce0 legacy=0x7fd0780716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07dadb640 1 -- 172.21.15.5:0/3523884791 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0780bf6f0 con 0x7fd0780be4f0 2024-05-16T21:32:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.237+0000 7fd07e2dc640 1 --2- 172.21.15.5:0/3523884791 >> v2:172.21.15.157:3300/0 conn(0x7fd07814d0f0 0x7fd078156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:50.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.238+0000 7fd07dadb640 1 --2- 172.21.15.5:0/3523884791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0780be4f0 0x7fd0780bfef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0700097a0 tx=0x7fd07002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c01a1ec2e728f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:50.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.238+0000 7fd07cad9640 1 -- 172.21.15.5:0/3523884791 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070037070 con 0x7fd0780be4f0 2024-05-16T21:32:50.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.238+0000 7fd07cad9640 1 -- 172.21.15.5:0/3523884791 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07002ae50 con 0x7fd0780be4f0 2024-05-16T21:32:50.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.238+0000 7fd07cad9640 1 -- 172.21.15.5:0/3523884791 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070032660 con 0x7fd0780be4f0 2024-05-16T21:32:50.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.239+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3523884791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0780be4f0 msgr2=0x7fd0780bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.239+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3523884791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0780be4f0 0x7fd0780bfef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0700097a0 tx=0x7fd07002a100 comp rx=0 tx=0).stop 2024-05-16T21:32:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.239+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3523884791 shutdown_connections 2024-05-16T21:32:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.239+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3523884791 >> v2:172.21.15.157:3300/0 conn(0x7fd07814d0f0 0x7fd078156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.239+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3523884791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0780be4f0 0x7fd0780bfef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.239+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3523884791 >> 172.21.15.5:0/3523884791 conn(0x7fd0780c17c0 msgr2=0x7fd0780c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.239+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3523884791 shutdown_connections 2024-05-16T21:32:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.239+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3523884791 wait complete. 2024-05-16T21:32:50.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.241+0000 7fd07fd3f640 1 Processor -- start 2024-05-16T21:32:50.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.241+0000 7fd07fd3f640 1 -- start start 2024-05-16T21:32:50.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07fd3f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0780be4f0 0x7fd07809ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07fd3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd07814cce0 0x7fd078143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07fd3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd07814d0f0 0x7fd078140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07fd3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd078071db0 con 0x7fd07814d0f0 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07fd3f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd0780723b0 con 0x7fd0780be4f0 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07fd3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd0780c0430 con 0x7fd07814cce0 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd07814d0f0 0x7fd078140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd07814d0f0 0x7fd078140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44590/0 (socket says 172.21.15.5:44590) 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 -- 172.21.15.5:0/3896541350 learned_addr learned my addr 172.21.15.5:0/3896541350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07dadb640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0780be4f0 0x7fd07809ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07d2da640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd07814cce0 0x7fd078143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 -- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd07814cce0 msgr2=0x7fd078143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd07814cce0 0x7fd078143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 -- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0780be4f0 msgr2=0x7fd07809ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0780be4f0 0x7fd07809ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 -- 172.21.15.5:0/3896541350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0780a0470 con 0x7fd07814d0f0 2024-05-16T21:32:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07dadb640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0780be4f0 0x7fd07809ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd07e2dc640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd07814d0f0 0x7fd078140e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd068009e10 tx=0x7fd06800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.242+0000 7fd0767fc640 1 -- 172.21.15.5:0/3896541350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068018020 con 0x7fd07814d0f0 2024-05-16T21:32:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.243+0000 7fd0767fc640 1 -- 172.21.15.5:0/3896541350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd068014480 con 0x7fd07814d0f0 2024-05-16T21:32:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.243+0000 7fd0767fc640 1 -- 172.21.15.5:0/3896541350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068014850 con 0x7fd07814d0f0 2024-05-16T21:32:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.243+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd078142890 con 0x7fd07814d0f0 2024-05-16T21:32:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.243+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd078141ff0 con 0x7fd07814d0f0 2024-05-16T21:32:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.243+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0780a5e20 con 0x7fd07814d0f0 2024-05-16T21:32:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.244+0000 7fd0767fc640 1 -- 172.21.15.5:0/3896541350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd068005d10 con 0x7fd07814d0f0 2024-05-16T21:32:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.245+0000 7fd0767fc640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd0640762d0 0x7fd0640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.245+0000 7fd0767fc640 1 -- 172.21.15.5:0/3896541350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fd068097f80 con 0x7fd07814d0f0 2024-05-16T21:32:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.245+0000 7fd07dadb640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd0640762d0 0x7fd0640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.245+0000 7fd07dadb640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd0640762d0 0x7fd0640787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd070034000 tx=0x7fd07002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:50.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.249+0000 7fd0767fc640 1 -- 172.21.15.5:0/3896541350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd068022030 con 0x7fd07814d0f0 2024-05-16T21:32:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.516+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fd0780a4070 con 0x7fd07814d0f0 2024-05-16T21:32:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.518+0000 7fd0767fc640 1 -- 172.21.15.5:0/3896541350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7fd068010040 con 0x7fd07814d0f0 2024-05-16T21:32:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd0640762d0 msgr2=0x7fd0640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd0640762d0 0x7fd0640787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd070034000 tx=0x7fd07002e000 comp rx=0 tx=0).stop 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd07814d0f0 msgr2=0x7fd078140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd07814d0f0 0x7fd078140e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd068009e10 tx=0x7fd06800c490 comp rx=0 tx=0).stop 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 shutdown_connections 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd0640762d0 0x7fd0640787e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd07814d0f0 0x7fd078140e20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd07814cce0 0x7fd078143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 --2- 172.21.15.5:0/3896541350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0780be4f0 0x7fd07809ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 >> 172.21.15.5:0/3896541350 conn(0x7fd0780c17c0 msgr2=0x7fd078149ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 shutdown_connections 2024-05-16T21:32:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.520+0000 7fd07fd3f640 1 -- 172.21.15.5:0/3896541350 wait complete. 2024-05-16T21:32:50.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-16T21:32:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.643+0000 7f7250334640 1 Processor -- start 2024-05-16T21:32:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.643+0000 7f7250334640 1 -- start start 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f7250334640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7248151fc0 0x7f72480bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f7250334640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f724806da30 0x7f72480be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f7250334640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f724806de40 0x7f72480bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f7250334640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f72480bdc10 con 0x7f724806da30 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f7250334640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f72480c36f0 con 0x7f724806de40 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f7250334640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7248152530 con 0x7f7248151fc0 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724d8cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f724806da30 0x7f72480be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724d8cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f724806da30 0x7f72480be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44604/0 (socket says 172.21.15.5:44604) 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724d8cf640 1 -- 172.21.15.5:0/549141846 learned_addr learned my addr 172.21.15.5:0/549141846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724e8d1640 1 --2- 172.21.15.5:0/549141846 >> v2:172.21.15.157:3300/0 conn(0x7f724806de40 0x7f72480bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724d8cf640 1 -- 172.21.15.5:0/549141846 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7248151fc0 msgr2=0x7f72480bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724e0d0640 1 --2- 172.21.15.5:0/549141846 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7248151fc0 0x7f72480bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724d8cf640 1 --2- 172.21.15.5:0/549141846 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7248151fc0 0x7f72480bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724d8cf640 1 -- 172.21.15.5:0/549141846 >> v2:172.21.15.157:3300/0 conn(0x7f724806de40 msgr2=0x7f72480bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724d8cf640 1 --2- 172.21.15.5:0/549141846 >> v2:172.21.15.157:3300/0 conn(0x7f724806de40 0x7f72480bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724d8cf640 1 -- 172.21.15.5:0/549141846 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7248152810 con 0x7f724806da30 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724e8d1640 1 --2- 172.21.15.5:0/549141846 >> v2:172.21.15.157:3300/0 conn(0x7f724806de40 0x7f72480bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.645+0000 7f724e0d0640 1 --2- 172.21.15.5:0/549141846 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7248151fc0 0x7f72480bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.646+0000 7f724d8cf640 1 --2- 172.21.15.5:0/549141846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806da30 0x7f72480be940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72480b7360 tx=0x7f723c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba92fa8324b6ea5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.646+0000 7f724d0ce640 1 -- 172.21.15.5:0/549141846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c037070 con 0x7f724806da30 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.646+0000 7f724d0ce640 1 -- 172.21.15.5:0/549141846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f723c032440 con 0x7f724806da30 2024-05-16T21:32:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.646+0000 7f724d0ce640 1 -- 172.21.15.5:0/549141846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c032810 con 0x7f724806da30 2024-05-16T21:32:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 -- 172.21.15.5:0/549141846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806da30 msgr2=0x7f72480be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 --2- 172.21.15.5:0/549141846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806da30 0x7f72480be940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72480b7360 tx=0x7f723c02a1e0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 -- 172.21.15.5:0/549141846 shutdown_connections 2024-05-16T21:32:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 --2- 172.21.15.5:0/549141846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806da30 0x7f72480be940 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 --2- 172.21.15.5:0/549141846 >> v2:172.21.15.157:3300/0 conn(0x7f724806de40 0x7f72480bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 --2- 172.21.15.5:0/549141846 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7248151fc0 0x7f72480bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 -- 172.21.15.5:0/549141846 >> 172.21.15.5:0/549141846 conn(0x7f72480c3d20 msgr2=0x7f72480c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 -- 172.21.15.5:0/549141846 shutdown_connections 2024-05-16T21:32:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.647+0000 7f7250334640 1 -- 172.21.15.5:0/549141846 wait complete. 2024-05-16T21:32:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.648+0000 7f7250334640 1 Processor -- start 2024-05-16T21:32:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.648+0000 7f7250334640 1 -- start start 2024-05-16T21:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.649+0000 7f7250334640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f724806da30 0x7f72481d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.649+0000 7f7250334640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806de40 0x7f72481d7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.649+0000 7f7250334640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7248151fc0 0x7f72481e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.649+0000 7f7250334640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72480a3050 con 0x7f724806de40 2024-05-16T21:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.649+0000 7f7250334640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f72480a2ed0 con 0x7f7248151fc0 2024-05-16T21:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.649+0000 7f7250334640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f724814e570 con 0x7f724806da30 2024-05-16T21:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.649+0000 7f724d8cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806de40 0x7f72481d7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724d8cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806de40 0x7f72481d7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44612/0 (socket says 172.21.15.5:44612) 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724d8cf640 1 -- 172.21.15.5:0/2075316762 learned_addr learned my addr 172.21.15.5:0/2075316762 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724e0d0640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f724806da30 0x7f72481d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724e8d1640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7248151fc0 0x7f72481e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724d8cf640 1 -- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f724806da30 msgr2=0x7f72481d98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724d8cf640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f724806da30 0x7f72481d98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724d8cf640 1 -- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7248151fc0 msgr2=0x7f72481e4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724d8cf640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7248151fc0 0x7f72481e4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724d8cf640 1 -- 172.21.15.5:0/2075316762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72481d9e30 con 0x7f724806de40 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f724d8cf640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806de40 0x7f72481d7f10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f723c02a220 tx=0x7f723c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f7246ffd640 1 -- 172.21.15.5:0/2075316762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c037040 con 0x7f724806de40 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f7246ffd640 1 -- 172.21.15.5:0/2075316762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f723c042070 con 0x7f724806de40 2024-05-16T21:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f7246ffd640 1 -- 172.21.15.5:0/2075316762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c030bb0 con 0x7f724806de40 2024-05-16T21:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72481db4b0 con 0x7f724806de40 2024-05-16T21:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.650+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72480a2830 con 0x7f724806de40 2024-05-16T21:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.651+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7248050940 con 0x7f724806de40 2024-05-16T21:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.652+0000 7f7246ffd640 1 -- 172.21.15.5:0/2075316762 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f723c047460 con 0x7f724806de40 2024-05-16T21:32:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.652+0000 7f7246ffd640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f72340762d0 0x7f72340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.652+0000 7f7246ffd640 1 -- 172.21.15.5:0/2075316762 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f723c0b7eb0 con 0x7f724806de40 2024-05-16T21:32:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.653+0000 7f724e0d0640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f72340762d0 0x7f72340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.653+0000 7f724e0d0640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f72340762d0 0x7f72340787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f724000aac0 tx=0x7f7240008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.657+0000 7f7246ffd640 1 -- 172.21.15.5:0/2075316762 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f723c081480 con 0x7f724806de40 2024-05-16T21:32:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.920+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f724806eb40 con 0x7f724806de40 2024-05-16T21:32:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.923+0000 7f7246ffd640 1 -- 172.21.15.5:0/2075316762 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f723c085780 con 0x7f724806de40 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f72340762d0 msgr2=0x7f72340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f72340762d0 0x7f72340787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f724000aac0 tx=0x7f7240008040 comp rx=0 tx=0).stop 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806de40 msgr2=0x7f72481d7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806de40 0x7f72481d7f10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f723c02a220 tx=0x7f723c0046c0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 shutdown_connections 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f72340762d0 0x7f72340787e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7248151fc0 0x7f72481e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724806de40 0x7f72481d7f10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 --2- 172.21.15.5:0/2075316762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f724806da30 0x7f72481d98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 >> 172.21.15.5:0/2075316762 conn(0x7f72480c3d20 msgr2=0x7f72480be820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 shutdown_connections 2024-05-16T21:32:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:50.925+0000 7f7250334640 1 -- 172.21.15.5:0/2075316762 wait complete. 2024-05-16T21:32:50.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-16T21:32:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.047+0000 7f5ad1cbf640 1 Processor -- start 2024-05-16T21:32:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.047+0000 7f5ad1cbf640 1 -- start start 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5ad1cbf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5acc0bd6d0 0x7f5acc0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5ad1cbf640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc06e140 con 0x7f5acc0bee80 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5ad1cbf640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc0c36f0 con 0x7f5acc151fc0 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5ad1cbf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5acc152530 con 0x7f5acc0bd6d0 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5acbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5acc0bee80 0x7f5acc158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34004/0 (socket says 172.21.15.5:34004) 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5acbfff640 1 -- 172.21.15.5:0/3049035331 learned_addr learned my addr 172.21.15.5:0/3049035331 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373016889 0 0) 0x7f5ac4001490 con 0x7f5acc0bee80 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5acaffd640 1 --2- 172.21.15.5:0/3049035331 >> v2:172.21.15.157:3300/0 conn(0x7f5acc0bd6d0 0x7f5acc0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.048+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ab4003520 con 0x7f5acc0bee80 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4077825245 0 0) 0x7f5ab4003520 con 0x7f5acc0bee80 2024-05-16T21:32:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 >> v2:172.21.15.157:3300/0 conn(0x7f5acc0bd6d0 msgr2=0x7f5acc0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 --2- 172.21.15.5:0/3049035331 >> v2:172.21.15.157:3300/0 conn(0x7f5acc0bd6d0 0x7f5acc0be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 >> v1:172.21.15.157:6789/0 conn(0x7f5acc151fc0 legacy=0x7f5acc06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc152810 con 0x7f5acc0bee80 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f5ac4001c60 con 0x7f5acc0bee80 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 >> v1:172.21.15.5:6789/0 conn(0x7f5acc0bee80 legacy=0x7f5acc158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5ab4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ab4004800 0x7f5ab4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab4005350 0x7f5ab400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc152530 con 0x7f5ab4003a50 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab400c280 con 0x7f5ab4005350 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab400c480 con 0x7f5ab4004800 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acb7fe640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5ab4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acbfff640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab4005350 0x7f5ab400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acaffd640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ab4004800 0x7f5ab4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acb7fe640 1 -- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ab4004800 msgr2=0x7f5ab4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acb7fe640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ab4004800 0x7f5ab4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acb7fe640 1 -- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab4005350 msgr2=0x7f5ab400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acb7fe640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab4005350 0x7f5ab400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acb7fe640 1 -- 172.21.15.5:0/3049035331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab4003520 con 0x7f5ab4003a50 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acbfff640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab4005350 0x7f5ab400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acaffd640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ab4004800 0x7f5ab4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.049+0000 7f5acbfff640 1 -- 172.21.15.5:0/3049035331 reap_dead start 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.050+0000 7f5acb7fe640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5ab4003ec0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5abc001790 tx=0x7f5ab4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74be108f816bf7f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.050+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0013b0 con 0x7f5ab4003a50 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.050+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5abc0052d0 con 0x7f5ab4003a50 2024-05-16T21:32:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.050+0000 7f5aca7fc640 1 -- 172.21.15.5:0/3049035331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc02aac0 con 0x7f5ab4003a50 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.051+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/3049035331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 msgr2=0x7f5ab4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.051+0000 7f5ad1cbf640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5ab4003ec0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5abc001790 tx=0x7f5ab4005830 comp rx=0 tx=0).stop 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.051+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/3049035331 shutdown_connections 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.051+0000 7f5ad1cbf640 1 --2- 172.21.15.5:0/3049035331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5ab4003ec0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.051+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/3049035331 >> 172.21.15.5:0/3049035331 conn(0x7f5acc0c3d20 msgr2=0x7f5acc0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.051+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/3049035331 shutdown_connections 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.051+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/3049035331 wait complete. 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.052+0000 7f5ad1cbf640 1 Processor -- start 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.053+0000 7f5ad1cbf640 1 -- start start 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ad1cbf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5acc0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ad1cbf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc1e47c0 0x7f5acc0b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ad1cbf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5acc0b63d0 0x7f5acc1e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ad1cbf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc0bdae0 con 0x7f5ab4003a50 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ad1cbf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc0c0070 con 0x7f5acc1e47c0 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ad1cbf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5acc0a2ed0 con 0x7f5acc0b63d0 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5acc0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5acc0a39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44644/0 (socket says 172.21.15.5:44644) 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 -- 172.21.15.5:0/232446992 learned_addr learned my addr 172.21.15.5:0/232446992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acaffd640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc1e47c0 0x7f5acc0b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acbfff640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5acc0b63d0 0x7f5acc1e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 -- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5acc0b63d0 msgr2=0x7f5acc1e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5acc0b63d0 0x7f5acc1e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 -- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc1e47c0 msgr2=0x7f5acc0b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc1e47c0 0x7f5acc0b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 -- 172.21.15.5:0/232446992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc0a3f20 con 0x7f5ab4003a50 2024-05-16T21:32:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acaffd640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc1e47c0 0x7f5acc0b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:51.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5acb7fe640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5acc0a39e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5abc005040 tx=0x7f5abc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:51.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ab3fff640 1 -- 172.21.15.5:0/232446992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc042070 con 0x7f5ab4003a50 2024-05-16T21:32:51.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ab3fff640 1 -- 172.21.15.5:0/232446992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5abc005480 con 0x7f5ab4003a50 2024-05-16T21:32:51.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5acc0b9850 con 0x7f5ab4003a50 2024-05-16T21:32:51.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ab3fff640 1 -- 172.21.15.5:0/232446992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc037040 con 0x7f5ab4003a50 2024-05-16T21:32:51.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.054+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5acc0b8130 con 0x7f5ab4003a50 2024-05-16T21:32:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.055+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5acc050940 con 0x7f5ab4003a50 2024-05-16T21:32:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.056+0000 7f5ab3fff640 1 -- 172.21.15.5:0/232446992 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5abc045070 con 0x7f5ab4003a50 2024-05-16T21:32:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.057+0000 7f5ab3fff640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ab80762d0 0x7f5ab80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.057+0000 7f5ab3fff640 1 -- 172.21.15.5:0/232446992 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f5abc0b6c00 con 0x7f5ab4003a50 2024-05-16T21:32:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.057+0000 7f5acaffd640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ab80762d0 0x7f5ab80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.058+0000 7f5acaffd640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ab80762d0 0x7f5ab80787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00090e0 tx=0x7f5ac0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.064+0000 7f5ab3fff640 1 -- 172.21.15.5:0/232446992 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5abc0bd080 con 0x7f5ab4003a50 2024-05-16T21:32:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.259+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5acc06eb40 con 0x7f5ab4003a50 2024-05-16T21:32:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.259+0000 7f5ab3fff640 1 -- 172.21.15.5:0/232446992 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7f5abc0801d0 con 0x7f5ab4003a50 2024-05-16T21:32:51.261 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-05-16T21:32:51.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:32:51.261 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-05-16T21:32:51.262 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-05-16T21:32:51.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:32:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ab80762d0 msgr2=0x7f5ab80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ab80762d0 0x7f5ab80787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00090e0 tx=0x7f5ac0008040 comp rx=0 tx=0).stop 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 msgr2=0x7f5acc0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5acc0a39e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5abc005040 tx=0x7f5abc001120 comp rx=0 tx=0).stop 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 shutdown_connections 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ab80762d0 0x7f5ab80787e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5acc0b63d0 0x7f5acc1e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5acc1e47c0 0x7f5acc0b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 --2- 172.21.15.5:0/232446992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab4003a50 0x7f5acc0a39e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 >> 172.21.15.5:0/232446992 conn(0x7f5acc0c3d20 msgr2=0x7f5acc0c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 shutdown_connections 2024-05-16T21:32:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.262+0000 7f5ad1cbf640 1 -- 172.21.15.5:0/232446992 wait complete. 2024-05-16T21:32:51.277 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-16T21:32:51.277 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-16T21:32:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.391+0000 7ff3d05b7640 1 Processor -- start 2024-05-16T21:32:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.391+0000 7ff3d05b7640 1 -- start start 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.392+0000 7ff3d05b7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c8151fc0 0x7ff3c80bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.392+0000 7ff3d05b7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3c80bf050 0x7ff3c8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.392+0000 7ff3d05b7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c80c36f0 con 0x7ff3c806da30 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.392+0000 7ff3d05b7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c80bdc10 con 0x7ff3c80bf050 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.392+0000 7ff3d05b7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c8152530 con 0x7ff3c8151fc0 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.392+0000 7ff3ceb54640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3c80bf050 0x7ff3c8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.393+0000 7ff3ceb54640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3c80bf050 0x7ff3c8158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44656/0 (socket says 172.21.15.5:44656) 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.393+0000 7ff3ceb54640 1 -- 172.21.15.5:0/2745434608 learned_addr learned my addr 172.21.15.5:0/2745434608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.393+0000 7ff3ce353640 1 --2- 172.21.15.5:0/2745434608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c8151fc0 0x7ff3c80bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.393+0000 7ff3ceb54640 1 -- 172.21.15.5:0/2745434608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c8151fc0 msgr2=0x7ff3c80bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.393+0000 7ff3ceb54640 1 --2- 172.21.15.5:0/2745434608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c8151fc0 0x7ff3c80bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.393+0000 7ff3ceb54640 1 -- 172.21.15.5:0/2745434608 >> v1:172.21.15.157:6789/0 conn(0x7ff3c806da30 legacy=0x7ff3c80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.393+0000 7ff3ceb54640 1 -- 172.21.15.5:0/2745434608 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c8152810 con 0x7ff3c80bf050 2024-05-16T21:32:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.393+0000 7ff3cd351640 1 -- 172.21.15.5:0/2745434608 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442906753 0 0) 0x7ff3c80c36f0 con 0x7ff3c806da30 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.394+0000 7ff3ceb54640 1 --2- 172.21.15.5:0/2745434608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c80bf050 0x7ff3c8158e90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009e50 tx=0x7ff3c002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3e9af0d365e121 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.394+0000 7ff3cd351640 1 -- 172.21.15.5:0/2745434608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0036070 con 0x7ff3c80bf050 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.394+0000 7ff3cd351640 1 -- 172.21.15.5:0/2745434608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c0031600 con 0x7ff3c80bf050 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.394+0000 7ff3cd351640 1 -- 172.21.15.5:0/2745434608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00319d0 con 0x7ff3c80bf050 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.394+0000 7ff3d05b7640 1 -- 172.21.15.5:0/2745434608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c80bf050 msgr2=0x7ff3c8158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.394+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/2745434608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c80bf050 0x7ff3c8158e90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009e50 tx=0x7ff3c002a680 comp rx=0 tx=0).stop 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.395+0000 7ff3d05b7640 1 -- 172.21.15.5:0/2745434608 shutdown_connections 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.395+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/2745434608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c80bf050 0x7ff3c8158e90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.395+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/2745434608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c8151fc0 0x7ff3c80bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.395+0000 7ff3d05b7640 1 -- 172.21.15.5:0/2745434608 >> 172.21.15.5:0/2745434608 conn(0x7ff3c80c3d20 msgr2=0x7ff3c80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.395+0000 7ff3d05b7640 1 -- 172.21.15.5:0/2745434608 shutdown_connections 2024-05-16T21:32:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.395+0000 7ff3d05b7640 1 -- 172.21.15.5:0/2745434608 wait complete. 2024-05-16T21:32:51.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.396+0000 7ff3d05b7640 1 Processor -- start 2024-05-16T21:32:51.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.396+0000 7ff3d05b7640 1 -- start start 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3d05b7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c806da30 0x7ff3c81d8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3d05b7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3c80bf050 0x7ff3c81e7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3d05b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c8151fc0 0x7ff3c80b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3d05b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c80a3050 con 0x7ff3c8151fc0 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3d05b7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c80a2ed0 con 0x7ff3c80bf050 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3d05b7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c806de40 con 0x7ff3c806da30 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3ceb54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c8151fc0 0x7ff3c80b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3ceb54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c8151fc0 0x7ff3c80b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44672/0 (socket says 172.21.15.5:44672) 2024-05-16T21:32:51.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3ceb54640 1 -- 172.21.15.5:0/4219290494 learned_addr learned my addr 172.21.15.5:0/4219290494 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.397+0000 7ff3cdb52640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3c80bf050 0x7ff3c81e7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3ce353640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c806da30 0x7ff3c81d8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3ceb54640 1 -- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c806da30 msgr2=0x7ff3c81d8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3ceb54640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c806da30 0x7ff3c81d8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3ceb54640 1 -- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3c80bf050 msgr2=0x7ff3c81e7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3ceb54640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3c80bf050 0x7ff3c81e7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3ceb54640 1 -- 172.21.15.5:0/4219290494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c81d8c80 con 0x7ff3c8151fc0 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3ceb54640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c8151fc0 0x7ff3c80b5f30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0034040 tx=0x7ff3c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3beffd640 1 -- 172.21.15.5:0/4219290494 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0036050 con 0x7ff3c8151fc0 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3beffd640 1 -- 172.21.15.5:0/4219290494 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c0042070 con 0x7ff3c8151fc0 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c81e7ea0 con 0x7ff3c8151fc0 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3beffd640 1 -- 172.21.15.5:0/4219290494 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0009510 con 0x7ff3c8151fc0 2024-05-16T21:32:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.398+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c81d7980 con 0x7ff3c8151fc0 2024-05-16T21:32:51.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.399+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c8050940 con 0x7ff3c8151fc0 2024-05-16T21:32:51.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.400+0000 7ff3beffd640 1 -- 172.21.15.5:0/4219290494 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff3c0007bf0 con 0x7ff3c8151fc0 2024-05-16T21:32:51.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.400+0000 7ff3beffd640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff3ac0762d0 0x7ff3ac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:51.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.400+0000 7ff3beffd640 1 -- 172.21.15.5:0/4219290494 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ff3c00b8240 con 0x7ff3c8151fc0 2024-05-16T21:32:51.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.400+0000 7ff3ce353640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff3ac0762d0 0x7ff3ac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:51.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.401+0000 7ff3ce353640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff3ac0762d0 0x7ff3ac0787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009a30 tx=0x7ff3c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:51.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.405+0000 7ff3beffd640 1 -- 172.21.15.5:0/4219290494 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff3c0081dc0 con 0x7ff3c8151fc0 2024-05-16T21:32:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:51.598+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff3c806eb40 con 0x7ff3c8151fc0 2024-05-16T21:32:52.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.113+0000 7ff3beffd640 1 -- 172.21.15.5:0/4219290494 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7ff3c00816c0 con 0x7ff3c8151fc0 2024-05-16T21:32:52.115 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff3ac0762d0 msgr2=0x7ff3ac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff3ac0762d0 0x7ff3ac0787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009a30 tx=0x7ff3c4008040 comp rx=0 tx=0).stop 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c8151fc0 msgr2=0x7ff3c80b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c8151fc0 0x7ff3c80b5f30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0034040 tx=0x7ff3c0004a40 comp rx=0 tx=0).stop 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 shutdown_connections 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff3ac0762d0 0x7ff3ac0787e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c8151fc0 0x7ff3c80b5f30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3c80bf050 0x7ff3c81e7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 --2- 172.21.15.5:0/4219290494 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3c806da30 0x7ff3c81d8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 >> 172.21.15.5:0/4219290494 conn(0x7ff3c80c3d20 msgr2=0x7ff3c80a4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 shutdown_connections 2024-05-16T21:32:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.116+0000 7ff3d05b7640 1 -- 172.21.15.5:0/4219290494 wait complete. 2024-05-16T21:32:52.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-16T21:32:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.259+0000 7f240919d640 1 Processor -- start 2024-05-16T21:32:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.259+0000 7f240919d640 1 -- start start 2024-05-16T21:32:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f240919d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2404151fc0 0x7f24040bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f240919d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f240406da30 0x7f24040be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f240919d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24040c36f0 con 0x7f240406de40 2024-05-16T21:32:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f240919d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f24040bdc10 con 0x7f240406da30 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f240919d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f2404152530 con 0x7f2404151fc0 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f23fbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f240406da30 0x7f24040be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f23fbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f240406da30 0x7f24040be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44678/0 (socket says 172.21.15.5:44678) 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f23fbfff640 1 -- 172.21.15.5:0/2181169006 learned_addr learned my addr 172.21.15.5:0/2181169006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f2402d9d640 1 --2- 172.21.15.5:0/2181169006 >> v2:172.21.15.157:3300/0 conn(0x7f2404151fc0 0x7f24040bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f23fbfff640 1 -- 172.21.15.5:0/2181169006 >> v2:172.21.15.157:3300/0 conn(0x7f2404151fc0 msgr2=0x7f24040bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f23fbfff640 1 --2- 172.21.15.5:0/2181169006 >> v2:172.21.15.157:3300/0 conn(0x7f2404151fc0 0x7f24040bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f23fbfff640 1 -- 172.21.15.5:0/2181169006 >> v1:172.21.15.157:6789/0 conn(0x7f240406de40 legacy=0x7f240414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f23fbfff640 1 -- 172.21.15.5:0/2181169006 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2404152810 con 0x7f240406da30 2024-05-16T21:32:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.260+0000 7f2402d9d640 1 --2- 172.21.15.5:0/2181169006 >> v2:172.21.15.157:3300/0 conn(0x7f2404151fc0 0x7f24040bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.261+0000 7f23fbfff640 1 --2- 172.21.15.5:0/2181169006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f24040be940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f240408d300 tx=0x7f23ec02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f99d23f7929696 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.261+0000 7f240259c640 1 -- 172.21.15.5:0/2181169006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec037070 con 0x7f240406da30 2024-05-16T21:32:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.261+0000 7f240259c640 1 -- 172.21.15.5:0/2181169006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec032440 con 0x7f240406da30 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.261+0000 7f240259c640 1 -- 172.21.15.5:0/2181169006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec032810 con 0x7f240406da30 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.262+0000 7f240919d640 1 -- 172.21.15.5:0/2181169006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 msgr2=0x7f24040be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.262+0000 7f240919d640 1 --2- 172.21.15.5:0/2181169006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f24040be940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f240408d300 tx=0x7f23ec02a200 comp rx=0 tx=0).stop 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.262+0000 7f240919d640 1 -- 172.21.15.5:0/2181169006 shutdown_connections 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.262+0000 7f240919d640 1 --2- 172.21.15.5:0/2181169006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f24040be940 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.262+0000 7f240919d640 1 --2- 172.21.15.5:0/2181169006 >> v2:172.21.15.157:3300/0 conn(0x7f2404151fc0 0x7f24040bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.262+0000 7f240919d640 1 -- 172.21.15.5:0/2181169006 >> 172.21.15.5:0/2181169006 conn(0x7f24040c3d20 msgr2=0x7f24040c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.262+0000 7f240919d640 1 -- 172.21.15.5:0/2181169006 shutdown_connections 2024-05-16T21:32:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.262+0000 7f240919d640 1 -- 172.21.15.5:0/2181169006 wait complete. 2024-05-16T21:32:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.264+0000 7f240919d640 1 Processor -- start 2024-05-16T21:32:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.264+0000 7f240919d640 1 -- start start 2024-05-16T21:32:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f240919d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f240414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f240919d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f240406de40 0x7f24041e7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f240919d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2404151fc0 0x7f240414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f240919d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f24040a3050 con 0x7f240406da30 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f240919d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f24040a2ed0 con 0x7f240406de40 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f240919d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f24040bee80 con 0x7f2404151fc0 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f240414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f240414c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44692/0 (socket says 172.21.15.5:44692) 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 -- 172.21.15.5:0/2686959700 learned_addr learned my addr 172.21.15.5:0/2686959700 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f23fbfff640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f240406de40 0x7f24041e7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f240359e640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2404151fc0 0x7f240414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 -- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2404151fc0 msgr2=0x7f240414b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2404151fc0 0x7f240414b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 -- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f240406de40 msgr2=0x7f24041e7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f240406de40 0x7f24041e7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 -- 172.21.15.5:0/2686959700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240414c8d0 con 0x7f240406da30 2024-05-16T21:32:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f240359e640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2404151fc0 0x7f240414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f23fbfff640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f240406de40 0x7f24041e7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.265+0000 7f2402d9d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f240414c390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23f400d800 tx=0x7f23f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.266+0000 7f23fb7fe640 1 -- 172.21.15.5:0/2686959700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4004030 con 0x7f240406da30 2024-05-16T21:32:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.266+0000 7f23fb7fe640 1 -- 172.21.15.5:0/2686959700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f40041d0 con 0x7f240406da30 2024-05-16T21:32:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.266+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24041e8060 con 0x7f240406da30 2024-05-16T21:32:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.266+0000 7f23fb7fe640 1 -- 172.21.15.5:0/2686959700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f40096a0 con 0x7f240406da30 2024-05-16T21:32:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.266+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24041e48c0 con 0x7f240406da30 2024-05-16T21:32:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.267+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2404050940 con 0x7f240406da30 2024-05-16T21:32:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.268+0000 7f23fb7fe640 1 -- 172.21.15.5:0/2686959700 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f23f4009840 con 0x7f240406da30 2024-05-16T21:32:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.268+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f23e4076300 0x7f23e4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.268+0000 7f23fb7fe640 1 -- 172.21.15.5:0/2686959700 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7f23f40976c0 con 0x7f240406da30 2024-05-16T21:32:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.268+0000 7f23fbfff640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f23e4076300 0x7f23e4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.269+0000 7f23fbfff640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f23e4076300 0x7f23e4078810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f23ec034000 tx=0x7f23ec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.273+0000 7f23fb7fe640 1 -- 172.21.15.5:0/2686959700 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f23f4061200 con 0x7f240406da30 2024-05-16T21:32:52.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:52.468+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f240406eb40 con 0x7f240406da30 2024-05-16T21:32:53.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.118+0000 7f23fb7fe640 1 -- 172.21.15.5:0/2686959700 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7f23f4060b00 con 0x7f240406da30 2024-05-16T21:32:53.121 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-05-16T21:32:53.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.124+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f23e4076300 msgr2=0x7f23e4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:53.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.124+0000 7f240919d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f23e4076300 0x7f23e4078810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f23ec034000 tx=0x7f23ec02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:53.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.124+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 msgr2=0x7f240414c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:53.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.124+0000 7f240919d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f240414c390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23f400d800 tx=0x7f23f400dcc0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.127+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 shutdown_connections 2024-05-16T21:32:53.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.127+0000 7f240919d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f23e4076300 0x7f23e4078810 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.127+0000 7f240919d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2404151fc0 0x7f240414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.127+0000 7f240919d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f240406de40 0x7f24041e7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.127+0000 7f240919d640 1 --2- 172.21.15.5:0/2686959700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240406da30 0x7f240414c390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.127+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 >> 172.21.15.5:0/2686959700 conn(0x7f24040c3d20 msgr2=0x7f24040a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:53.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.127+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 shutdown_connections 2024-05-16T21:32:53.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.127+0000 7f240919d640 1 -- 172.21.15.5:0/2686959700 wait complete. 2024-05-16T21:32:53.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-16T21:32:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.272+0000 7fd741db2640 1 Processor -- start 2024-05-16T21:32:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.272+0000 7fd741db2640 1 -- start start 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd741db2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd73c14ee10 0x7fd73c152330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd741db2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd73c0bf630 0x7fd73c0bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd741db2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73c0be510 con 0x7fd73c14e310 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd741db2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd73c0c03a0 con 0x7fd73c0bf630 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd741db2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd73c152870 con 0x7fd73c14ee10 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd73bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd73c0bf630 0x7fd73c0bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd73bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd73c0bf630 0x7fd73c0bfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44696/0 (socket says 172.21.15.5:44696) 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd73bfff640 1 -- 172.21.15.5:0/2498361044 learned_addr learned my addr 172.21.15.5:0/2498361044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd73affd640 1 --2- 172.21.15.5:0/2498361044 >> v2:172.21.15.157:3300/0 conn(0x7fd73c14ee10 0x7fd73c152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd73bfff640 1 -- 172.21.15.5:0/2498361044 >> v2:172.21.15.157:3300/0 conn(0x7fd73c14ee10 msgr2=0x7fd73c152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd73bfff640 1 --2- 172.21.15.5:0/2498361044 >> v2:172.21.15.157:3300/0 conn(0x7fd73c14ee10 0x7fd73c152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd73bfff640 1 -- 172.21.15.5:0/2498361044 >> v1:172.21.15.157:6789/0 conn(0x7fd73c14e310 legacy=0x7fd73c0bde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.273+0000 7fd73bfff640 1 -- 172.21.15.5:0/2498361044 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c0c00c0 con 0x7fd73c0bf630 2024-05-16T21:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.274+0000 7fd73bfff640 1 --2- 172.21.15.5:0/2498361044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0bf630 0x7fd73c0bfa40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd73c070930 tx=0x7fd73402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f21d4f94fc7b8a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.274+0000 7fd73a7fc640 1 -- 172.21.15.5:0/2498361044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734036070 con 0x7fd73c0bf630 2024-05-16T21:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.274+0000 7fd73a7fc640 1 -- 172.21.15.5:0/2498361044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd734031600 con 0x7fd73c0bf630 2024-05-16T21:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.274+0000 7fd73a7fc640 1 -- 172.21.15.5:0/2498361044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340319f0 con 0x7fd73c0bf630 2024-05-16T21:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.275+0000 7fd741db2640 1 -- 172.21.15.5:0/2498361044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0bf630 msgr2=0x7fd73c0bfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.275+0000 7fd741db2640 1 --2- 172.21.15.5:0/2498361044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0bf630 0x7fd73c0bfa40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd73c070930 tx=0x7fd73402a7c0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.275+0000 7fd741db2640 1 -- 172.21.15.5:0/2498361044 shutdown_connections 2024-05-16T21:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.275+0000 7fd741db2640 1 --2- 172.21.15.5:0/2498361044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0bf630 0x7fd73c0bfa40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.275+0000 7fd741db2640 1 --2- 172.21.15.5:0/2498361044 >> v2:172.21.15.157:3300/0 conn(0x7fd73c14ee10 0x7fd73c152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.275+0000 7fd741db2640 1 -- 172.21.15.5:0/2498361044 >> 172.21.15.5:0/2498361044 conn(0x7fd73c0c1830 msgr2=0x7fd73c0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.275+0000 7fd741db2640 1 -- 172.21.15.5:0/2498361044 shutdown_connections 2024-05-16T21:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.275+0000 7fd741db2640 1 -- 172.21.15.5:0/2498361044 wait complete. 2024-05-16T21:32:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.276+0000 7fd741db2640 1 Processor -- start 2024-05-16T21:32:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.277+0000 7fd741db2640 1 -- start start 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd741db2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c0bf630 0x7fd73c1e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd741db2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c14e310 0x7fd73c149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd741db2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c14ee10 0x7fd73c0a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd741db2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c151ea0 con 0x7fd73c14e310 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd741db2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c1518e0 con 0x7fd73c14ee10 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd741db2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd73c14f220 con 0x7fd73c0bf630 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c14e310 0x7fd73c149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c14e310 0x7fd73c149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44702/0 (socket says 172.21.15.5:44702) 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 -- 172.21.15.5:0/643130648 learned_addr learned my addr 172.21.15.5:0/643130648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73bfff640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c14ee10 0x7fd73c0a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73b7fe640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c0bf630 0x7fd73c1e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 -- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c0bf630 msgr2=0x7fd73c1e46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c0bf630 0x7fd73c1e46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 -- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c14ee10 msgr2=0x7fd73c0a73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c14ee10 0x7fd73c0a73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 -- 172.21.15.5:0/643130648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c0a59f0 con 0x7fd73c14e310 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73b7fe640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c0bf630 0x7fd73c1e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd73affd640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c14e310 0x7fd73c149f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd73000d620 tx=0x7fd73000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.278+0000 7fd723fff640 1 -- 172.21.15.5:0/643130648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73000b620 con 0x7fd73c14e310 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.279+0000 7fd723fff640 1 -- 172.21.15.5:0/643130648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730019070 con 0x7fd73c14e310 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.279+0000 7fd723fff640 1 -- 172.21.15.5:0/643130648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73000ba00 con 0x7fd73c14e310 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.279+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73c14b820 con 0x7fd73c14e310 2024-05-16T21:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.279+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd73c14b310 con 0x7fd73c14e310 2024-05-16T21:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.280+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73c0be1c0 con 0x7fd73c14e310 2024-05-16T21:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.280+0000 7fd723fff640 1 -- 172.21.15.5:0/643130648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd73000bba0 con 0x7fd73c14e310 2024-05-16T21:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.281+0000 7fd723fff640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd728076300 0x7fd728078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.281+0000 7fd723fff640 1 -- 172.21.15.5:0/643130648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7fd7300978d0 con 0x7fd73c14e310 2024-05-16T21:32:53.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.281+0000 7fd73b7fe640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd728076300 0x7fd728078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:53.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.282+0000 7fd73b7fe640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd728076300 0x7fd728078810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd72c007fd0 tx=0x7fd72c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.286+0000 7fd723fff640 1 -- 172.21.15.5:0/643130648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd730061280 con 0x7fd73c14e310 2024-05-16T21:32:53.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:53.517+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd73c050940 con 0x7fd73c14e310 2024-05-16T21:32:54.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.120+0000 7fd723fff640 1 -- 172.21.15.5:0/643130648 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7fd730060b80 con 0x7fd73c14e310 2024-05-16T21:32:54.122 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 4 and data pool 5 2024-05-16T21:32:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.125+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd728076300 msgr2=0x7fd728078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.125+0000 7fd741db2640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd728076300 0x7fd728078810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd72c007fd0 tx=0x7fd72c009040 comp rx=0 tx=0).stop 2024-05-16T21:32:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.126+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c14e310 msgr2=0x7fd73c149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.126+0000 7fd741db2640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c14e310 0x7fd73c149f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd73000d620 tx=0x7fd73000dae0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.129+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 shutdown_connections 2024-05-16T21:32:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.129+0000 7fd741db2640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd728076300 0x7fd728078810 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.129+0000 7fd741db2640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c14ee10 0x7fd73c0a73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.129+0000 7fd741db2640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c14e310 0x7fd73c149f20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.129+0000 7fd741db2640 1 --2- 172.21.15.5:0/643130648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c0bf630 0x7fd73c1e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.129+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 >> 172.21.15.5:0/643130648 conn(0x7fd73c0c1830 msgr2=0x7fd73c0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.131+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 shutdown_connections 2024-05-16T21:32:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.131+0000 7fd741db2640 1 -- 172.21.15.5:0/643130648 wait complete. 2024-05-16T21:32:54.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.279+0000 7f83ece13640 1 Processor -- start 2024-05-16T21:32:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.279+0000 7f83ece13640 1 -- start start 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.280+0000 7f83ece13640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 0x7f83e80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.280+0000 7f83ece13640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f83e80bf9b0 0x7f83e80bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.280+0000 7f83ece13640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e80c0620 con 0x7f83e814e360 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.280+0000 7f83ece13640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f83e8151e40 con 0x7f83e80bf9b0 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.280+0000 7f83ece13640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83e8151ad0 con 0x7f83e8148770 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.280+0000 7f83e659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f83e814e360 0x7f83e81522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34006/0 (socket says 172.21.15.5:34006) 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.280+0000 7f83e659c640 1 -- 172.21.15.5:0/1224851216 learned_addr learned my addr 172.21.15.5:0/1224851216 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e5d9b640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 0x7f83e80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e6d9d640 1 --2- 172.21.15.5:0/1224851216 >> v2:172.21.15.157:3300/0 conn(0x7f83e80bf9b0 0x7f83e80bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011539718 0 0) 0x7f83e80c0620 con 0x7f83e814e360 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83d4003520 con 0x7f83e814e360 2024-05-16T21:32:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 593657940 0 0) 0x7f83d4003520 con 0x7f83e814e360 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 msgr2=0x7f83e80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 0x7f83e80c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 >> v2:172.21.15.157:3300/0 conn(0x7f83e80bf9b0 msgr2=0x7f83e80bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 --2- 172.21.15.5:0/1224851216 >> v2:172.21.15.157:3300/0 conn(0x7f83e80bf9b0 0x7f83e80bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e80c0300 con 0x7f83e814e360 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f83e0001710 con 0x7f83e814e360 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e5d9b640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 0x7f83e80c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 >> v1:172.21.15.5:6789/0 conn(0x7f83e814e360 legacy=0x7f83e81522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4003a00 0x7f83d4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d4004800 0x7f83d4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 0x7f83d4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f83e8151e40 con 0x7f83d4004800 2024-05-16T21:32:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f83e8151ad0 con 0x7f83d4003a00 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83d400baa0 con 0x7f83e8148770 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e6d9d640 1 --2- 172.21.15.5:0/1224851216 >> v2:172.21.15.157:3300/0 conn(0x7f83e80bf9b0 0x7f83e80bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e5d9b640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d4004800 0x7f83d4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e659c640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4003a00 0x7f83d4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.281+0000 7f83e6d9d640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 0x7f83d4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.282+0000 7f83e5d9b640 1 -- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 msgr2=0x7f83d4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.282+0000 7f83e5d9b640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8148770 0x7f83d4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.282+0000 7f83e5d9b640 1 -- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4003a00 msgr2=0x7f83d4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.282+0000 7f83e5d9b640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4003a00 0x7f83d4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.282+0000 7f83e5d9b640 1 -- 172.21.15.5:0/1224851216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d4003520 con 0x7f83d4004800 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.282+0000 7f83e5d9b640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d4004800 0x7f83d4004c10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009c90 tx=0x7f83d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29d7805b5f28824 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.282+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0036070 con 0x7f83d4004800 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d0031400 con 0x7f83d4004800 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83e559a640 1 -- 172.21.15.5:0/1224851216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0009860 con 0x7f83d4004800 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83ece13640 1 -- 172.21.15.5:0/1224851216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d4004800 msgr2=0x7f83d4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83ece13640 1 --2- 172.21.15.5:0/1224851216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d4004800 0x7f83d4004c10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009c90 tx=0x7f83d4005830 comp rx=0 tx=0).stop 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83e6d9d640 1 -- 172.21.15.5:0/1224851216 reap_dead start 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83ece13640 1 -- 172.21.15.5:0/1224851216 shutdown_connections 2024-05-16T21:32:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83ece13640 1 -- 172.21.15.5:0/1224851216 >> 172.21.15.5:0/1224851216 conn(0x7f83e80c17c0 msgr2=0x7f83e80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83ece13640 1 -- 172.21.15.5:0/1224851216 shutdown_connections 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.283+0000 7f83ece13640 1 -- 172.21.15.5:0/1224851216 wait complete. 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.285+0000 7f83ece13640 1 Processor -- start 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.285+0000 7f83ece13640 1 -- start start 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83ece13640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4004800 0x7f83e8150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83ece13640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8071940 0x7f83e8150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83ece13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e81473f0 0x7f83e8147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83ece13640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f83e80c1050 con 0x7f83e81473f0 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83ece13640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f83e80c0ed0 con 0x7f83d4004800 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83ece13640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83e80c11d0 con 0x7f83e8071940 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83e6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e81473f0 0x7f83e8147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83e6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e81473f0 0x7f83e8147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44718/0 (socket says 172.21.15.5:44718) 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83e6d9d640 1 -- 172.21.15.5:0/1565121637 learned_addr learned my addr 172.21.15.5:0/1565121637 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83e659c640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4004800 0x7f83e8150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.286+0000 7f83e5d9b640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8071940 0x7f83e8150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83e6d9d640 1 -- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8071940 msgr2=0x7f83e8150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83e6d9d640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8071940 0x7f83e8150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83e6d9d640 1 -- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4004800 msgr2=0x7f83e8150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83e6d9d640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4004800 0x7f83e8150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83e6d9d640 1 -- 172.21.15.5:0/1565121637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e8072b50 con 0x7f83e81473f0 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83e6d9d640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e81473f0 0x7f83e8147800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83e80bf700 tx=0x7f83d800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83deffd640 1 -- 172.21.15.5:0/1565121637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8003990 con 0x7f83e81473f0 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83deffd640 1 -- 172.21.15.5:0/1565121637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d8003b30 con 0x7f83e81473f0 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e8071140 con 0x7f83e81473f0 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83deffd640 1 -- 172.21.15.5:0/1565121637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8004020 con 0x7f83e81473f0 2024-05-16T21:32:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.287+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e814f760 con 0x7f83e81473f0 2024-05-16T21:32:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.288+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e80a1140 con 0x7f83e81473f0 2024-05-16T21:32:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.289+0000 7f83deffd640 1 -- 172.21.15.5:0/1565121637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f83d801f020 con 0x7f83e81473f0 2024-05-16T21:32:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.289+0000 7f83deffd640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83c80762d0 0x7f83c80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.289+0000 7f83deffd640 1 -- 172.21.15.5:0/1565121637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f83d8097aa0 con 0x7f83e81473f0 2024-05-16T21:32:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.290+0000 7f83e659c640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83c80762d0 0x7f83c80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.290+0000 7f83e659c640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83c80762d0 0x7f83c80787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f83e80bef30 tx=0x7f83e00078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.294+0000 7f83deffd640 1 -- 172.21.15.5:0/1565121637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f83d8010040 con 0x7f83e81473f0 2024-05-16T21:32:54.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.487+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83e8050940 con 0x7f83e81473f0 2024-05-16T21:32:54.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.488+0000 7f83deffd640 1 -- 172.21.15.5:0/1565121637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16634 (secure 0 0 0) 0x7f83d8060db0 con 0x7f83e81473f0 2024-05-16T21:32:54.491 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:54.491 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:53.518819+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:51.602373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:52.472465+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83c80762d0 msgr2=0x7f83c80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83c80762d0 0x7f83c80787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f83e80bef30 tx=0x7f83e00078f0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e81473f0 msgr2=0x7f83e8147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e81473f0 0x7f83e8147800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83e80bf700 tx=0x7f83d800f580 comp rx=0 tx=0).stop 2024-05-16T21:32:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 shutdown_connections 2024-05-16T21:32:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f83c80762d0 0x7f83c80787e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e81473f0 0x7f83e8147800 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83e8071940 0x7f83e8150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 --2- 172.21.15.5:0/1565121637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83d4004800 0x7f83e8150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 >> 172.21.15.5:0/1565121637 conn(0x7f83e80c17c0 msgr2=0x7f83e80bd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:54.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 shutdown_connections 2024-05-16T21:32:54.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.491+0000 7f83ece13640 1 -- 172.21.15.5:0/1565121637 wait complete. 2024-05-16T21:32:54.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.614+0000 7f5970e69640 1 Processor -- start 2024-05-16T21:32:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.614+0000 7f5970e69640 1 -- start start 2024-05-16T21:32:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f5970e69640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f596c151fc0 0x7f596c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f5970e69640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c06da30 0x7f596c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f5970e69640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f596c06de40 0x7f596c0bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f5970e69640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0bdc10 con 0x7f596c06de40 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f5970e69640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0c36f0 con 0x7f596c151fc0 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f5970e69640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f596c152530 con 0x7f596c06da30 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f596c06de40 0x7f596c0bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f596c06de40 0x7f596c0bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44722/0 (socket says 172.21.15.5:44722) 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596ad9d640 1 -- 172.21.15.5:0/2453671644 learned_addr learned my addr 172.21.15.5:0/2453671644 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596a59c640 1 --2- 172.21.15.5:0/2453671644 >> v2:172.21.15.157:3300/0 conn(0x7f596c151fc0 0x7f596c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f5961d9b640 1 --2- 172.21.15.5:0/2453671644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c06da30 0x7f596c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596ad9d640 1 -- 172.21.15.5:0/2453671644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c06da30 msgr2=0x7f596c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596ad9d640 1 --2- 172.21.15.5:0/2453671644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c06da30 0x7f596c0be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596ad9d640 1 -- 172.21.15.5:0/2453671644 >> v2:172.21.15.157:3300/0 conn(0x7f596c151fc0 msgr2=0x7f596c0bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596ad9d640 1 --2- 172.21.15.5:0/2453671644 >> v2:172.21.15.157:3300/0 conn(0x7f596c151fc0 0x7f596c0bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596ad9d640 1 -- 172.21.15.5:0/2453671644 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c152810 con 0x7f596c06de40 2024-05-16T21:32:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f596a59c640 1 --2- 172.21.15.5:0/2453671644 >> v2:172.21.15.157:3300/0 conn(0x7f596c151fc0 0x7f596c0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.615+0000 7f5961d9b640 1 --2- 172.21.15.5:0/2453671644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c06da30 0x7f596c0be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.616+0000 7f596ad9d640 1 --2- 172.21.15.5:0/2453671644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0bee80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f596c08d300 tx=0x7f596402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d27cb644ac37f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.616+0000 7f5969d9b640 1 -- 172.21.15.5:0/2453671644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964036070 con 0x7f596c06de40 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.616+0000 7f5969d9b640 1 -- 172.21.15.5:0/2453671644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5964031600 con 0x7f596c06de40 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.616+0000 7f5969d9b640 1 -- 172.21.15.5:0/2453671644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640319d0 con 0x7f596c06de40 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 -- 172.21.15.5:0/2453671644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 msgr2=0x7f596c0bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 --2- 172.21.15.5:0/2453671644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0bee80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f596c08d300 tx=0x7f596402a6a0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 -- 172.21.15.5:0/2453671644 shutdown_connections 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 --2- 172.21.15.5:0/2453671644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0bee80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 --2- 172.21.15.5:0/2453671644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c06da30 0x7f596c0be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 --2- 172.21.15.5:0/2453671644 >> v2:172.21.15.157:3300/0 conn(0x7f596c151fc0 0x7f596c0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 -- 172.21.15.5:0/2453671644 >> 172.21.15.5:0/2453671644 conn(0x7f596c0c3d20 msgr2=0x7f596c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:54.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 -- 172.21.15.5:0/2453671644 shutdown_connections 2024-05-16T21:32:54.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.617+0000 7f5970e69640 1 -- 172.21.15.5:0/2453671644 wait complete. 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.619+0000 7f5970e69640 1 Processor -- start 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.619+0000 7f5970e69640 1 -- start start 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5970e69640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f596c06da30 0x7f596c0c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5970e69640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5970e69640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c151fc0 0x7f596c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5970e69640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0a3050 con 0x7f596c06de40 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5970e69640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0a2ed0 con 0x7f596c06da30 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5970e69640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f596c14e570 con 0x7f596c151fc0 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5961d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5961d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0b86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44732/0 (socket says 172.21.15.5:44732) 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5961d9b640 1 -- 172.21.15.5:0/221224275 learned_addr learned my addr 172.21.15.5:0/221224275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f596ad9d640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c151fc0 0x7f596c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f596a59c640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f596c06da30 0x7f596c0c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5961d9b640 1 -- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c151fc0 msgr2=0x7f596c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5961d9b640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c151fc0 0x7f596c14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5961d9b640 1 -- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f596c06da30 msgr2=0x7f596c0c1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5961d9b640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f596c06da30 0x7f596c0c1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f5961d9b640 1 -- 172.21.15.5:0/221224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c0c2060 con 0x7f596c06de40 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.620+0000 7f596a59c640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f596c06da30 0x7f596c0c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.621+0000 7f5961d9b640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0b86e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f595400d800 tx=0x7f595400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.621+0000 7f59637fe640 1 -- 172.21.15.5:0/221224275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954018070 con 0x7f596c06de40 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.621+0000 7f59637fe640 1 -- 172.21.15.5:0/221224275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5954004030 con 0x7f596c06de40 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.621+0000 7f59637fe640 1 -- 172.21.15.5:0/221224275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954004400 con 0x7f596c06de40 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.621+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c0b8c20 con 0x7f596c06de40 2024-05-16T21:32:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.621+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c0ba140 con 0x7f596c06de40 2024-05-16T21:32:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.622+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c050940 con 0x7f596c06de40 2024-05-16T21:32:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.622+0000 7f59637fe640 1 -- 172.21.15.5:0/221224275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f59540096a0 con 0x7f596c06de40 2024-05-16T21:32:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.623+0000 7f59637fe640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f594c076300 0x7f594c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.623+0000 7f59637fe640 1 -- 172.21.15.5:0/221224275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f5954097970 con 0x7f596c06de40 2024-05-16T21:32:54.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.623+0000 7f596a59c640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f594c076300 0x7f594c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.624+0000 7f596a59c640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f594c076300 0x7f594c078810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f595c006fd0 tx=0x7f595c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.627+0000 7f59637fe640 1 -- 172.21.15.5:0/221224275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f596c0b8c20 con 0x7f596c06de40 2024-05-16T21:32:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.817+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f596c06eb40 con 0x7f596c06de40 2024-05-16T21:32:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.818+0000 7f59637fe640 1 -- 172.21.15.5:0/221224275 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16634 (secure 0 0 0) 0x7f59540611a0 con 0x7f596c06de40 2024-05-16T21:32:54.820 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:54.820 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:53.518819+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:51.602373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:52.472465+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:54.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f594c076300 msgr2=0x7f594c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f594c076300 0x7f594c078810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f595c006fd0 tx=0x7f595c008040 comp rx=0 tx=0).stop 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 msgr2=0x7f596c0b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0b86e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f595400d800 tx=0x7f595400dcc0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 shutdown_connections 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f594c076300 0x7f594c078810 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f596c151fc0 0x7f596c14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f596c06de40 0x7f596c0b86e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 --2- 172.21.15.5:0/221224275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f596c06da30 0x7f596c0c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 >> 172.21.15.5:0/221224275 conn(0x7f596c0c3d20 msgr2=0x7f596c0a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 shutdown_connections 2024-05-16T21:32:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.820+0000 7f5970e69640 1 -- 172.21.15.5:0/221224275 wait complete. 2024-05-16T21:32:54.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-16T21:32:54.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.946+0000 7fccbf12e640 1 Processor -- start 2024-05-16T21:32:54.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.946+0000 7fccbf12e640 1 -- start start 2024-05-16T21:32:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbf12e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fccb80be4f0 0x7fccb80bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbf12e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb814cce0 0x7fccb80716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbf12e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fccb8071be0 0x7fccb814f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbf12e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fccb80bfa60 con 0x7fccb80be4f0 2024-05-16T21:32:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbf12e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fccb8071310 con 0x7fccb8071be0 2024-05-16T21:32:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbf12e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80723b0 con 0x7fccb814cce0 2024-05-16T21:32:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbceca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fccb80be4f0 0x7fccb80bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbceca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fccb80be4f0 0x7fccb80bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44734/0 (socket says 172.21.15.5:44734) 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbceca640 1 -- 172.21.15.5:0/4050649568 learned_addr learned my addr 172.21.15.5:0/4050649568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbd6cb640 1 --2- 172.21.15.5:0/4050649568 >> v2:172.21.15.157:3300/0 conn(0x7fccb8071be0 0x7fccb814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccbceca640 1 -- 172.21.15.5:0/4050649568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb814cce0 msgr2=0x7fccb80716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.947+0000 7fccb7fff640 1 --2- 172.21.15.5:0/4050649568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb814cce0 0x7fccb80716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccbceca640 1 --2- 172.21.15.5:0/4050649568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb814cce0 0x7fccb80716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccbceca640 1 -- 172.21.15.5:0/4050649568 >> v2:172.21.15.157:3300/0 conn(0x7fccb8071be0 msgr2=0x7fccb814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccbceca640 1 --2- 172.21.15.5:0/4050649568 >> v2:172.21.15.157:3300/0 conn(0x7fccb8071be0 0x7fccb814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccbceca640 1 -- 172.21.15.5:0/4050649568 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80720d0 con 0x7fccb80be4f0 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccbd6cb640 1 --2- 172.21.15.5:0/4050649568 >> v2:172.21.15.157:3300/0 conn(0x7fccb8071be0 0x7fccb814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccb7fff640 1 --2- 172.21.15.5:0/4050649568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb814cce0 0x7fccb80716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccbceca640 1 --2- 172.21.15.5:0/4050649568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb80be4f0 0x7fccb80bfef0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fccb80727b0 tx=0x7fccac02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baae575f2d31abc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccb77fe640 1 -- 172.21.15.5:0/4050649568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac037070 con 0x7fccb80be4f0 2024-05-16T21:32:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccb77fe640 1 -- 172.21.15.5:0/4050649568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccac032440 con 0x7fccb80be4f0 2024-05-16T21:32:54.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.948+0000 7fccb77fe640 1 -- 172.21.15.5:0/4050649568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac032810 con 0x7fccb80be4f0 2024-05-16T21:32:54.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 -- 172.21.15.5:0/4050649568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb80be4f0 msgr2=0x7fccb80bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 --2- 172.21.15.5:0/4050649568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb80be4f0 0x7fccb80bfef0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fccb80727b0 tx=0x7fccac02a140 comp rx=0 tx=0).stop 2024-05-16T21:32:54.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 -- 172.21.15.5:0/4050649568 shutdown_connections 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 --2- 172.21.15.5:0/4050649568 >> v2:172.21.15.157:3300/0 conn(0x7fccb8071be0 0x7fccb814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 --2- 172.21.15.5:0/4050649568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb814cce0 0x7fccb80716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 --2- 172.21.15.5:0/4050649568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb80be4f0 0x7fccb80bfef0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 -- 172.21.15.5:0/4050649568 >> 172.21.15.5:0/4050649568 conn(0x7fccb80c17c0 msgr2=0x7fccb80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 -- 172.21.15.5:0/4050649568 shutdown_connections 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.949+0000 7fccbf12e640 1 -- 172.21.15.5:0/4050649568 wait complete. 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.951+0000 7fccbf12e640 1 Processor -- start 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.951+0000 7fccbf12e640 1 -- start start 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbf12e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccb8071be0 0x7fccb81e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbf12e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb80be4f0 0x7fccb8143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbf12e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb814cce0 0x7fccb8147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbf12e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80c0430 con 0x7fccb814cce0 2024-05-16T21:32:54.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbf12e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80be900 con 0x7fccb8071be0 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbf12e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80a6c90 con 0x7fccb80be4f0 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbd6cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb814cce0 0x7fccb8147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbd6cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb814cce0 0x7fccb8147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44750/0 (socket says 172.21.15.5:44750) 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbd6cb640 1 -- 172.21.15.5:0/1323179815 learned_addr learned my addr 172.21.15.5:0/1323179815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbceca640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccb8071be0 0x7fccb81e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccb7fff640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb80be4f0 0x7fccb8143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbd6cb640 1 -- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb80be4f0 msgr2=0x7fccb8143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbd6cb640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb80be4f0 0x7fccb8143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbd6cb640 1 -- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccb8071be0 msgr2=0x7fccb81e5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbd6cb640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccb8071be0 0x7fccb81e5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.952+0000 7fccbd6cb640 1 -- 172.21.15.5:0/1323179815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb8147b70 con 0x7fccb814cce0 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.953+0000 7fccbd6cb640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb814cce0 0x7fccb8147630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fccb000cd40 tx=0x7fccb000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.953+0000 7fccb57fa640 1 -- 172.21.15.5:0/1323179815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb000f680 con 0x7fccb814cce0 2024-05-16T21:32:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.953+0000 7fccb57fa640 1 -- 172.21.15.5:0/1323179815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb000f840 con 0x7fccb814cce0 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.953+0000 7fccb57fa640 1 -- 172.21.15.5:0/1323179815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb000fc30 con 0x7fccb814cce0 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.953+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb80a1080 con 0x7fccb814cce0 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.953+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb81440e0 con 0x7fccb814cce0 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.954+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb8050940 con 0x7fccb814cce0 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.954+0000 7fccb57fa640 1 -- 172.21.15.5:0/1323179815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fccb00213f0 con 0x7fccb814cce0 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.955+0000 7fccb57fa640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcc9c076300 0x7fcc9c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.955+0000 7fccb57fa640 1 -- 172.21.15.5:0/1323179815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fccb00982a0 con 0x7fccb814cce0 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.955+0000 7fccbceca640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcc9c076300 0x7fcc9c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.956+0000 7fccbceca640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcc9c076300 0x7fcc9c078810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccac034000 tx=0x7fccac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:54.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:54.960+0000 7fccb57fa640 1 -- 172.21.15.5:0/1323179815 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fccb0014030 con 0x7fccb814cce0 2024-05-16T21:32:55.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:55.193+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fccb80c0e20 con 0x7fccb814cce0 2024-05-16T21:32:56.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:32:56.042 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:32:56.045 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:32:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.141+0000 7fccb57fa640 1 -- 172.21.15.5:0/1323179815 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7fccb0061c90 con 0x7fccb814cce0 2024-05-16T21:32:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcc9c076300 msgr2=0x7fcc9c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcc9c076300 0x7fcc9c078810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccac034000 tx=0x7fccac02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb814cce0 msgr2=0x7fccb8147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb814cce0 0x7fccb8147630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fccb000cd40 tx=0x7fccb000a650 comp rx=0 tx=0).stop 2024-05-16T21:32:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 shutdown_connections 2024-05-16T21:32:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcc9c076300 0x7fcc9c078810 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb814cce0 0x7fccb8147630 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fccb80be4f0 0x7fccb8143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 --2- 172.21.15.5:0/1323179815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccb8071be0 0x7fccb81e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 >> 172.21.15.5:0/1323179815 conn(0x7fccb80c17c0 msgr2=0x7fccb80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 shutdown_connections 2024-05-16T21:32:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.144+0000 7fccbf12e640 1 -- 172.21.15.5:0/1323179815 wait complete. 2024-05-16T21:32:56.159 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-16T21:32:56.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-16T21:32:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.320+0000 7f6b58938640 1 Processor -- start 2024-05-16T21:32:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.320+0000 7f6b58938640 1 -- start start 2024-05-16T21:32:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.321+0000 7f6b58938640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b540bf050 0x7f6b54159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.321+0000 7f6b58938640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b5406e140 con 0x7f6b54151fc0 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.321+0000 7f6b58938640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b540c36f0 con 0x7f6b540bd6d0 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.321+0000 7f6b58938640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6b54152530 con 0x7f6b540bf050 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.321+0000 7f6b5259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6b54151fc0 0x7f6b5406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34016/0 (socket says 172.21.15.5:34016) 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.321+0000 7f6b5259c640 1 -- 172.21.15.5:0/1513316477 learned_addr learned my addr 172.21.15.5:0/1513316477 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.321+0000 7f6b52d9d640 1 --2- 172.21.15.5:0/1513316477 >> v2:172.21.15.5:3300/0 conn(0x7f6b540bf050 0x7f6b54159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.322+0000 7f6b52d9d640 1 -- 172.21.15.5:0/1513316477 >> v1:172.21.15.157:6789/0 conn(0x7f6b540bd6d0 legacy=0x7f6b540be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.322+0000 7f6b5159a640 1 -- 172.21.15.5:0/1513316477 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531732285 0 0) 0x7f6b4c001110 con 0x7f6b54151fc0 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.322+0000 7f6b52d9d640 1 -- 172.21.15.5:0/1513316477 >> v1:172.21.15.5:6789/0 conn(0x7f6b54151fc0 legacy=0x7f6b5406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.322+0000 7f6b52d9d640 1 -- 172.21.15.5:0/1513316477 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b54152810 con 0x7f6b540bf050 2024-05-16T21:32:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.323+0000 7f6b52d9d640 1 --2- 172.21.15.5:0/1513316477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bf050 0x7f6b54159ea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009d90 tx=0x7f6b4402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6492fee44b200ad server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.323+0000 7f6b5159a640 1 -- 172.21.15.5:0/1513316477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44007740 con 0x7f6b540bf050 2024-05-16T21:32:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.323+0000 7f6b5159a640 1 -- 172.21.15.5:0/1513316477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b440078e0 con 0x7f6b540bf050 2024-05-16T21:32:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.323+0000 7f6b5159a640 1 -- 172.21.15.5:0/1513316477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44007cb0 con 0x7f6b540bf050 2024-05-16T21:32:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.323+0000 7f6b58938640 1 -- 172.21.15.5:0/1513316477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bf050 msgr2=0x7f6b54159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.323+0000 7f6b58938640 1 --2- 172.21.15.5:0/1513316477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bf050 0x7f6b54159ea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009d90 tx=0x7f6b4402a6f0 comp rx=0 tx=0).stop 2024-05-16T21:32:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.324+0000 7f6b58938640 1 -- 172.21.15.5:0/1513316477 shutdown_connections 2024-05-16T21:32:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.324+0000 7f6b58938640 1 --2- 172.21.15.5:0/1513316477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bf050 0x7f6b54159ea0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.324+0000 7f6b58938640 1 -- 172.21.15.5:0/1513316477 >> 172.21.15.5:0/1513316477 conn(0x7f6b540c3d20 msgr2=0x7f6b540c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.324+0000 7f6b58938640 1 -- 172.21.15.5:0/1513316477 shutdown_connections 2024-05-16T21:32:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.324+0000 7f6b58938640 1 -- 172.21.15.5:0/1513316477 wait complete. 2024-05-16T21:32:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.325+0000 7f6b58938640 1 Processor -- start 2024-05-16T21:32:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.325+0000 7f6b58938640 1 -- start start 2024-05-16T21:32:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.326+0000 7f6b58938640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bd6d0 0x7f6b5414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.326+0000 7f6b58938640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b540bf050 0x7f6b541e4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.326+0000 7f6b58938640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b54151fc0 0x7f6b540b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.326+0000 7f6b58938640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6b540a2ed0 con 0x7f6b540bd6d0 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.326+0000 7f6b58938640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6b540bdae0 con 0x7f6b54151fc0 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.326+0000 7f6b58938640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6b540a3050 con 0x7f6b540bf050 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.326+0000 7f6b5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bd6d0 0x7f6b5414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bd6d0 0x7f6b5414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44766/0 (socket says 172.21.15.5:44766) 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b5259c640 1 -- 172.21.15.5:0/2928670356 learned_addr learned my addr 172.21.15.5:0/2928670356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b52d9d640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b54151fc0 0x7f6b540b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b51d9b640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b540bf050 0x7f6b541e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b5259c640 1 -- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b540bf050 msgr2=0x7f6b541e4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b5259c640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b540bf050 0x7f6b541e4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b5259c640 1 -- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b54151fc0 msgr2=0x7f6b540b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b5259c640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b54151fc0 0x7f6b540b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b5259c640 1 -- 172.21.15.5:0/2928670356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b541e4e70 con 0x7f6b540bd6d0 2024-05-16T21:32:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b5259c640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bd6d0 0x7f6b5414ebd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c3a0 tx=0x7f6b4c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b4affd640 1 -- 172.21.15.5:0/2928670356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c017070 con 0x7f6b540bd6d0 2024-05-16T21:32:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b4affd640 1 -- 172.21.15.5:0/2928670356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4c005ce0 con 0x7f6b540bd6d0 2024-05-16T21:32:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b540b8ca0 con 0x7f6b540bd6d0 2024-05-16T21:32:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b4affd640 1 -- 172.21.15.5:0/2928670356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c007310 con 0x7f6b540bd6d0 2024-05-16T21:32:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.327+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b540b8f60 con 0x7f6b540bd6d0 2024-05-16T21:32:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.328+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b541462a0 con 0x7f6b540bd6d0 2024-05-16T21:32:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.329+0000 7f6b4affd640 1 -- 172.21.15.5:0/2928670356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b4c01a070 con 0x7f6b540bd6d0 2024-05-16T21:32:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.329+0000 7f6b4affd640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6b340762d0 0x7f6b340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.330+0000 7f6b4affd640 1 -- 172.21.15.5:0/2928670356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6b4c0968f0 con 0x7f6b540bd6d0 2024-05-16T21:32:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.330+0000 7f6b51d9b640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6b340762d0 0x7f6b340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.331+0000 7f6b51d9b640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6b340762d0 0x7f6b340787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6b541e8d40 tx=0x7f6b3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.334+0000 7f6b4affd640 1 -- 172.21.15.5:0/2928670356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6b5406e140 con 0x7f6b540bd6d0 2024-05-16T21:32:56.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:56.566+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6b540ba460 con 0x7f6b540bd6d0 2024-05-16T21:32:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.146+0000 7f6b4affd640 1 -- 172.21.15.5:0/2928670356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f6b4c05fb60 con 0x7f6b540bd6d0 2024-05-16T21:32:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6b340762d0 msgr2=0x7f6b340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6b340762d0 0x7f6b340787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6b541e8d40 tx=0x7f6b3c009040 comp rx=0 tx=0).stop 2024-05-16T21:32:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bd6d0 msgr2=0x7f6b5414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bd6d0 0x7f6b5414ebd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c3a0 tx=0x7f6b4c00c860 comp rx=0 tx=0).stop 2024-05-16T21:32:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 shutdown_connections 2024-05-16T21:32:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6b340762d0 0x7f6b340787e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b54151fc0 0x7f6b540b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b540bf050 0x7f6b541e4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 --2- 172.21.15.5:0/2928670356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b540bd6d0 0x7f6b5414ebd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 >> 172.21.15.5:0/2928670356 conn(0x7f6b540c3d20 msgr2=0x7f6b540be940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 shutdown_connections 2024-05-16T21:32:57.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.148+0000 7f6b58938640 1 -- 172.21.15.5:0/2928670356 wait complete. 2024-05-16T21:32:57.163 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-16T21:32:57.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:57.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.276+0000 7fdba48a8640 1 Processor -- start 2024-05-16T21:32:57.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.276+0000 7fdba48a8640 1 -- start start 2024-05-16T21:32:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.277+0000 7fdba48a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba0151fc0 0x7fdba00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.277+0000 7fdba48a8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdba00bf050 0x7fdba0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.277+0000 7fdba48a8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba00c36f0 con 0x7fdba006da30 2024-05-16T21:32:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.277+0000 7fdba48a8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdba00bdc10 con 0x7fdba00bf050 2024-05-16T21:32:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.277+0000 7fdba48a8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdba0152530 con 0x7fdba0151fc0 2024-05-16T21:32:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.278+0000 7fdb9ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdba00bf050 0x7fdba0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.278+0000 7fdb9ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdba00bf050 0x7fdba0158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46626/0 (socket says 172.21.15.5:46626) 2024-05-16T21:32:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.278+0000 7fdb9ed9d640 1 -- 172.21.15.5:0/564101010 learned_addr learned my addr 172.21.15.5:0/564101010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.278+0000 7fdb9e59c640 1 --2- 172.21.15.5:0/564101010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba0151fc0 0x7fdba00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.278+0000 7fdb9ed9d640 1 -- 172.21.15.5:0/564101010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba0151fc0 msgr2=0x7fdba00bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.278+0000 7fdb9ed9d640 1 --2- 172.21.15.5:0/564101010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba0151fc0 0x7fdba00bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.278+0000 7fdb9ed9d640 1 -- 172.21.15.5:0/564101010 >> v1:172.21.15.157:6789/0 conn(0x7fdba006da30 legacy=0x7fdba00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.278+0000 7fdb9ed9d640 1 -- 172.21.15.5:0/564101010 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba0152810 con 0x7fdba00bf050 2024-05-16T21:32:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.279+0000 7fdb9ed9d640 1 --2- 172.21.15.5:0/564101010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba00bf050 0x7fdba0158e90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009e50 tx=0x7fdb9002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c88bfbfb9a81304 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.279+0000 7fdb9d59a640 1 -- 172.21.15.5:0/564101010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90036070 con 0x7fdba00bf050 2024-05-16T21:32:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.279+0000 7fdb9d59a640 1 -- 172.21.15.5:0/564101010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb90031600 con 0x7fdba00bf050 2024-05-16T21:32:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.279+0000 7fdb9d59a640 1 -- 172.21.15.5:0/564101010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb900319d0 con 0x7fdba00bf050 2024-05-16T21:32:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.279+0000 7fdba48a8640 1 -- 172.21.15.5:0/564101010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba00bf050 msgr2=0x7fdba0158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.279+0000 7fdba48a8640 1 --2- 172.21.15.5:0/564101010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba00bf050 0x7fdba0158e90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009e50 tx=0x7fdb9002a680 comp rx=0 tx=0).stop 2024-05-16T21:32:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.280+0000 7fdba48a8640 1 -- 172.21.15.5:0/564101010 shutdown_connections 2024-05-16T21:32:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.280+0000 7fdba48a8640 1 --2- 172.21.15.5:0/564101010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba00bf050 0x7fdba0158e90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.280+0000 7fdba48a8640 1 --2- 172.21.15.5:0/564101010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba0151fc0 0x7fdba00bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.280+0000 7fdba48a8640 1 -- 172.21.15.5:0/564101010 >> 172.21.15.5:0/564101010 conn(0x7fdba00c3d20 msgr2=0x7fdba00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.280+0000 7fdba48a8640 1 -- 172.21.15.5:0/564101010 shutdown_connections 2024-05-16T21:32:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.280+0000 7fdba48a8640 1 -- 172.21.15.5:0/564101010 wait complete. 2024-05-16T21:32:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.281+0000 7fdba48a8640 1 Processor -- start 2024-05-16T21:32:57.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.281+0000 7fdba48a8640 1 -- start start 2024-05-16T21:32:57.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdba48a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba006da30 0x7fdba01e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdba48a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba00bf050 0x7fdba00b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdba48a8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba0151fc0 0x7fdba014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdba48a8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00a3050 con 0x7fdba006da30 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdba48a8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00a2ed0 con 0x7fdba0151fc0 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdba48a8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdba006de40 con 0x7fdba00bf050 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdb9e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba006da30 0x7fdba01e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdb9e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba006da30 0x7fdba01e7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46634/0 (socket says 172.21.15.5:46634) 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.282+0000 7fdb9e59c640 1 -- 172.21.15.5:0/3411759834 learned_addr learned my addr 172.21.15.5:0/3411759834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9ed9d640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba0151fc0 0x7fdba014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9dd9b640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba00bf050 0x7fdba00b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9e59c640 1 -- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba00bf050 msgr2=0x7fdba00b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9e59c640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba00bf050 0x7fdba00b86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9e59c640 1 -- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba0151fc0 msgr2=0x7fdba014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9e59c640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba0151fc0 0x7fdba014b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9e59c640 1 -- 172.21.15.5:0/3411759834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba00b9dd0 con 0x7fdba006da30 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9dd9b640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba00bf050 0x7fdba00b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb9e59c640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba006da30 0x7fdba01e7c60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800d620 tx=0x7fdb9800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb96ffd640 1 -- 172.21.15.5:0/3411759834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800b620 con 0x7fdba006da30 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb96ffd640 1 -- 172.21.15.5:0/3411759834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb98019070 con 0x7fdba006da30 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba01e81a0 con 0x7fdba006da30 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdb96ffd640 1 -- 172.21.15.5:0/3411759834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800ba00 con 0x7fdba006da30 2024-05-16T21:32:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.283+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba00b90c0 con 0x7fdba006da30 2024-05-16T21:32:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.284+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba00bd080 con 0x7fdba006da30 2024-05-16T21:32:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.285+0000 7fdb96ffd640 1 -- 172.21.15.5:0/3411759834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb9800bba0 con 0x7fdba006da30 2024-05-16T21:32:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.285+0000 7fdb96ffd640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb80076300 0x7fdb80078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.286+0000 7fdb96ffd640 1 -- 172.21.15.5:0/3411759834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fdb98097a90 con 0x7fdba006da30 2024-05-16T21:32:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.286+0000 7fdb9dd9b640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb80076300 0x7fdb80078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.286+0000 7fdb9dd9b640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb80076300 0x7fdb80078810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdba00a4be0 tx=0x7fdb88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.290+0000 7fdb96ffd640 1 -- 172.21.15.5:0/3411759834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdb980612c0 con 0x7fdba006da30 2024-05-16T21:32:57.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.522+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdba0050940 con 0x7fdba006da30 2024-05-16T21:32:57.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.523+0000 7fdb96ffd640 1 -- 172.21.15.5:0/3411759834 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4353 (secure 0 0 0) 0x7fdb98060bc0 con 0x7fdba006da30 2024-05-16T21:32:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:57.525 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2890333934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2890333934},{"type":"v1","addr":"172.21.15.5:6834","nonce":2890333934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3111678801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3111678801},{"type":"v1","addr":"172.21.15.157:6835","nonce":3111678801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:53.518776+0000","modified":"2024-05-16T21:32:56.567421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4692},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4692":{"gid":4692,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2543237506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543237506},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543237506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4692,"qdb_cluster":[4692]},"id":2}]} 2024-05-16T21:32:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-05-16T21:32:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.524+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb80076300 msgr2=0x7fdb80078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.524+0000 7fdba48a8640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb80076300 0x7fdb80078810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdba00a4be0 tx=0x7fdb88009040 comp rx=0 tx=0).stop 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.524+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba006da30 msgr2=0x7fdba01e7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.524+0000 7fdba48a8640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba006da30 0x7fdba01e7c60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800d620 tx=0x7fdb9800dae0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.525+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 shutdown_connections 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.525+0000 7fdba48a8640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb80076300 0x7fdb80078810 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.525+0000 7fdba48a8640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdba0151fc0 0x7fdba014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.525+0000 7fdba48a8640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdba00bf050 0x7fdba00b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.525+0000 7fdba48a8640 1 --2- 172.21.15.5:0/3411759834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba006da30 0x7fdba01e7c60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.525+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 >> 172.21.15.5:0/3411759834 conn(0x7fdba00c3d20 msgr2=0x7fdba00c2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.525+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 shutdown_connections 2024-05-16T21:32:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.525+0000 7fdba48a8640 1 -- 172.21.15.5:0/3411759834 wait complete. 2024-05-16T21:32:57.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:32:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.647+0000 7f0adf696640 1 Processor -- start 2024-05-16T21:32:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.647+0000 7f0adf696640 1 -- start start 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.648+0000 7f0adf696640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ad8074b00 0x7f0ad806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.648+0000 7f0adf696640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ad80be3f0 0x7f0ad814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.648+0000 7f0adf696640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad806ce00 con 0x7f0ad814fad0 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.648+0000 7f0adf696640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad80bb470 con 0x7f0ad80be3f0 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.648+0000 7f0adf696640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad80bb890 con 0x7f0ad8074b00 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0adcc31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ad80be3f0 0x7f0ad814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0adcc31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ad80be3f0 0x7f0ad814cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46640/0 (socket says 172.21.15.5:46640) 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0adcc31640 1 -- 172.21.15.5:0/2054062727 learned_addr learned my addr 172.21.15.5:0/2054062727 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0add432640 1 --2- 172.21.15.5:0/2054062727 >> v2:172.21.15.157:3300/0 conn(0x7f0ad8074b00 0x7f0ad806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0adcc31640 1 -- 172.21.15.5:0/2054062727 >> v2:172.21.15.157:3300/0 conn(0x7f0ad8074b00 msgr2=0x7f0ad806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0adcc31640 1 --2- 172.21.15.5:0/2054062727 >> v2:172.21.15.157:3300/0 conn(0x7f0ad8074b00 0x7f0ad806c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0adcc31640 1 -- 172.21.15.5:0/2054062727 >> v1:172.21.15.157:6789/0 conn(0x7f0ad814fad0 legacy=0x7f0ad814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0adcc31640 1 -- 172.21.15.5:0/2054062727 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad80bbb30 con 0x7f0ad80be3f0 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.649+0000 7f0add432640 1 --2- 172.21.15.5:0/2054062727 >> v2:172.21.15.157:3300/0 conn(0x7f0ad8074b00 0x7f0ad806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.650+0000 7f0adcc31640 1 --2- 172.21.15.5:0/2054062727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad80be3f0 0x7f0ad814cb20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ad806d7a0 tx=0x7f0acc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df97586393fe2ebf server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.650+0000 7f0ad7fff640 1 -- 172.21.15.5:0/2054062727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc037070 con 0x7f0ad80be3f0 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.650+0000 7f0ad7fff640 1 -- 172.21.15.5:0/2054062727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc032440 con 0x7f0ad80be3f0 2024-05-16T21:32:57.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.650+0000 7f0ad7fff640 1 -- 172.21.15.5:0/2054062727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc032810 con 0x7f0ad80be3f0 2024-05-16T21:32:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.650+0000 7f0adf696640 1 -- 172.21.15.5:0/2054062727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad80be3f0 msgr2=0x7f0ad814cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.650+0000 7f0adf696640 1 --2- 172.21.15.5:0/2054062727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad80be3f0 0x7f0ad814cb20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ad806d7a0 tx=0x7f0acc02a140 comp rx=0 tx=0).stop 2024-05-16T21:32:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.650+0000 7f0adf696640 1 -- 172.21.15.5:0/2054062727 shutdown_connections 2024-05-16T21:32:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.650+0000 7f0adf696640 1 --2- 172.21.15.5:0/2054062727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad80be3f0 0x7f0ad814cb20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.651+0000 7f0adf696640 1 --2- 172.21.15.5:0/2054062727 >> v2:172.21.15.157:3300/0 conn(0x7f0ad8074b00 0x7f0ad806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.651+0000 7f0adf696640 1 -- 172.21.15.5:0/2054062727 >> 172.21.15.5:0/2054062727 conn(0x7f0ad80bd0f0 msgr2=0x7f0ad80bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.651+0000 7f0adf696640 1 -- 172.21.15.5:0/2054062727 shutdown_connections 2024-05-16T21:32:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.651+0000 7f0adf696640 1 -- 172.21.15.5:0/2054062727 wait complete. 2024-05-16T21:32:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.652+0000 7f0adf696640 1 Processor -- start 2024-05-16T21:32:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.652+0000 7f0adf696640 1 -- start start 2024-05-16T21:32:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0adf696640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad8074b00 0x7f0ad8148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0adf696640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ad80be3f0 0x7f0ad81e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0adf696640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ad814fad0 0x7f0ad813f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0adf696640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80bc3d0 con 0x7f0ad8074b00 2024-05-16T21:32:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0adf696640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80bc0f0 con 0x7f0ad80be3f0 2024-05-16T21:32:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0adf696640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad814d060 con 0x7f0ad814fad0 2024-05-16T21:32:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0add432640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad8074b00 0x7f0ad8148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0add432640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad8074b00 0x7f0ad8148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46646/0 (socket says 172.21.15.5:46646) 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.653+0000 7f0add432640 1 -- 172.21.15.5:0/1008377282 learned_addr learned my addr 172.21.15.5:0/1008377282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0adcc31640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ad80be3f0 0x7f0ad81e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0addc33640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ad814fad0 0x7f0ad813f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0add432640 1 -- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ad814fad0 msgr2=0x7f0ad813f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0add432640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ad814fad0 0x7f0ad813f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0add432640 1 -- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ad80be3f0 msgr2=0x7f0ad81e41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0add432640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ad80be3f0 0x7f0ad81e41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0add432640 1 -- 172.21.15.5:0/1008377282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad8148a50 con 0x7f0ad8074b00 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0add432640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad8074b00 0x7f0ad8148510 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c850 tx=0x7f0ad000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0ad5ffb640 1 -- 172.21.15.5:0/1008377282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0015070 con 0x7f0ad8074b00 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0ad5ffb640 1 -- 172.21.15.5:0/1008377282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad0007830 con 0x7f0ad8074b00 2024-05-16T21:32:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad81e46e0 con 0x7f0ad8074b00 2024-05-16T21:32:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0ad5ffb640 1 -- 172.21.15.5:0/1008377282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0007be0 con 0x7f0ad8074b00 2024-05-16T21:32:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.654+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad80a48c0 con 0x7f0ad8074b00 2024-05-16T21:32:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.655+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad8146870 con 0x7f0ad8074b00 2024-05-16T21:32:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.656+0000 7f0ad5ffb640 1 -- 172.21.15.5:0/1008377282 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ad0018070 con 0x7f0ad8074b00 2024-05-16T21:32:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.656+0000 7f0ad5ffb640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0ac4076300 0x7f0ac4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.656+0000 7f0ad5ffb640 1 -- 172.21.15.5:0/1008377282 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0ad00973c0 con 0x7f0ad8074b00 2024-05-16T21:32:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.657+0000 7f0adcc31640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0ac4076300 0x7f0ac4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.657+0000 7f0adcc31640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0ac4076300 0x7f0ac4078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0acc034000 tx=0x7f0acc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.661+0000 7f0ad5ffb640 1 -- 172.21.15.5:0/1008377282 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ad0060db0 con 0x7f0ad8074b00 2024-05-16T21:32:57.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.851+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ad8050940 con 0x7f0ad8074b00 2024-05-16T21:32:57.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.853+0000 7f0ad5ffb640 1 -- 172.21.15.5:0/1008377282 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16621 (secure 0 0 0) 0x7f0ad00606b0 con 0x7f0ad8074b00 2024-05-16T21:32:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:57.855 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:55.121195+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:51.602373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:52.472465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0ac4076300 msgr2=0x7f0ac4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0ac4076300 0x7f0ac4078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0acc034000 tx=0x7f0acc02e000 comp rx=0 tx=0).stop 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad8074b00 msgr2=0x7f0ad8148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad8074b00 0x7f0ad8148510 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c850 tx=0x7f0ad000cd10 comp rx=0 tx=0).stop 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 shutdown_connections 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0ac4076300 0x7f0ac4078810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ad814fad0 0x7f0ad813f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ad80be3f0 0x7f0ad81e41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 --2- 172.21.15.5:0/1008377282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ad8074b00 0x7f0ad8148510 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 >> 172.21.15.5:0/1008377282 conn(0x7f0ad80bd0f0 msgr2=0x7f0ad80be890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:57.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 shutdown_connections 2024-05-16T21:32:57.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.855+0000 7f0adf696640 1 -- 172.21.15.5:0/1008377282 wait complete. 2024-05-16T21:32:57.868 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T21:32:57.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T21:32:57.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.977+0000 7f5c2c63b640 1 Processor -- start 2024-05-16T21:32:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.977+0000 7f5c2c63b640 1 -- start start 2024-05-16T21:32:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c2c63b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5c240bb940 0x7f5c241462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c2c63b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c240a40b0 con 0x7f5c2414fa20 2024-05-16T21:32:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c2c63b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c240a4390 con 0x7f5c240a3bd0 2024-05-16T21:32:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c2c63b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5c240a49e0 con 0x7f5c240bb940 2024-05-16T21:32:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c2abd8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5c2414fa20 0x7f5c2414fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54390/0 (socket says 172.21.15.5:54390) 2024-05-16T21:32:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c2abd8640 1 -- 172.21.15.5:0/2622394818 learned_addr learned my addr 172.21.15.5:0/2622394818 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c29bd6640 1 --2- 172.21.15.5:0/2622394818 >> v2:172.21.15.157:3300/0 conn(0x7f5c240bb940 0x7f5c241462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971178086 0 0) 0x7f5c240a40b0 con 0x7f5c2414fa20 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.978+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c10003520 con 0x7f5c2414fa20 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315609884 0 0) 0x7f5c240a4390 con 0x7f5c240a3bd0 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c240a40b0 con 0x7f5c240a3bd0 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1439617326 0 0) 0x7f5c10003520 con 0x7f5c2414fa20 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 >> v2:172.21.15.157:3300/0 conn(0x7f5c240bb940 msgr2=0x7f5c241462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 --2- 172.21.15.5:0/2622394818 >> v2:172.21.15.157:3300/0 conn(0x7f5c240bb940 0x7f5c241462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 >> v1:172.21.15.157:6789/0 conn(0x7f5c240a3bd0 legacy=0x7f5c240bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c240a4670 con 0x7f5c2414fa20 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f5c1c001a70 con 0x7f5c2414fa20 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c29bd6640 1 --2- 172.21.15.5:0/2622394818 >> v2:172.21.15.157:3300/0 conn(0x7f5c240bb940 0x7f5c241462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 >> v1:172.21.15.5:6789/0 conn(0x7f5c2414fa20 legacy=0x7f5c2414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10003c30 0x7f5c10004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c10004800 0x7f5c10004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c10005280 0x7f5c1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c240a49e0 con 0x7f5c10004800 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1000c230 con 0x7f5c10003c30 2024-05-16T21:32:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1000c430 con 0x7f5c10005280 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c29bd6640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c10004800 0x7f5c10004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c2a3d7640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10003c30 0x7f5c10004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c2abd8640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c10005280 0x7f5c1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c29bd6640 1 -- 172.21.15.5:0/2622394818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c10005280 msgr2=0x7f5c1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c29bd6640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c10005280 0x7f5c1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c29bd6640 1 -- 172.21.15.5:0/2622394818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10003c30 msgr2=0x7f5c10004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c29bd6640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10003c30 0x7f5c10004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c29bd6640 1 -- 172.21.15.5:0/2622394818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c10003520 con 0x7f5c10004800 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.979+0000 7f5c2abd8640 1 -- 172.21.15.5:0/2622394818 reap_dead start 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.980+0000 7f5c29bd6640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c10004800 0x7f5c10004c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009c60 tx=0x7f5c10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f403ad3eeabb1da5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.980+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14009860 con 0x7f5c10004800 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.980+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c14004020 con 0x7f5c10004800 2024-05-16T21:32:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.980+0000 7f5c293d5640 1 -- 172.21.15.5:0/2622394818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c140043f0 con 0x7f5c10004800 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.981+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2622394818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c10004800 msgr2=0x7f5c10004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.981+0000 7f5c2c63b640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c10004800 0x7f5c10004c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009c60 tx=0x7f5c10005830 comp rx=0 tx=0).stop 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.981+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2622394818 shutdown_connections 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.981+0000 7f5c2c63b640 1 --2- 172.21.15.5:0/2622394818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c10004800 0x7f5c10004c10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.981+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2622394818 >> 172.21.15.5:0/2622394818 conn(0x7f5c240a1ac0 msgr2=0x7f5c240bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.981+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2622394818 shutdown_connections 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.981+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2622394818 wait complete. 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.982+0000 7f5c2c63b640 1 Processor -- start 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.983+0000 7f5c2c63b640 1 -- start start 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2c63b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10004800 0x7f5c241e2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2c63b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c24148570 0x7f5c2414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2c63b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c2414cdc0 0x7f5c241d8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2c63b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c240bc8d0 con 0x7f5c2414cdc0 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2c63b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5c240bbdb0 con 0x7f5c10004800 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2c63b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5c240bca50 con 0x7f5c24148570 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c2414cdc0 0x7f5c241d8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c2414cdc0 0x7f5c241d8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46664/0 (socket says 172.21.15.5:46664) 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 -- 172.21.15.5:0/2385123243 learned_addr learned my addr 172.21.15.5:0/2385123243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2a3d7640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10004800 0x7f5c241e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c29bd6640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c24148570 0x7f5c2414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 -- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c24148570 msgr2=0x7f5c2414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c24148570 0x7f5c2414c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 -- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10004800 msgr2=0x7f5c241e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10004800 0x7f5c241e2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 -- 172.21.15.5:0/2385123243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c241e64f0 con 0x7f5c2414cdc0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2abd8640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c2414cdc0 0x7f5c241d8840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5c240bd3b0 tx=0x7f5c1c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c1affd640 1 -- 172.21.15.5:0/2385123243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c00ea00 con 0x7f5c2414cdc0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c1affd640 1 -- 172.21.15.5:0/2385123243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c00ebe0 con 0x7f5c2414cdc0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c241e5730 con 0x7f5c2414cdc0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.984+0000 7f5c1affd640 1 -- 172.21.15.5:0/2385123243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c014430 con 0x7f5c2414cdc0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.985+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c241e5cf0 con 0x7f5c2414cdc0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.986+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c24050940 con 0x7f5c2414cdc0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.986+0000 7f5c1affd640 1 -- 172.21.15.5:0/2385123243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c1c0145d0 con 0x7f5c2414cdc0 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.986+0000 7f5c1affd640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c080762d0 0x7f5c080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.987+0000 7f5c1affd640 1 -- 172.21.15.5:0/2385123243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5c1c0972c0 con 0x7f5c2414cdc0 2024-05-16T21:32:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.987+0000 7f5c2a3d7640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c080762d0 0x7f5c080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.987+0000 7f5c2a3d7640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c080762d0 0x7f5c080787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5c200018f0 tx=0x7f5c20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:57.991+0000 7f5c1affd640 1 -- 172.21.15.5:0/2385123243 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c1c060530 con 0x7f5c2414cdc0 2024-05-16T21:32:58.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.178+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c24073b10 con 0x7f5c080762d0 2024-05-16T21:32:58.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.185+0000 7f5c1affd640 1 -- 172.21.15.5:0/2385123243 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251869 (secure 0 0 0) 0x7f5c24073b10 con 0x7f5c080762d0 2024-05-16T21:32:58.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T21:32:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c080762d0 msgr2=0x7f5c080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c080762d0 0x7f5c080787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5c200018f0 tx=0x7f5c20009040 comp rx=0 tx=0).stop 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c2414cdc0 msgr2=0x7f5c241d8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c2414cdc0 0x7f5c241d8840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5c240bd3b0 tx=0x7f5c1c007bc0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 shutdown_connections 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c080762d0 0x7f5c080787e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c2414cdc0 0x7f5c241d8840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c24148570 0x7f5c2414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 --2- 172.21.15.5:0/2385123243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10004800 0x7f5c241e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 >> 172.21.15.5:0/2385123243 conn(0x7f5c240a1ac0 msgr2=0x7f5c240b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 shutdown_connections 2024-05-16T21:32:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.188+0000 7f5c2c63b640 1 -- 172.21.15.5:0/2385123243 wait complete. 2024-05-16T21:32:58.201 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-05-16T21:32:56.371427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249040,"kb_used_data":3748,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725680,"statfs":{"total":773094113280,"available":772839096320,"internally_reserved":0,"allocated":3837952,"data_stored":2168631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.256191"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146569+0000","last_change":"2024-05-16T21:32:54.144260+0000","last_active":"2024-05-16T21:32:54.146569+0000","last_peered":"2024-05-16T21:32:54.146569+0000","last_clean":"2024-05-16T21:32:54.146569+0000","last_became_active":"2024-05-16T21:32:54.143512+0000","last_became_peered":"2024-05-16T21:32:54.143512+0000","last_unstale":"2024-05-16T21:32:54.146569+0000","last_undegraded":"2024-05-16T21:32:54.146569+0000","last_fullsized":"2024-05-16T21:32:54.146569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:36.685282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.160479+0000","last_change":"2024-05-16T21:32:54.158383+0000","last_active":"2024-05-16T21:32:54.160479+0000","last_peered":"2024-05-16T21:32:54.160479+0000","last_clean":"2024-05-16T21:32:54.160479+0000","last_became_active":"2024-05-16T21:32:54.157697+0000","last_became_peered":"2024-05-16T21:32:54.157697+0000","last_unstale":"2024-05-16T21:32:54.160479+0000","last_undegraded":"2024-05-16T21:32:54.160479+0000","last_fullsized":"2024-05-16T21:32:54.160479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:03:35.458345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156657+0000","last_change":"2024-05-16T21:32:54.155740+0000","last_active":"2024-05-16T21:32:54.156657+0000","last_peered":"2024-05-16T21:32:54.156657+0000","last_clean":"2024-05-16T21:32:54.156657+0000","last_became_active":"2024-05-16T21:32:54.155396+0000","last_became_peered":"2024-05-16T21:32:54.155396+0000","last_unstale":"2024-05-16T21:32:54.156657+0000","last_undegraded":"2024-05-16T21:32:54.156657+0000","last_fullsized":"2024-05-16T21:32:54.156657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:37:57.741344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.147904+0000","last_change":"2024-05-16T21:32:54.135310+0000","last_active":"2024-05-16T21:32:54.147904+0000","last_peered":"2024-05-16T21:32:54.147904+0000","last_clean":"2024-05-16T21:32:54.147904+0000","last_became_active":"2024-05-16T21:32:54.134525+0000","last_became_peered":"2024-05-16T21:32:54.134525+0000","last_unstale":"2024-05-16T21:32:54.147904+0000","last_undegraded":"2024-05-16T21:32:54.147904+0000","last_fullsized":"2024-05-16T21:32:54.147904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:31:54.037731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157224+0000","last_change":"2024-05-16T21:32:54.144837+0000","last_active":"2024-05-16T21:32:54.157224+0000","last_peered":"2024-05-16T21:32:54.157224+0000","last_clean":"2024-05-16T21:32:54.157224+0000","last_became_active":"2024-05-16T21:32:54.144227+0000","last_became_peered":"2024-05-16T21:32:54.144227+0000","last_unstale":"2024-05-16T21:32:54.157224+0000","last_undegraded":"2024-05-16T21:32:54.157224+0000","last_fullsized":"2024-05-16T21:32:54.157224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:02:17.038915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153437+0000","last_change":"2024-05-16T21:32:54.151234+0000","last_active":"2024-05-16T21:32:54.153437+0000","last_peered":"2024-05-16T21:32:54.153437+0000","last_clean":"2024-05-16T21:32:54.153437+0000","last_became_active":"2024-05-16T21:32:54.150916+0000","last_became_peered":"2024-05-16T21:32:54.150916+0000","last_unstale":"2024-05-16T21:32:54.153437+0000","last_undegraded":"2024-05-16T21:32:54.153437+0000","last_fullsized":"2024-05-16T21:32:54.153437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:41:02.086770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143359+0000","last_change":"2024-05-16T21:32:54.139366+0000","last_active":"2024-05-16T21:32:54.143359+0000","last_peered":"2024-05-16T21:32:54.143359+0000","last_clean":"2024-05-16T21:32:54.143359+0000","last_became_active":"2024-05-16T21:32:54.139038+0000","last_became_peered":"2024-05-16T21:32:54.139038+0000","last_unstale":"2024-05-16T21:32:54.143359+0000","last_undegraded":"2024-05-16T21:32:54.143359+0000","last_fullsized":"2024-05-16T21:32:54.143359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:43:50.481487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.147073+0000","last_change":"2024-05-16T21:32:54.145894+0000","last_active":"2024-05-16T21:32:54.147073+0000","last_peered":"2024-05-16T21:32:54.147073+0000","last_clean":"2024-05-16T21:32:54.147073+0000","last_became_active":"2024-05-16T21:32:54.145575+0000","last_became_peered":"2024-05-16T21:32:54.145575+0000","last_unstale":"2024-05-16T21:32:54.147073+0000","last_undegraded":"2024-05-16T21:32:54.147073+0000","last_fullsized":"2024-05-16T21:32:54.147073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:03.463751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153287+0000","last_change":"2024-05-16T21:32:54.152294+0000","last_active":"2024-05-16T21:32:54.153287+0000","last_peered":"2024-05-16T21:32:54.153287+0000","last_clean":"2024-05-16T21:32:54.153287+0000","last_became_active":"2024-05-16T21:32:54.151754+0000","last_became_peered":"2024-05-16T21:32:54.151754+0000","last_unstale":"2024-05-16T21:32:54.153287+0000","last_undegraded":"2024-05-16T21:32:54.153287+0000","last_fullsized":"2024-05-16T21:32:54.153287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:58.708662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.158334+0000","last_change":"2024-05-16T21:32:54.150287+0000","last_active":"2024-05-16T21:32:54.158334+0000","last_peered":"2024-05-16T21:32:54.158334+0000","last_clean":"2024-05-16T21:32:54.158334+0000","last_became_active":"2024-05-16T21:32:54.149957+0000","last_became_peered":"2024-05-16T21:32:54.149957+0000","last_unstale":"2024-05-16T21:32:54.158334+0000","last_undegraded":"2024-05-16T21:32:54.158334+0000","last_fullsized":"2024-05-16T21:32:54.158334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150305+0000","last_change":"2024-05-16T21:32:54.148664+0000","last_active":"2024-05-16T21:32:54.150305+0000","last_peered":"2024-05-16T21:32:54.150305+0000","last_clean":"2024-05-16T21:32:54.150305+0000","last_became_active":"2024-05-16T21:32:54.147797+0000","last_became_peered":"2024-05-16T21:32:54.147797+0000","last_unstale":"2024-05-16T21:32:54.150305+0000","last_undegraded":"2024-05-16T21:32:54.150305+0000","last_fullsized":"2024-05-16T21:32:54.150305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:40:43.130391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153272+0000","last_change":"2024-05-16T21:32:54.152151+0000","last_active":"2024-05-16T21:32:54.153272+0000","last_peered":"2024-05-16T21:32:54.153272+0000","last_clean":"2024-05-16T21:32:54.153272+0000","last_became_active":"2024-05-16T21:32:54.151865+0000","last_became_peered":"2024-05-16T21:32:54.151865+0000","last_unstale":"2024-05-16T21:32:54.153272+0000","last_undegraded":"2024-05-16T21:32:54.153272+0000","last_fullsized":"2024-05-16T21:32:54.153272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:43:50.481487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159009+0000","last_change":"2024-05-16T21:32:54.156388+0000","last_active":"2024-05-16T21:32:54.159009+0000","last_peered":"2024-05-16T21:32:54.159009+0000","last_clean":"2024-05-16T21:32:54.159009+0000","last_became_active":"2024-05-16T21:32:54.156052+0000","last_became_peered":"2024-05-16T21:32:54.156052+0000","last_unstale":"2024-05-16T21:32:54.159009+0000","last_undegraded":"2024-05-16T21:32:54.159009+0000","last_fullsized":"2024-05-16T21:32:54.159009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:58.634972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148181+0000","last_change":"2024-05-16T21:32:54.145313+0000","last_active":"2024-05-16T21:32:54.148181+0000","last_peered":"2024-05-16T21:32:54.148181+0000","last_clean":"2024-05-16T21:32:54.148181+0000","last_became_active":"2024-05-16T21:32:54.144994+0000","last_became_peered":"2024-05-16T21:32:54.144994+0000","last_unstale":"2024-05-16T21:32:54.148181+0000","last_undegraded":"2024-05-16T21:32:54.148181+0000","last_fullsized":"2024-05-16T21:32:54.148181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:03.463751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.147192+0000","last_change":"2024-05-16T21:32:54.144571+0000","last_active":"2024-05-16T21:32:54.147192+0000","last_peered":"2024-05-16T21:32:54.147192+0000","last_clean":"2024-05-16T21:32:54.147192+0000","last_became_active":"2024-05-16T21:32:54.144222+0000","last_became_peered":"2024-05-16T21:32:54.144222+0000","last_unstale":"2024-05-16T21:32:54.147192+0000","last_undegraded":"2024-05-16T21:32:54.147192+0000","last_fullsized":"2024-05-16T21:32:54.147192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:17:51.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153401+0000","last_change":"2024-05-16T21:32:54.152734+0000","last_active":"2024-05-16T21:32:54.153401+0000","last_peered":"2024-05-16T21:32:54.153401+0000","last_clean":"2024-05-16T21:32:54.153401+0000","last_became_active":"2024-05-16T21:32:54.152034+0000","last_became_peered":"2024-05-16T21:32:54.152034+0000","last_unstale":"2024-05-16T21:32:54.153401+0000","last_undegraded":"2024-05-16T21:32:54.153401+0000","last_fullsized":"2024-05-16T21:32:54.153401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:41:02.086770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.144296+0000","last_change":"2024-05-16T21:32:54.139291+0000","last_active":"2024-05-16T21:32:54.144296+0000","last_peered":"2024-05-16T21:32:54.144296+0000","last_clean":"2024-05-16T21:32:54.144296+0000","last_became_active":"2024-05-16T21:32:54.138977+0000","last_became_peered":"2024-05-16T21:32:54.138977+0000","last_unstale":"2024-05-16T21:32:54.144296+0000","last_undegraded":"2024-05-16T21:32:54.144296+0000","last_fullsized":"2024-05-16T21:32:54.144296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153395+0000","last_change":"2024-05-16T21:32:54.151337+0000","last_active":"2024-05-16T21:32:54.153395+0000","last_peered":"2024-05-16T21:32:54.153395+0000","last_clean":"2024-05-16T21:32:54.153395+0000","last_became_active":"2024-05-16T21:32:54.150993+0000","last_became_peered":"2024-05-16T21:32:54.150993+0000","last_unstale":"2024-05-16T21:32:54.153395+0000","last_undegraded":"2024-05-16T21:32:54.153395+0000","last_fullsized":"2024-05-16T21:32:54.153395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:22:24.752568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.161068+0000","last_change":"2024-05-16T21:32:54.159358+0000","last_active":"2024-05-16T21:32:54.161068+0000","last_peered":"2024-05-16T21:32:54.161068+0000","last_clean":"2024-05-16T21:32:54.161068+0000","last_became_active":"2024-05-16T21:32:54.158921+0000","last_became_peered":"2024-05-16T21:32:54.158921+0000","last_unstale":"2024-05-16T21:32:54.161068+0000","last_undegraded":"2024-05-16T21:32:54.161068+0000","last_fullsized":"2024-05-16T21:32:54.161068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:50:06.562469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157407+0000","last_change":"2024-05-16T21:32:54.148815+0000","last_active":"2024-05-16T21:32:54.157407+0000","last_peered":"2024-05-16T21:32:54.157407+0000","last_clean":"2024-05-16T21:32:54.157407+0000","last_became_active":"2024-05-16T21:32:54.148431+0000","last_became_peered":"2024-05-16T21:32:54.148431+0000","last_unstale":"2024-05-16T21:32:54.157407+0000","last_undegraded":"2024-05-16T21:32:54.157407+0000","last_fullsized":"2024-05-16T21:32:54.157407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:28.954364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146705+0000","last_change":"2024-05-16T21:32:54.136821+0000","last_active":"2024-05-16T21:32:54.146705+0000","last_peered":"2024-05-16T21:32:54.146705+0000","last_clean":"2024-05-16T21:32:54.146705+0000","last_became_active":"2024-05-16T21:32:54.136466+0000","last_became_peered":"2024-05-16T21:32:54.136466+0000","last_unstale":"2024-05-16T21:32:54.146705+0000","last_undegraded":"2024-05-16T21:32:54.146705+0000","last_fullsized":"2024-05-16T21:32:54.146705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:42:09.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148479+0000","last_change":"2024-05-16T21:32:54.141761+0000","last_active":"2024-05-16T21:32:54.148479+0000","last_peered":"2024-05-16T21:32:54.148479+0000","last_clean":"2024-05-16T21:32:54.148479+0000","last_became_active":"2024-05-16T21:32:54.141212+0000","last_became_peered":"2024-05-16T21:32:54.141212+0000","last_unstale":"2024-05-16T21:32:54.148479+0000","last_undegraded":"2024-05-16T21:32:54.148479+0000","last_fullsized":"2024-05-16T21:32:54.148479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:36.685282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.139560+0000","last_change":"2024-05-16T21:32:54.134861+0000","last_active":"2024-05-16T21:32:54.139560+0000","last_peered":"2024-05-16T21:32:54.139560+0000","last_clean":"2024-05-16T21:32:54.139560+0000","last_became_active":"2024-05-16T21:32:54.134552+0000","last_became_peered":"2024-05-16T21:32:54.134552+0000","last_unstale":"2024-05-16T21:32:54.139560+0000","last_undegraded":"2024-05-16T21:32:54.139560+0000","last_fullsized":"2024-05-16T21:32:54.139560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:15:36.925732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150889+0000","last_change":"2024-05-16T21:32:54.147654+0000","last_active":"2024-05-16T21:32:54.150889+0000","last_peered":"2024-05-16T21:32:54.150889+0000","last_clean":"2024-05-16T21:32:54.150889+0000","last_became_active":"2024-05-16T21:32:54.147267+0000","last_became_peered":"2024-05-16T21:32:54.147267+0000","last_unstale":"2024-05-16T21:32:54.150889+0000","last_undegraded":"2024-05-16T21:32:54.150889+0000","last_fullsized":"2024-05-16T21:32:54.150889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146071+0000","last_change":"2024-05-16T21:32:54.129694+0000","last_active":"2024-05-16T21:32:54.146071+0000","last_peered":"2024-05-16T21:32:54.146071+0000","last_clean":"2024-05-16T21:32:54.146071+0000","last_became_active":"2024-05-16T21:32:54.128684+0000","last_became_peered":"2024-05-16T21:32:54.128684+0000","last_unstale":"2024-05-16T21:32:54.146071+0000","last_undegraded":"2024-05-16T21:32:54.146071+0000","last_fullsized":"2024-05-16T21:32:54.146071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:32.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.154560+0000","last_change":"2024-05-16T21:32:54.152246+0000","last_active":"2024-05-16T21:32:54.154560+0000","last_peered":"2024-05-16T21:32:54.154560+0000","last_clean":"2024-05-16T21:32:54.154560+0000","last_became_active":"2024-05-16T21:32:54.151908+0000","last_became_peered":"2024-05-16T21:32:54.151908+0000","last_unstale":"2024-05-16T21:32:54.154560+0000","last_undegraded":"2024-05-16T21:32:54.154560+0000","last_fullsized":"2024-05-16T21:32:54.154560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:47:37.614752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159230+0000","last_change":"2024-05-16T21:32:54.153823+0000","last_active":"2024-05-16T21:32:54.159230+0000","last_peered":"2024-05-16T21:32:54.159230+0000","last_clean":"2024-05-16T21:32:54.159230+0000","last_became_active":"2024-05-16T21:32:54.153033+0000","last_became_peered":"2024-05-16T21:32:54.153033+0000","last_unstale":"2024-05-16T21:32:54.159230+0000","last_undegraded":"2024-05-16T21:32:54.159230+0000","last_fullsized":"2024-05-16T21:32:54.159230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:43:50.481487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142440+0000","last_change":"2024-05-16T21:32:54.138206+0000","last_active":"2024-05-16T21:32:54.142440+0000","last_peered":"2024-05-16T21:32:54.142440+0000","last_clean":"2024-05-16T21:32:54.142440+0000","last_became_active":"2024-05-16T21:32:54.137910+0000","last_became_peered":"2024-05-16T21:32:54.137910+0000","last_unstale":"2024-05-16T21:32:54.142440+0000","last_undegraded":"2024-05-16T21:32:54.142440+0000","last_fullsized":"2024-05-16T21:32:54.142440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:22:36.765504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150980+0000","last_change":"2024-05-16T21:32:54.146830+0000","last_active":"2024-05-16T21:32:54.150980+0000","last_peered":"2024-05-16T21:32:54.150980+0000","last_clean":"2024-05-16T21:32:54.150980+0000","last_became_active":"2024-05-16T21:32:54.146504+0000","last_became_peered":"2024-05-16T21:32:54.146504+0000","last_unstale":"2024-05-16T21:32:54.150980+0000","last_undegraded":"2024-05-16T21:32:54.150980+0000","last_fullsized":"2024-05-16T21:32:54.150980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:35:35.435211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142260+0000","last_change":"2024-05-16T21:32:54.136878+0000","last_active":"2024-05-16T21:32:54.142260+0000","last_peered":"2024-05-16T21:32:54.142260+0000","last_clean":"2024-05-16T21:32:54.142260+0000","last_became_active":"2024-05-16T21:32:54.136508+0000","last_became_peered":"2024-05-16T21:32:54.136508+0000","last_unstale":"2024-05-16T21:32:54.142260+0000","last_undegraded":"2024-05-16T21:32:54.142260+0000","last_fullsized":"2024-05-16T21:32:54.142260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:31:54.037731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146920+0000","last_change":"2024-05-16T21:32:54.145500+0000","last_active":"2024-05-16T21:32:54.146920+0000","last_peered":"2024-05-16T21:32:54.146920+0000","last_clean":"2024-05-16T21:32:54.146920+0000","last_became_active":"2024-05-16T21:32:54.144987+0000","last_became_peered":"2024-05-16T21:32:54.144987+0000","last_unstale":"2024-05-16T21:32:54.146920+0000","last_undegraded":"2024-05-16T21:32:54.146920+0000","last_fullsized":"2024-05-16T21:32:54.146920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:35:35.435211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.133680+0000","last_change":"2024-05-16T21:32:54.130888+0000","last_active":"2024-05-16T21:32:54.133680+0000","last_peered":"2024-05-16T21:32:54.133680+0000","last_clean":"2024-05-16T21:32:54.133680+0000","last_became_active":"2024-05-16T21:32:54.130586+0000","last_became_peered":"2024-05-16T21:32:54.130586+0000","last_unstale":"2024-05-16T21:32:54.133680+0000","last_undegraded":"2024-05-16T21:32:54.133680+0000","last_fullsized":"2024-05-16T21:32:54.133680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:22:36.765504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.139648+0000","last_change":"2024-05-16T21:32:54.135547+0000","last_active":"2024-05-16T21:32:54.139648+0000","last_peered":"2024-05-16T21:32:54.139648+0000","last_clean":"2024-05-16T21:32:54.139648+0000","last_became_active":"2024-05-16T21:32:54.135220+0000","last_became_peered":"2024-05-16T21:32:54.135220+0000","last_unstale":"2024-05-16T21:32:54.139648+0000","last_undegraded":"2024-05-16T21:32:54.139648+0000","last_fullsized":"2024-05-16T21:32:54.139648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:35:35.435211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153153+0000","last_change":"2024-05-16T21:32:53.137267+0000","last_active":"2024-05-16T21:32:54.153153+0000","last_peered":"2024-05-16T21:32:54.153153+0000","last_clean":"2024-05-16T21:32:54.153153+0000","last_became_active":"2024-05-16T21:32:53.136931+0000","last_became_peered":"2024-05-16T21:32:53.136931+0000","last_unstale":"2024-05-16T21:32:54.153153+0000","last_undegraded":"2024-05-16T21:32:54.153153+0000","last_fullsized":"2024-05-16T21:32:54.153153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:42:08.686074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146591+0000","last_change":"2024-05-16T21:32:54.144520+0000","last_active":"2024-05-16T21:32:54.146591+0000","last_peered":"2024-05-16T21:32:54.146591+0000","last_clean":"2024-05-16T21:32:54.146591+0000","last_became_active":"2024-05-16T21:32:54.143938+0000","last_became_peered":"2024-05-16T21:32:54.143938+0000","last_unstale":"2024-05-16T21:32:54.146591+0000","last_undegraded":"2024-05-16T21:32:54.146591+0000","last_fullsized":"2024-05-16T21:32:54.146591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:15:36.925732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148123+0000","last_change":"2024-05-16T21:32:53.137146+0000","last_active":"2024-05-16T21:32:54.148123+0000","last_peered":"2024-05-16T21:32:54.148123+0000","last_clean":"2024-05-16T21:32:54.148123+0000","last_became_active":"2024-05-16T21:32:53.136829+0000","last_became_peered":"2024-05-16T21:32:53.136829+0000","last_unstale":"2024-05-16T21:32:54.148123+0000","last_undegraded":"2024-05-16T21:32:54.148123+0000","last_fullsized":"2024-05-16T21:32:54.148123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:22.602871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148405+0000","last_change":"2024-05-16T21:32:54.145161+0000","last_active":"2024-05-16T21:32:54.148405+0000","last_peered":"2024-05-16T21:32:54.148405+0000","last_clean":"2024-05-16T21:32:54.148405+0000","last_became_active":"2024-05-16T21:32:54.144436+0000","last_became_peered":"2024-05-16T21:32:54.144436+0000","last_unstale":"2024-05-16T21:32:54.148405+0000","last_undegraded":"2024-05-16T21:32:54.148405+0000","last_fullsized":"2024-05-16T21:32:54.148405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:15:36.925732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157997+0000","last_change":"2024-05-16T21:32:53.141768+0000","last_active":"2024-05-16T21:32:54.157997+0000","last_peered":"2024-05-16T21:32:54.157997+0000","last_clean":"2024-05-16T21:32:54.157997+0000","last_became_active":"2024-05-16T21:32:53.141412+0000","last_became_peered":"2024-05-16T21:32:53.141412+0000","last_unstale":"2024-05-16T21:32:54.157997+0000","last_undegraded":"2024-05-16T21:32:54.157997+0000","last_fullsized":"2024-05-16T21:32:54.157997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:43:49.479291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159254+0000","last_change":"2024-05-16T21:32:54.154158+0000","last_active":"2024-05-16T21:32:54.159254+0000","last_peered":"2024-05-16T21:32:54.159254+0000","last_clean":"2024-05-16T21:32:54.159254+0000","last_became_active":"2024-05-16T21:32:54.153500+0000","last_became_peered":"2024-05-16T21:32:54.153500+0000","last_unstale":"2024-05-16T21:32:54.159254+0000","last_undegraded":"2024-05-16T21:32:54.159254+0000","last_fullsized":"2024-05-16T21:32:54.159254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:11:19.206103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.155628+0000","last_change":"2024-05-16T21:32:53.142514+0000","last_active":"2024-05-16T21:32:54.155628+0000","last_peered":"2024-05-16T21:32:54.155628+0000","last_clean":"2024-05-16T21:32:54.155628+0000","last_became_active":"2024-05-16T21:32:53.142168+0000","last_became_peered":"2024-05-16T21:32:53.142168+0000","last_unstale":"2024-05-16T21:32:54.155628+0000","last_undegraded":"2024-05-16T21:32:54.155628+0000","last_fullsized":"2024-05-16T21:32:54.155628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:00:03.260267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143165+0000","last_change":"2024-05-16T21:32:54.137943+0000","last_active":"2024-05-16T21:32:54.143165+0000","last_peered":"2024-05-16T21:32:54.143165+0000","last_clean":"2024-05-16T21:32:54.143165+0000","last_became_active":"2024-05-16T21:32:54.137626+0000","last_became_peered":"2024-05-16T21:32:54.137626+0000","last_unstale":"2024-05-16T21:32:54.143165+0000","last_undegraded":"2024-05-16T21:32:54.143165+0000","last_fullsized":"2024-05-16T21:32:54.143165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:44:08.058267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159833+0000","last_change":"2024-05-16T21:32:53.137666+0000","last_active":"2024-05-16T21:32:54.159833+0000","last_peered":"2024-05-16T21:32:54.159833+0000","last_clean":"2024-05-16T21:32:54.159833+0000","last_became_active":"2024-05-16T21:32:53.137331+0000","last_became_peered":"2024-05-16T21:32:53.137331+0000","last_unstale":"2024-05-16T21:32:54.159833+0000","last_undegraded":"2024-05-16T21:32:54.159833+0000","last_fullsized":"2024-05-16T21:32:54.159833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:37:24.501176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.141632+0000","last_change":"2024-05-16T21:32:54.139979+0000","last_active":"2024-05-16T21:32:54.141632+0000","last_peered":"2024-05-16T21:32:54.141632+0000","last_clean":"2024-05-16T21:32:54.141632+0000","last_became_active":"2024-05-16T21:32:54.139626+0000","last_became_peered":"2024-05-16T21:32:54.139626+0000","last_unstale":"2024-05-16T21:32:54.141632+0000","last_undegraded":"2024-05-16T21:32:54.141632+0000","last_fullsized":"2024-05-16T21:32:54.141632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:31:54.037731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156212+0000","last_change":"2024-05-16T21:32:53.135323+0000","last_active":"2024-05-16T21:32:54.156212+0000","last_peered":"2024-05-16T21:32:54.156212+0000","last_clean":"2024-05-16T21:32:54.156212+0000","last_became_active":"2024-05-16T21:32:53.134999+0000","last_became_peered":"2024-05-16T21:32:53.134999+0000","last_unstale":"2024-05-16T21:32:54.156212+0000","last_undegraded":"2024-05-16T21:32:54.156212+0000","last_fullsized":"2024-05-16T21:32:54.156212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:57.632776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146684+0000","last_change":"2024-05-16T21:32:54.141523+0000","last_active":"2024-05-16T21:32:54.146684+0000","last_peered":"2024-05-16T21:32:54.146684+0000","last_clean":"2024-05-16T21:32:54.146684+0000","last_became_active":"2024-05-16T21:32:54.141222+0000","last_became_peered":"2024-05-16T21:32:54.141222+0000","last_unstale":"2024-05-16T21:32:54.146684+0000","last_undegraded":"2024-05-16T21:32:54.146684+0000","last_fullsized":"2024-05-16T21:32:54.146684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:48:50.894630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142018+0000","last_change":"2024-05-16T21:32:53.135917+0000","last_active":"2024-05-16T21:32:54.142018+0000","last_peered":"2024-05-16T21:32:54.142018+0000","last_clean":"2024-05-16T21:32:54.142018+0000","last_became_active":"2024-05-16T21:32:53.135042+0000","last_became_peered":"2024-05-16T21:32:53.135042+0000","last_unstale":"2024-05-16T21:32:54.142018+0000","last_undegraded":"2024-05-16T21:32:54.142018+0000","last_fullsized":"2024-05-16T21:32:54.142018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:11:18.203907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.147792+0000","last_change":"2024-05-16T21:32:54.134707+0000","last_active":"2024-05-16T21:32:54.147792+0000","last_peered":"2024-05-16T21:32:54.147792+0000","last_clean":"2024-05-16T21:32:54.147792+0000","last_became_active":"2024-05-16T21:32:54.134369+0000","last_became_peered":"2024-05-16T21:32:54.134369+0000","last_unstale":"2024-05-16T21:32:54.147792+0000","last_undegraded":"2024-05-16T21:32:54.147792+0000","last_fullsized":"2024-05-16T21:32:54.147792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:22:36.765504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.125645+0000","last_change":"2024-05-16T21:32:53.139861+0000","last_active":"2024-05-16T21:32:54.125645+0000","last_peered":"2024-05-16T21:32:54.125645+0000","last_clean":"2024-05-16T21:32:54.125645+0000","last_became_active":"2024-05-16T21:32:53.139521+0000","last_became_peered":"2024-05-16T21:32:53.139521+0000","last_unstale":"2024-05-16T21:32:54.125645+0000","last_undegraded":"2024-05-16T21:32:54.125645+0000","last_fullsized":"2024-05-16T21:32:54.125645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:46:49.644248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153538+0000","last_change":"2024-05-16T21:32:54.152611+0000","last_active":"2024-05-16T21:32:54.153538+0000","last_peered":"2024-05-16T21:32:54.153538+0000","last_clean":"2024-05-16T21:32:54.153538+0000","last_became_active":"2024-05-16T21:32:54.151931+0000","last_became_peered":"2024-05-16T21:32:54.151931+0000","last_unstale":"2024-05-16T21:32:54.153538+0000","last_undegraded":"2024-05-16T21:32:54.153538+0000","last_fullsized":"2024-05-16T21:32:54.153538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:11:19.206103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.136364+0000","last_change":"2024-05-16T21:32:53.137171+0000","last_active":"2024-05-16T21:32:54.136364+0000","last_peered":"2024-05-16T21:32:54.136364+0000","last_clean":"2024-05-16T21:32:54.136364+0000","last_became_active":"2024-05-16T21:32:53.136850+0000","last_became_peered":"2024-05-16T21:32:53.136850+0000","last_unstale":"2024-05-16T21:32:54.136364+0000","last_undegraded":"2024-05-16T21:32:54.136364+0000","last_fullsized":"2024-05-16T21:32:54.136364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:31:53.035536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159553+0000","last_change":"2024-05-16T21:32:54.156144+0000","last_active":"2024-05-16T21:32:54.159553+0000","last_peered":"2024-05-16T21:32:54.159553+0000","last_clean":"2024-05-16T21:32:54.159553+0000","last_became_active":"2024-05-16T21:32:54.155821+0000","last_became_peered":"2024-05-16T21:32:54.155821+0000","last_unstale":"2024-05-16T21:32:54.159553+0000","last_undegraded":"2024-05-16T21:32:54.159553+0000","last_fullsized":"2024-05-16T21:32:54.159553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:56:25.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.130958+0000","last_change":"2024-05-16T21:32:53.129813+0000","last_active":"2024-05-16T21:32:54.130958+0000","last_peered":"2024-05-16T21:32:54.130958+0000","last_clean":"2024-05-16T21:32:54.130958+0000","last_became_active":"2024-05-16T21:32:53.129475+0000","last_became_peered":"2024-05-16T21:32:53.129475+0000","last_unstale":"2024-05-16T21:32:54.130958+0000","last_undegraded":"2024-05-16T21:32:54.130958+0000","last_fullsized":"2024-05-16T21:32:54.130958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:48:49.892434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.158577+0000","last_change":"2024-05-16T21:32:54.154533+0000","last_active":"2024-05-16T21:32:54.158577+0000","last_peered":"2024-05-16T21:32:54.158577+0000","last_clean":"2024-05-16T21:32:54.158577+0000","last_became_active":"2024-05-16T21:32:54.153982+0000","last_became_peered":"2024-05-16T21:32:54.153982+0000","last_unstale":"2024-05-16T21:32:54.158577+0000","last_undegraded":"2024-05-16T21:32:54.158577+0000","last_fullsized":"2024-05-16T21:32:54.158577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:49:37.926528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.151864+0000","last_change":"2024-05-16T21:32:53.137882+0000","last_active":"2024-05-16T21:32:54.151864+0000","last_peered":"2024-05-16T21:32:54.151864+0000","last_clean":"2024-05-16T21:32:54.151864+0000","last_became_active":"2024-05-16T21:32:53.137168+0000","last_became_peered":"2024-05-16T21:32:53.137168+0000","last_unstale":"2024-05-16T21:32:54.151864+0000","last_undegraded":"2024-05-16T21:32:54.151864+0000","last_fullsized":"2024-05-16T21:32:54.151864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:31.298953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156714+0000","last_change":"2024-05-16T21:32:54.155820+0000","last_active":"2024-05-16T21:32:54.156714+0000","last_peered":"2024-05-16T21:32:54.156714+0000","last_clean":"2024-05-16T21:32:54.156714+0000","last_became_active":"2024-05-16T21:32:54.155417+0000","last_became_peered":"2024-05-16T21:32:54.155417+0000","last_unstale":"2024-05-16T21:32:54.156714+0000","last_undegraded":"2024-05-16T21:32:54.156714+0000","last_fullsized":"2024-05-16T21:32:54.156714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:40:43.130391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.163034+0000","last_change":"2024-05-16T21:32:53.142859+0000","last_active":"2024-05-16T21:32:54.163034+0000","last_peered":"2024-05-16T21:32:54.163034+0000","last_clean":"2024-05-16T21:32:54.163034+0000","last_became_active":"2024-05-16T21:32:53.142517+0000","last_became_peered":"2024-05-16T21:32:53.142517+0000","last_unstale":"2024-05-16T21:32:54.163034+0000","last_undegraded":"2024-05-16T21:32:54.163034+0000","last_fullsized":"2024-05-16T21:32:54.163034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:17.103689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148253+0000","last_change":"2024-05-16T21:32:54.135310+0000","last_active":"2024-05-16T21:32:54.148253+0000","last_peered":"2024-05-16T21:32:54.148253+0000","last_clean":"2024-05-16T21:32:54.148253+0000","last_became_active":"2024-05-16T21:32:54.134969+0000","last_became_peered":"2024-05-16T21:32:54.134969+0000","last_unstale":"2024-05-16T21:32:54.148253+0000","last_undegraded":"2024-05-16T21:32:54.148253+0000","last_fullsized":"2024-05-16T21:32:54.148253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:17:51.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150834+0000","last_change":"2024-05-16T21:32:53.140228+0000","last_active":"2024-05-16T21:32:54.150834+0000","last_peered":"2024-05-16T21:32:54.150834+0000","last_clean":"2024-05-16T21:32:54.150834+0000","last_became_active":"2024-05-16T21:32:53.139153+0000","last_became_peered":"2024-05-16T21:32:53.139153+0000","last_unstale":"2024-05-16T21:32:54.150834+0000","last_undegraded":"2024-05-16T21:32:54.150834+0000","last_fullsized":"2024-05-16T21:32:54.150834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:20:22.736654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148401+0000","last_change":"2024-05-16T21:32:54.147162+0000","last_active":"2024-05-16T21:32:54.148401+0000","last_peered":"2024-05-16T21:32:54.148401+0000","last_clean":"2024-05-16T21:32:54.148401+0000","last_became_active":"2024-05-16T21:32:54.146870+0000","last_became_peered":"2024-05-16T21:32:54.146870+0000","last_unstale":"2024-05-16T21:32:54.148401+0000","last_undegraded":"2024-05-16T21:32:54.148401+0000","last_fullsized":"2024-05-16T21:32:54.148401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:40:43.130391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.124578+0000","last_change":"2024-05-16T21:32:53.142261+0000","last_active":"2024-05-16T21:32:54.124578+0000","last_peered":"2024-05-16T21:32:54.124578+0000","last_clean":"2024-05-16T21:32:54.124578+0000","last_became_active":"2024-05-16T21:32:53.141950+0000","last_became_peered":"2024-05-16T21:32:53.141950+0000","last_unstale":"2024-05-16T21:32:54.124578+0000","last_undegraded":"2024-05-16T21:32:54.124578+0000","last_fullsized":"2024-05-16T21:32:54.124578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:48:49.892434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143188+0000","last_change":"2024-05-16T21:32:54.137110+0000","last_active":"2024-05-16T21:32:54.143188+0000","last_peered":"2024-05-16T21:32:54.143188+0000","last_clean":"2024-05-16T21:32:54.143188+0000","last_became_active":"2024-05-16T21:32:54.136772+0000","last_became_peered":"2024-05-16T21:32:54.136772+0000","last_unstale":"2024-05-16T21:32:54.143188+0000","last_undegraded":"2024-05-16T21:32:54.143188+0000","last_fullsized":"2024-05-16T21:32:54.143188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:17:51.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142222+0000","last_change":"2024-05-16T21:32:53.136255+0000","last_active":"2024-05-16T21:32:54.142222+0000","last_peered":"2024-05-16T21:32:54.142222+0000","last_clean":"2024-05-16T21:32:54.142222+0000","last_became_active":"2024-05-16T21:32:53.135532+0000","last_became_peered":"2024-05-16T21:32:53.135532+0000","last_unstale":"2024-05-16T21:32:54.142222+0000","last_undegraded":"2024-05-16T21:32:54.142222+0000","last_fullsized":"2024-05-16T21:32:54.142222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:37:56.739149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150369+0000","last_change":"2024-05-16T21:32:54.147585+0000","last_active":"2024-05-16T21:32:54.150369+0000","last_peered":"2024-05-16T21:32:54.150369+0000","last_clean":"2024-05-16T21:32:54.150369+0000","last_became_active":"2024-05-16T21:32:54.147200+0000","last_became_peered":"2024-05-16T21:32:54.147200+0000","last_unstale":"2024-05-16T21:32:54.150369+0000","last_undegraded":"2024-05-16T21:32:54.150369+0000","last_fullsized":"2024-05-16T21:32:54.150369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:58.708662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.161787+0000","last_change":"2024-05-16T21:32:53.138971+0000","last_active":"2024-05-16T21:32:54.161787+0000","last_peered":"2024-05-16T21:32:54.161787+0000","last_clean":"2024-05-16T21:32:54.161787+0000","last_became_active":"2024-05-16T21:32:53.138553+0000","last_became_peered":"2024-05-16T21:32:53.138553+0000","last_unstale":"2024-05-16T21:32:54.161787+0000","last_undegraded":"2024-05-16T21:32:54.161787+0000","last_fullsized":"2024-05-16T21:32:54.161787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:17:50.300525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143190+0000","last_change":"2024-05-16T21:32:54.134975+0000","last_active":"2024-05-16T21:32:54.143190+0000","last_peered":"2024-05-16T21:32:54.143190+0000","last_clean":"2024-05-16T21:32:54.143190+0000","last_became_active":"2024-05-16T21:32:54.134641+0000","last_became_peered":"2024-05-16T21:32:54.134641+0000","last_unstale":"2024-05-16T21:32:54.143190+0000","last_undegraded":"2024-05-16T21:32:54.143190+0000","last_fullsized":"2024-05-16T21:32:54.143190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:13.090850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.161950+0000","last_change":"2024-05-16T21:32:53.145021+0000","last_active":"2024-05-16T21:32:54.161950+0000","last_peered":"2024-05-16T21:32:54.161950+0000","last_clean":"2024-05-16T21:32:54.161950+0000","last_became_active":"2024-05-16T21:32:53.144647+0000","last_became_peered":"2024-05-16T21:32:53.144647+0000","last_unstale":"2024-05-16T21:32:54.161950+0000","last_undegraded":"2024-05-16T21:32:54.161950+0000","last_fullsized":"2024-05-16T21:32:54.161950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:15:35.923536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148105+0000","last_change":"2024-05-16T21:32:54.145225+0000","last_active":"2024-05-16T21:32:54.148105+0000","last_peered":"2024-05-16T21:32:54.148105+0000","last_clean":"2024-05-16T21:32:54.148105+0000","last_became_active":"2024-05-16T21:32:54.144898+0000","last_became_peered":"2024-05-16T21:32:54.144898+0000","last_unstale":"2024-05-16T21:32:54.148105+0000","last_undegraded":"2024-05-16T21:32:54.148105+0000","last_fullsized":"2024-05-16T21:32:54.148105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:44:08.058267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.149261+0000","last_change":"2024-05-16T21:32:53.141127+0000","last_active":"2024-05-16T21:32:54.149261+0000","last_peered":"2024-05-16T21:32:54.149261+0000","last_clean":"2024-05-16T21:32:54.149261+0000","last_became_active":"2024-05-16T21:32:53.140779+0000","last_became_peered":"2024-05-16T21:32:53.140779+0000","last_unstale":"2024-05-16T21:32:54.149261+0000","last_undegraded":"2024-05-16T21:32:54.149261+0000","last_fullsized":"2024-05-16T21:32:54.149261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:41:39.604044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148917+0000","last_change":"2024-05-16T21:32:54.140534+0000","last_active":"2024-05-16T21:32:54.148917+0000","last_peered":"2024-05-16T21:32:54.148917+0000","last_clean":"2024-05-16T21:32:54.148917+0000","last_became_active":"2024-05-16T21:32:54.140209+0000","last_became_peered":"2024-05-16T21:32:54.140209+0000","last_unstale":"2024-05-16T21:32:54.148917+0000","last_undegraded":"2024-05-16T21:32:54.148917+0000","last_fullsized":"2024-05-16T21:32:54.148917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:44:08.058267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157756+0000","last_change":"2024-05-16T21:32:53.133833+0000","last_active":"2024-05-16T21:32:54.157756+0000","last_peered":"2024-05-16T21:32:54.157756+0000","last_clean":"2024-05-16T21:32:54.157756+0000","last_became_active":"2024-05-16T21:32:53.133363+0000","last_became_peered":"2024-05-16T21:32:53.133363+0000","last_unstale":"2024-05-16T21:32:54.157756+0000","last_undegraded":"2024-05-16T21:32:54.157756+0000","last_fullsized":"2024-05-16T21:32:54.157756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:02:48.185229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.145515+0000","last_change":"2024-05-16T21:32:54.142801+0000","last_active":"2024-05-16T21:32:54.145515+0000","last_peered":"2024-05-16T21:32:54.145515+0000","last_clean":"2024-05-16T21:32:54.145515+0000","last_became_active":"2024-05-16T21:32:54.142465+0000","last_became_peered":"2024-05-16T21:32:54.142465+0000","last_unstale":"2024-05-16T21:32:54.145515+0000","last_undegraded":"2024-05-16T21:32:54.145515+0000","last_fullsized":"2024-05-16T21:32:54.145515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:32.750107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.125674+0000","last_change":"2024-05-16T21:32:53.138797+0000","last_active":"2024-05-16T21:32:54.125674+0000","last_peered":"2024-05-16T21:32:54.125674+0000","last_clean":"2024-05-16T21:32:54.125674+0000","last_became_active":"2024-05-16T21:32:53.138490+0000","last_became_peered":"2024-05-16T21:32:53.138490+0000","last_unstale":"2024-05-16T21:32:54.125674+0000","last_undegraded":"2024-05-16T21:32:54.125674+0000","last_fullsized":"2024-05-16T21:32:54.125674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:28.402007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157362+0000","last_change":"2024-05-16T21:32:54.148195+0000","last_active":"2024-05-16T21:32:54.157362+0000","last_peered":"2024-05-16T21:32:54.157362+0000","last_clean":"2024-05-16T21:32:54.157362+0000","last_became_active":"2024-05-16T21:32:54.146503+0000","last_became_peered":"2024-05-16T21:32:54.146503+0000","last_unstale":"2024-05-16T21:32:54.157362+0000","last_undegraded":"2024-05-16T21:32:54.157362+0000","last_fullsized":"2024-05-16T21:32:54.157362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:47.599008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.161185+0000","last_change":"2024-05-16T21:32:53.140212+0000","last_active":"2024-05-16T21:32:54.161185+0000","last_peered":"2024-05-16T21:32:54.161185+0000","last_clean":"2024-05-16T21:32:54.161185+0000","last_became_active":"2024-05-16T21:32:53.139927+0000","last_became_peered":"2024-05-16T21:32:53.139927+0000","last_unstale":"2024-05-16T21:32:54.161185+0000","last_undegraded":"2024-05-16T21:32:54.161185+0000","last_fullsized":"2024-05-16T21:32:54.161185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:12.088655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157255+0000","last_change":"2024-05-16T21:32:54.145872+0000","last_active":"2024-05-16T21:32:54.157255+0000","last_peered":"2024-05-16T21:32:54.157255+0000","last_clean":"2024-05-16T21:32:54.157255+0000","last_became_active":"2024-05-16T21:32:54.144613+0000","last_became_peered":"2024-05-16T21:32:54.144613+0000","last_unstale":"2024-05-16T21:32:54.157255+0000","last_undegraded":"2024-05-16T21:32:54.157255+0000","last_fullsized":"2024-05-16T21:32:54.157255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:57.460053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.135182+0000","last_change":"2024-05-16T21:32:53.142397+0000","last_active":"2024-05-16T21:32:54.135182+0000","last_peered":"2024-05-16T21:32:54.135182+0000","last_clean":"2024-05-16T21:32:54.135182+0000","last_became_active":"2024-05-16T21:32:53.142046+0000","last_became_peered":"2024-05-16T21:32:53.142046+0000","last_unstale":"2024-05-16T21:32:54.135182+0000","last_undegraded":"2024-05-16T21:32:54.135182+0000","last_fullsized":"2024-05-16T21:32:54.135182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:12.088655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157155+0000","last_change":"2024-05-16T21:32:54.144768+0000","last_active":"2024-05-16T21:32:54.157155+0000","last_peered":"2024-05-16T21:32:54.157155+0000","last_clean":"2024-05-16T21:32:54.157155+0000","last_became_active":"2024-05-16T21:32:54.144392+0000","last_became_peered":"2024-05-16T21:32:54.144392+0000","last_unstale":"2024-05-16T21:32:54.157155+0000","last_undegraded":"2024-05-16T21:32:54.157155+0000","last_fullsized":"2024-05-16T21:32:54.157155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:23:06.096891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.128958+0000","last_change":"2024-05-16T21:32:53.140626+0000","last_active":"2024-05-16T21:32:54.128958+0000","last_peered":"2024-05-16T21:32:54.128958+0000","last_clean":"2024-05-16T21:32:54.128958+0000","last_became_active":"2024-05-16T21:32:53.140222+0000","last_became_peered":"2024-05-16T21:32:53.140222+0000","last_unstale":"2024-05-16T21:32:54.128958+0000","last_undegraded":"2024-05-16T21:32:54.128958+0000","last_fullsized":"2024-05-16T21:32:54.128958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:48:28.454557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143382+0000","last_change":"2024-05-16T21:32:54.141417+0000","last_active":"2024-05-16T21:32:54.143382+0000","last_peered":"2024-05-16T21:32:54.143382+0000","last_clean":"2024-05-16T21:32:54.143382+0000","last_became_active":"2024-05-16T21:32:54.141091+0000","last_became_peered":"2024-05-16T21:32:54.141091+0000","last_unstale":"2024-05-16T21:32:54.143382+0000","last_undegraded":"2024-05-16T21:32:54.143382+0000","last_fullsized":"2024-05-16T21:32:54.143382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:11:19.206103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.132672+0000","last_change":"2024-05-16T21:32:53.138194+0000","last_active":"2024-05-16T21:32:54.132672+0000","last_peered":"2024-05-16T21:32:54.132672+0000","last_clean":"2024-05-16T21:32:54.132672+0000","last_became_active":"2024-05-16T21:32:53.137844+0000","last_became_peered":"2024-05-16T21:32:53.137844+0000","last_unstale":"2024-05-16T21:32:54.132672+0000","last_undegraded":"2024-05-16T21:32:54.132672+0000","last_fullsized":"2024-05-16T21:32:54.132672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:57.706466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157343+0000","last_change":"2024-05-16T21:32:54.147962+0000","last_active":"2024-05-16T21:32:54.157343+0000","last_peered":"2024-05-16T21:32:54.157343+0000","last_clean":"2024-05-16T21:32:54.157343+0000","last_became_active":"2024-05-16T21:32:54.147031+0000","last_became_peered":"2024-05-16T21:32:54.147031+0000","last_unstale":"2024-05-16T21:32:54.157343+0000","last_undegraded":"2024-05-16T21:32:54.157343+0000","last_fullsized":"2024-05-16T21:32:54.157343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:21:14.403465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.158462+0000","last_change":"2024-05-16T21:32:53.139362+0000","last_active":"2024-05-16T21:32:54.158462+0000","last_peered":"2024-05-16T21:32:54.158462+0000","last_clean":"2024-05-16T21:32:54.158462+0000","last_became_active":"2024-05-16T21:32:53.138984+0000","last_became_peered":"2024-05-16T21:32:53.138984+0000","last_unstale":"2024-05-16T21:32:54.158462+0000","last_undegraded":"2024-05-16T21:32:54.158462+0000","last_fullsized":"2024-05-16T21:32:54.158462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:35:34.433016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156694+0000","last_change":"2024-05-16T21:32:54.155787+0000","last_active":"2024-05-16T21:32:54.156694+0000","last_peered":"2024-05-16T21:32:54.156694+0000","last_clean":"2024-05-16T21:32:54.156694+0000","last_became_active":"2024-05-16T21:32:54.155457+0000","last_became_peered":"2024-05-16T21:32:54.155457+0000","last_unstale":"2024-05-16T21:32:54.156694+0000","last_undegraded":"2024-05-16T21:32:54.156694+0000","last_fullsized":"2024-05-16T21:32:54.156694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:03.463751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.131150+0000","last_change":"2024-05-16T21:32:53.140786+0000","last_active":"2024-05-16T21:32:54.131150+0000","last_peered":"2024-05-16T21:32:54.131150+0000","last_clean":"2024-05-16T21:32:54.131150+0000","last_became_active":"2024-05-16T21:32:53.140379+0000","last_became_peered":"2024-05-16T21:32:53.140379+0000","last_unstale":"2024-05-16T21:32:54.131150+0000","last_undegraded":"2024-05-16T21:32:54.131150+0000","last_fullsized":"2024-05-16T21:32:54.131150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:35.683086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156928+0000","last_change":"2024-05-16T21:32:54.152369+0000","last_active":"2024-05-16T21:32:54.156928+0000","last_peered":"2024-05-16T21:32:54.156928+0000","last_clean":"2024-05-16T21:32:54.156928+0000","last_became_active":"2024-05-16T21:32:54.152051+0000","last_became_peered":"2024-05-16T21:32:54.152051+0000","last_unstale":"2024-05-16T21:32:54.156928+0000","last_undegraded":"2024-05-16T21:32:54.156928+0000","last_fullsized":"2024-05-16T21:32:54.156928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:32.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.125907+0000","last_change":"2024-05-16T21:32:53.139849+0000","last_active":"2024-05-16T21:32:54.125907+0000","last_peered":"2024-05-16T21:32:54.125907+0000","last_clean":"2024-05-16T21:32:54.125907+0000","last_became_active":"2024-05-16T21:32:53.139201+0000","last_became_peered":"2024-05-16T21:32:53.139201+0000","last_unstale":"2024-05-16T21:32:54.125907+0000","last_undegraded":"2024-05-16T21:32:54.125907+0000","last_fullsized":"2024-05-16T21:32:54.125907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:57.706466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.141900+0000","last_change":"2024-05-16T21:32:54.140332+0000","last_active":"2024-05-16T21:32:54.141900+0000","last_peered":"2024-05-16T21:32:54.141900+0000","last_clean":"2024-05-16T21:32:54.141900+0000","last_became_active":"2024-05-16T21:32:54.140025+0000","last_became_peered":"2024-05-16T21:32:54.140025+0000","last_unstale":"2024-05-16T21:32:54.141900+0000","last_undegraded":"2024-05-16T21:32:54.141900+0000","last_fullsized":"2024-05-16T21:32:54.141900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:48:50.894630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.130809+0000","last_change":"2024-05-16T21:32:53.136949+0000","last_active":"2024-05-16T21:32:54.130809+0000","last_peered":"2024-05-16T21:32:54.130809+0000","last_clean":"2024-05-16T21:32:54.130809+0000","last_became_active":"2024-05-16T21:32:53.136619+0000","last_became_peered":"2024-05-16T21:32:53.136619+0000","last_unstale":"2024-05-16T21:32:54.130809+0000","last_undegraded":"2024-05-16T21:32:54.130809+0000","last_fullsized":"2024-05-16T21:32:54.130809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:42:08.686074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142296+0000","last_change":"2024-05-16T21:32:54.139316+0000","last_active":"2024-05-16T21:32:54.142296+0000","last_peered":"2024-05-16T21:32:54.142296+0000","last_clean":"2024-05-16T21:32:54.142296+0000","last_became_active":"2024-05-16T21:32:54.139058+0000","last_became_peered":"2024-05-16T21:32:54.139058+0000","last_unstale":"2024-05-16T21:32:54.142296+0000","last_undegraded":"2024-05-16T21:32:54.142296+0000","last_fullsized":"2024-05-16T21:32:54.142296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:58.708662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.124808+0000","last_change":"2024-05-16T21:32:53.139710+0000","last_active":"2024-05-16T21:32:54.124808+0000","last_peered":"2024-05-16T21:32:54.124808+0000","last_clean":"2024-05-16T21:32:54.124808+0000","last_became_active":"2024-05-16T21:32:53.139312+0000","last_became_peered":"2024-05-16T21:32:53.139312+0000","last_unstale":"2024-05-16T21:32:54.124808+0000","last_undegraded":"2024-05-16T21:32:54.124808+0000","last_fullsized":"2024-05-16T21:32:54.124808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:35.683086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.158645+0000","last_change":"2024-05-16T21:32:54.155347+0000","last_active":"2024-05-16T21:32:54.158645+0000","last_peered":"2024-05-16T21:32:54.158645+0000","last_clean":"2024-05-16T21:32:54.158645+0000","last_became_active":"2024-05-16T21:32:54.155048+0000","last_became_peered":"2024-05-16T21:32:54.155048+0000","last_unstale":"2024-05-16T21:32:54.158645+0000","last_undegraded":"2024-05-16T21:32:54.158645+0000","last_fullsized":"2024-05-16T21:32:54.158645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:13:30.272913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.129543+0000","last_change":"2024-05-16T21:32:53.137119+0000","last_active":"2024-05-16T21:32:54.129543+0000","last_peered":"2024-05-16T21:32:54.129543+0000","last_clean":"2024-05-16T21:32:54.129543+0000","last_became_active":"2024-05-16T21:32:53.135346+0000","last_became_peered":"2024-05-16T21:32:53.135346+0000","last_unstale":"2024-05-16T21:32:54.129543+0000","last_undegraded":"2024-05-16T21:32:54.129543+0000","last_fullsized":"2024-05-16T21:32:54.129543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:22.602871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156797+0000","last_change":"2024-05-16T21:32:54.156237+0000","last_active":"2024-05-16T21:32:54.156797+0000","last_peered":"2024-05-16T21:32:54.156797+0000","last_clean":"2024-05-16T21:32:54.156797+0000","last_became_active":"2024-05-16T21:32:54.155843+0000","last_became_peered":"2024-05-16T21:32:54.155843+0000","last_unstale":"2024-05-16T21:32:54.156797+0000","last_undegraded":"2024-05-16T21:32:54.156797+0000","last_fullsized":"2024-05-16T21:32:54.156797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:32.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.136944+0000","last_change":"2024-05-16T21:32:53.137100+0000","last_active":"2024-05-16T21:32:54.136944+0000","last_peered":"2024-05-16T21:32:54.136944+0000","last_clean":"2024-05-16T21:32:54.136944+0000","last_became_active":"2024-05-16T21:32:53.136765+0000","last_became_peered":"2024-05-16T21:32:53.136765+0000","last_unstale":"2024-05-16T21:32:54.136944+0000","last_undegraded":"2024-05-16T21:32:54.136944+0000","last_fullsized":"2024-05-16T21:32:54.136944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:44:07.056072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146985+0000","last_change":"2024-05-16T21:32:54.145196+0000","last_active":"2024-05-16T21:32:54.146985+0000","last_peered":"2024-05-16T21:32:54.146985+0000","last_clean":"2024-05-16T21:32:54.146985+0000","last_became_active":"2024-05-16T21:32:54.144867+0000","last_became_peered":"2024-05-16T21:32:54.144867+0000","last_unstale":"2024-05-16T21:32:54.146985+0000","last_undegraded":"2024-05-16T21:32:54.146985+0000","last_fullsized":"2024-05-16T21:32:54.146985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:37:57.741344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.131641+0000","last_change":"2024-05-16T21:32:53.139918+0000","last_active":"2024-05-16T21:32:54.131641+0000","last_peered":"2024-05-16T21:32:54.131641+0000","last_clean":"2024-05-16T21:32:54.131641+0000","last_became_active":"2024-05-16T21:32:53.139563+0000","last_became_peered":"2024-05-16T21:32:53.139563+0000","last_unstale":"2024-05-16T21:32:54.131641+0000","last_undegraded":"2024-05-16T21:32:54.131641+0000","last_fullsized":"2024-05-16T21:32:54.131641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:22.602871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":126,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.126725+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T21:32:54.126725+0000","last_peered":"2024-05-16T21:32:54.126725+0000","last_clean":"2024-05-16T21:32:54.126725+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T21:32:54.126725+0000","last_undegraded":"2024-05-16T21:32:54.126725+0000","last_fullsized":"2024-05-16T21:32:54.126725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":711033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":344064,"data_stored":128056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":717808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T21:32:58.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T21:32:58.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.351+0000 7f82f702b640 1 Processor -- start 2024-05-16T21:32:58.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.351+0000 7f82f702b640 1 -- start start 2024-05-16T21:32:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f702b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f82f00be2c0 0x7f82f009fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f702b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be6d0 0x7f82f00bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f702b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82f00bffe0 0x7f82f00bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f702b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f82f0152240 con 0x7f82f00bffe0 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f702b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f82f0151910 con 0x7f82f00be2c0 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f702b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f82f0151bf0 con 0x7f82f00be6d0 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f55c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82f00bffe0 0x7f82f00bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f55c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82f00bffe0 0x7f82f00bd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46672/0 (socket says 172.21.15.5:46672) 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f55c8640 1 -- 172.21.15.5:0/1909705055 learned_addr learned my addr 172.21.15.5:0/1909705055 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f4dc7640 1 --2- 172.21.15.5:0/1909705055 >> v2:172.21.15.157:3300/0 conn(0x7f82f00be2c0 0x7f82f009fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82e7fff640 1 --2- 172.21.15.5:0/1909705055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be6d0 0x7f82f00bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f55c8640 1 -- 172.21.15.5:0/1909705055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be6d0 msgr2=0x7f82f00bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f55c8640 1 --2- 172.21.15.5:0/1909705055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be6d0 0x7f82f00bfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f55c8640 1 -- 172.21.15.5:0/1909705055 >> v2:172.21.15.157:3300/0 conn(0x7f82f00be2c0 msgr2=0x7f82f009fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.352+0000 7f82f55c8640 1 --2- 172.21.15.5:0/1909705055 >> v2:172.21.15.157:3300/0 conn(0x7f82f00be2c0 0x7f82f009fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.353+0000 7f82f55c8640 1 -- 172.21.15.5:0/1909705055 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f0151ed0 con 0x7f82f00bffe0 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.353+0000 7f82f55c8640 1 --2- 172.21.15.5:0/1909705055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f00bd7b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f82f00a4630 tx=0x7f82e802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aeeebc10bb44611 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.353+0000 7f82e77fe640 1 -- 172.21.15.5:0/1909705055 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8036070 con 0x7f82f00bffe0 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.353+0000 7f82e77fe640 1 -- 172.21.15.5:0/1909705055 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e8031600 con 0x7f82f00bffe0 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.353+0000 7f82e77fe640 1 -- 172.21.15.5:0/1909705055 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80319d0 con 0x7f82f00bffe0 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 -- 172.21.15.5:0/1909705055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 msgr2=0x7f82f00bd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 --2- 172.21.15.5:0/1909705055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f00bd7b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f82f00a4630 tx=0x7f82e802a6a0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 -- 172.21.15.5:0/1909705055 shutdown_connections 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 --2- 172.21.15.5:0/1909705055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f00bd7b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 --2- 172.21.15.5:0/1909705055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be6d0 0x7f82f00bfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 --2- 172.21.15.5:0/1909705055 >> v2:172.21.15.157:3300/0 conn(0x7f82f00be2c0 0x7f82f009fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 -- 172.21.15.5:0/1909705055 >> 172.21.15.5:0/1909705055 conn(0x7f82f00c17c0 msgr2=0x7f82f00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 -- 172.21.15.5:0/1909705055 shutdown_connections 2024-05-16T21:32:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.354+0000 7f82f702b640 1 -- 172.21.15.5:0/1909705055 wait complete. 2024-05-16T21:32:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.356+0000 7f82f702b640 1 Processor -- start 2024-05-16T21:32:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.356+0000 7f82f702b640 1 -- start start 2024-05-16T21:32:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f702b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be2c0 0x7f82f0150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f702b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82f00be6d0 0x7f82f013e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f702b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f013ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f702b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82f00c0c80 con 0x7f82f00bffe0 2024-05-16T21:32:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f702b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f82f00a0290 con 0x7f82f00be6d0 2024-05-16T21:32:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f702b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f82f01e8040 con 0x7f82f00be2c0 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f55c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f013ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f55c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f013ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46674/0 (socket says 172.21.15.5:46674) 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f55c8640 1 -- 172.21.15.5:0/1481054783 learned_addr learned my addr 172.21.15.5:0/1481054783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f4dc7640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be2c0 0x7f82f0150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82e7fff640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82f00be6d0 0x7f82f013e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f55c8640 1 -- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be2c0 msgr2=0x7f82f0150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f55c8640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be2c0 0x7f82f0150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f55c8640 1 -- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82f00be6d0 msgr2=0x7f82f013e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f55c8640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82f00be6d0 0x7f82f013e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.357+0000 7f82f55c8640 1 -- 172.21.15.5:0/1481054783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f0151070 con 0x7f82f00bffe0 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.358+0000 7f82f55c8640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f013ee80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009f40 tx=0x7f82e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.358+0000 7f82e57fa640 1 -- 172.21.15.5:0/1481054783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8036050 con 0x7f82f00bffe0 2024-05-16T21:32:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.358+0000 7f82e57fa640 1 -- 172.21.15.5:0/1481054783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e8042070 con 0x7f82f00bffe0 2024-05-16T21:32:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.358+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f00a4150 con 0x7f82f00bffe0 2024-05-16T21:32:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.358+0000 7f82e57fa640 1 -- 172.21.15.5:0/1481054783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8009510 con 0x7f82f00bffe0 2024-05-16T21:32:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.358+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01d9b90 con 0x7f82f00bffe0 2024-05-16T21:32:58.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.359+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f014f220 con 0x7f82f00bffe0 2024-05-16T21:32:58.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.359+0000 7f82e57fa640 1 -- 172.21.15.5:0/1481054783 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82e8007bf0 con 0x7f82f00bffe0 2024-05-16T21:32:58.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.360+0000 7f82e57fa640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f82dc0762d0 0x7f82dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.360+0000 7f82e57fa640 1 -- 172.21.15.5:0/1481054783 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f82e80b83e0 con 0x7f82f00bffe0 2024-05-16T21:32:58.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.360+0000 7f82f4dc7640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f82dc0762d0 0x7f82dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.361+0000 7f82f4dc7640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f82dc0762d0 0x7f82dc0787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009a30 tx=0x7f82ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.365+0000 7f82e57fa640 1 -- 172.21.15.5:0/1481054783 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82e8081d40 con 0x7f82f00bffe0 2024-05-16T21:32:58.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.554+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82f013f3c0 con 0x7f82dc0762d0 2024-05-16T21:32:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.561+0000 7f82e57fa640 1 -- 172.21.15.5:0/1481054783 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251869 (secure 0 0 0) 0x7f82f013f3c0 con 0x7f82dc0762d0 2024-05-16T21:32:58.565 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T21:32:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f82dc0762d0 msgr2=0x7f82dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f82dc0762d0 0x7f82dc0787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009a30 tx=0x7f82ec008040 comp rx=0 tx=0).stop 2024-05-16T21:32:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 msgr2=0x7f82f013ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f013ee80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009f40 tx=0x7f82e8004a40 comp rx=0 tx=0).stop 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 shutdown_connections 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f82dc0762d0 0x7f82dc0787e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f00bffe0 0x7f82f013ee80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82f00be6d0 0x7f82f013e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 --2- 172.21.15.5:0/1481054783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82f00be2c0 0x7f82f0150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 >> 172.21.15.5:0/1481054783 conn(0x7f82f00c17c0 msgr2=0x7f82f0147520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 shutdown_connections 2024-05-16T21:32:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.564+0000 7f82f702b640 1 -- 172.21.15.5:0/1481054783 wait complete. 2024-05-16T21:32:58.577 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-16T21:32:58.371875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249040,"kb_used_data":3748,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725680,"statfs":{"total":773094113280,"available":772839096320,"internally_reserved":0,"allocated":3837952,"data_stored":2168631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001269"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146569+0000","last_change":"2024-05-16T21:32:54.144260+0000","last_active":"2024-05-16T21:32:54.146569+0000","last_peered":"2024-05-16T21:32:54.146569+0000","last_clean":"2024-05-16T21:32:54.146569+0000","last_became_active":"2024-05-16T21:32:54.143512+0000","last_became_peered":"2024-05-16T21:32:54.143512+0000","last_unstale":"2024-05-16T21:32:54.146569+0000","last_undegraded":"2024-05-16T21:32:54.146569+0000","last_fullsized":"2024-05-16T21:32:54.146569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:36.685282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.160479+0000","last_change":"2024-05-16T21:32:54.158383+0000","last_active":"2024-05-16T21:32:54.160479+0000","last_peered":"2024-05-16T21:32:54.160479+0000","last_clean":"2024-05-16T21:32:54.160479+0000","last_became_active":"2024-05-16T21:32:54.157697+0000","last_became_peered":"2024-05-16T21:32:54.157697+0000","last_unstale":"2024-05-16T21:32:54.160479+0000","last_undegraded":"2024-05-16T21:32:54.160479+0000","last_fullsized":"2024-05-16T21:32:54.160479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:03:35.458345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156657+0000","last_change":"2024-05-16T21:32:54.155740+0000","last_active":"2024-05-16T21:32:54.156657+0000","last_peered":"2024-05-16T21:32:54.156657+0000","last_clean":"2024-05-16T21:32:54.156657+0000","last_became_active":"2024-05-16T21:32:54.155396+0000","last_became_peered":"2024-05-16T21:32:54.155396+0000","last_unstale":"2024-05-16T21:32:54.156657+0000","last_undegraded":"2024-05-16T21:32:54.156657+0000","last_fullsized":"2024-05-16T21:32:54.156657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:37:57.741344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.147904+0000","last_change":"2024-05-16T21:32:54.135310+0000","last_active":"2024-05-16T21:32:54.147904+0000","last_peered":"2024-05-16T21:32:54.147904+0000","last_clean":"2024-05-16T21:32:54.147904+0000","last_became_active":"2024-05-16T21:32:54.134525+0000","last_became_peered":"2024-05-16T21:32:54.134525+0000","last_unstale":"2024-05-16T21:32:54.147904+0000","last_undegraded":"2024-05-16T21:32:54.147904+0000","last_fullsized":"2024-05-16T21:32:54.147904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:31:54.037731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157224+0000","last_change":"2024-05-16T21:32:54.144837+0000","last_active":"2024-05-16T21:32:54.157224+0000","last_peered":"2024-05-16T21:32:54.157224+0000","last_clean":"2024-05-16T21:32:54.157224+0000","last_became_active":"2024-05-16T21:32:54.144227+0000","last_became_peered":"2024-05-16T21:32:54.144227+0000","last_unstale":"2024-05-16T21:32:54.157224+0000","last_undegraded":"2024-05-16T21:32:54.157224+0000","last_fullsized":"2024-05-16T21:32:54.157224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:02:17.038915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153437+0000","last_change":"2024-05-16T21:32:54.151234+0000","last_active":"2024-05-16T21:32:54.153437+0000","last_peered":"2024-05-16T21:32:54.153437+0000","last_clean":"2024-05-16T21:32:54.153437+0000","last_became_active":"2024-05-16T21:32:54.150916+0000","last_became_peered":"2024-05-16T21:32:54.150916+0000","last_unstale":"2024-05-16T21:32:54.153437+0000","last_undegraded":"2024-05-16T21:32:54.153437+0000","last_fullsized":"2024-05-16T21:32:54.153437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:41:02.086770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143359+0000","last_change":"2024-05-16T21:32:54.139366+0000","last_active":"2024-05-16T21:32:54.143359+0000","last_peered":"2024-05-16T21:32:54.143359+0000","last_clean":"2024-05-16T21:32:54.143359+0000","last_became_active":"2024-05-16T21:32:54.139038+0000","last_became_peered":"2024-05-16T21:32:54.139038+0000","last_unstale":"2024-05-16T21:32:54.143359+0000","last_undegraded":"2024-05-16T21:32:54.143359+0000","last_fullsized":"2024-05-16T21:32:54.143359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:43:50.481487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.147073+0000","last_change":"2024-05-16T21:32:54.145894+0000","last_active":"2024-05-16T21:32:54.147073+0000","last_peered":"2024-05-16T21:32:54.147073+0000","last_clean":"2024-05-16T21:32:54.147073+0000","last_became_active":"2024-05-16T21:32:54.145575+0000","last_became_peered":"2024-05-16T21:32:54.145575+0000","last_unstale":"2024-05-16T21:32:54.147073+0000","last_undegraded":"2024-05-16T21:32:54.147073+0000","last_fullsized":"2024-05-16T21:32:54.147073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:03.463751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153287+0000","last_change":"2024-05-16T21:32:54.152294+0000","last_active":"2024-05-16T21:32:54.153287+0000","last_peered":"2024-05-16T21:32:54.153287+0000","last_clean":"2024-05-16T21:32:54.153287+0000","last_became_active":"2024-05-16T21:32:54.151754+0000","last_became_peered":"2024-05-16T21:32:54.151754+0000","last_unstale":"2024-05-16T21:32:54.153287+0000","last_undegraded":"2024-05-16T21:32:54.153287+0000","last_fullsized":"2024-05-16T21:32:54.153287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:58.708662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.158334+0000","last_change":"2024-05-16T21:32:54.150287+0000","last_active":"2024-05-16T21:32:54.158334+0000","last_peered":"2024-05-16T21:32:54.158334+0000","last_clean":"2024-05-16T21:32:54.158334+0000","last_became_active":"2024-05-16T21:32:54.149957+0000","last_became_peered":"2024-05-16T21:32:54.149957+0000","last_unstale":"2024-05-16T21:32:54.158334+0000","last_undegraded":"2024-05-16T21:32:54.158334+0000","last_fullsized":"2024-05-16T21:32:54.158334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150305+0000","last_change":"2024-05-16T21:32:54.148664+0000","last_active":"2024-05-16T21:32:54.150305+0000","last_peered":"2024-05-16T21:32:54.150305+0000","last_clean":"2024-05-16T21:32:54.150305+0000","last_became_active":"2024-05-16T21:32:54.147797+0000","last_became_peered":"2024-05-16T21:32:54.147797+0000","last_unstale":"2024-05-16T21:32:54.150305+0000","last_undegraded":"2024-05-16T21:32:54.150305+0000","last_fullsized":"2024-05-16T21:32:54.150305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:40:43.130391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153272+0000","last_change":"2024-05-16T21:32:54.152151+0000","last_active":"2024-05-16T21:32:54.153272+0000","last_peered":"2024-05-16T21:32:54.153272+0000","last_clean":"2024-05-16T21:32:54.153272+0000","last_became_active":"2024-05-16T21:32:54.151865+0000","last_became_peered":"2024-05-16T21:32:54.151865+0000","last_unstale":"2024-05-16T21:32:54.153272+0000","last_undegraded":"2024-05-16T21:32:54.153272+0000","last_fullsized":"2024-05-16T21:32:54.153272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:43:50.481487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159009+0000","last_change":"2024-05-16T21:32:54.156388+0000","last_active":"2024-05-16T21:32:54.159009+0000","last_peered":"2024-05-16T21:32:54.159009+0000","last_clean":"2024-05-16T21:32:54.159009+0000","last_became_active":"2024-05-16T21:32:54.156052+0000","last_became_peered":"2024-05-16T21:32:54.156052+0000","last_unstale":"2024-05-16T21:32:54.159009+0000","last_undegraded":"2024-05-16T21:32:54.159009+0000","last_fullsized":"2024-05-16T21:32:54.159009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:58.634972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148181+0000","last_change":"2024-05-16T21:32:54.145313+0000","last_active":"2024-05-16T21:32:54.148181+0000","last_peered":"2024-05-16T21:32:54.148181+0000","last_clean":"2024-05-16T21:32:54.148181+0000","last_became_active":"2024-05-16T21:32:54.144994+0000","last_became_peered":"2024-05-16T21:32:54.144994+0000","last_unstale":"2024-05-16T21:32:54.148181+0000","last_undegraded":"2024-05-16T21:32:54.148181+0000","last_fullsized":"2024-05-16T21:32:54.148181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:03.463751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.147192+0000","last_change":"2024-05-16T21:32:54.144571+0000","last_active":"2024-05-16T21:32:54.147192+0000","last_peered":"2024-05-16T21:32:54.147192+0000","last_clean":"2024-05-16T21:32:54.147192+0000","last_became_active":"2024-05-16T21:32:54.144222+0000","last_became_peered":"2024-05-16T21:32:54.144222+0000","last_unstale":"2024-05-16T21:32:54.147192+0000","last_undegraded":"2024-05-16T21:32:54.147192+0000","last_fullsized":"2024-05-16T21:32:54.147192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:17:51.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153401+0000","last_change":"2024-05-16T21:32:54.152734+0000","last_active":"2024-05-16T21:32:54.153401+0000","last_peered":"2024-05-16T21:32:54.153401+0000","last_clean":"2024-05-16T21:32:54.153401+0000","last_became_active":"2024-05-16T21:32:54.152034+0000","last_became_peered":"2024-05-16T21:32:54.152034+0000","last_unstale":"2024-05-16T21:32:54.153401+0000","last_undegraded":"2024-05-16T21:32:54.153401+0000","last_fullsized":"2024-05-16T21:32:54.153401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:41:02.086770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.144296+0000","last_change":"2024-05-16T21:32:54.139291+0000","last_active":"2024-05-16T21:32:54.144296+0000","last_peered":"2024-05-16T21:32:54.144296+0000","last_clean":"2024-05-16T21:32:54.144296+0000","last_became_active":"2024-05-16T21:32:54.138977+0000","last_became_peered":"2024-05-16T21:32:54.138977+0000","last_unstale":"2024-05-16T21:32:54.144296+0000","last_undegraded":"2024-05-16T21:32:54.144296+0000","last_fullsized":"2024-05-16T21:32:54.144296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153395+0000","last_change":"2024-05-16T21:32:54.151337+0000","last_active":"2024-05-16T21:32:54.153395+0000","last_peered":"2024-05-16T21:32:54.153395+0000","last_clean":"2024-05-16T21:32:54.153395+0000","last_became_active":"2024-05-16T21:32:54.150993+0000","last_became_peered":"2024-05-16T21:32:54.150993+0000","last_unstale":"2024-05-16T21:32:54.153395+0000","last_undegraded":"2024-05-16T21:32:54.153395+0000","last_fullsized":"2024-05-16T21:32:54.153395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:22:24.752568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.161068+0000","last_change":"2024-05-16T21:32:54.159358+0000","last_active":"2024-05-16T21:32:54.161068+0000","last_peered":"2024-05-16T21:32:54.161068+0000","last_clean":"2024-05-16T21:32:54.161068+0000","last_became_active":"2024-05-16T21:32:54.158921+0000","last_became_peered":"2024-05-16T21:32:54.158921+0000","last_unstale":"2024-05-16T21:32:54.161068+0000","last_undegraded":"2024-05-16T21:32:54.161068+0000","last_fullsized":"2024-05-16T21:32:54.161068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:50:06.562469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157407+0000","last_change":"2024-05-16T21:32:54.148815+0000","last_active":"2024-05-16T21:32:54.157407+0000","last_peered":"2024-05-16T21:32:54.157407+0000","last_clean":"2024-05-16T21:32:54.157407+0000","last_became_active":"2024-05-16T21:32:54.148431+0000","last_became_peered":"2024-05-16T21:32:54.148431+0000","last_unstale":"2024-05-16T21:32:54.157407+0000","last_undegraded":"2024-05-16T21:32:54.157407+0000","last_fullsized":"2024-05-16T21:32:54.157407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:28.954364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146705+0000","last_change":"2024-05-16T21:32:54.136821+0000","last_active":"2024-05-16T21:32:54.146705+0000","last_peered":"2024-05-16T21:32:54.146705+0000","last_clean":"2024-05-16T21:32:54.146705+0000","last_became_active":"2024-05-16T21:32:54.136466+0000","last_became_peered":"2024-05-16T21:32:54.136466+0000","last_unstale":"2024-05-16T21:32:54.146705+0000","last_undegraded":"2024-05-16T21:32:54.146705+0000","last_fullsized":"2024-05-16T21:32:54.146705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:42:09.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148479+0000","last_change":"2024-05-16T21:32:54.141761+0000","last_active":"2024-05-16T21:32:54.148479+0000","last_peered":"2024-05-16T21:32:54.148479+0000","last_clean":"2024-05-16T21:32:54.148479+0000","last_became_active":"2024-05-16T21:32:54.141212+0000","last_became_peered":"2024-05-16T21:32:54.141212+0000","last_unstale":"2024-05-16T21:32:54.148479+0000","last_undegraded":"2024-05-16T21:32:54.148479+0000","last_fullsized":"2024-05-16T21:32:54.148479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:36.685282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.139560+0000","last_change":"2024-05-16T21:32:54.134861+0000","last_active":"2024-05-16T21:32:54.139560+0000","last_peered":"2024-05-16T21:32:54.139560+0000","last_clean":"2024-05-16T21:32:54.139560+0000","last_became_active":"2024-05-16T21:32:54.134552+0000","last_became_peered":"2024-05-16T21:32:54.134552+0000","last_unstale":"2024-05-16T21:32:54.139560+0000","last_undegraded":"2024-05-16T21:32:54.139560+0000","last_fullsized":"2024-05-16T21:32:54.139560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:15:36.925732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150889+0000","last_change":"2024-05-16T21:32:54.147654+0000","last_active":"2024-05-16T21:32:54.150889+0000","last_peered":"2024-05-16T21:32:54.150889+0000","last_clean":"2024-05-16T21:32:54.150889+0000","last_became_active":"2024-05-16T21:32:54.147267+0000","last_became_peered":"2024-05-16T21:32:54.147267+0000","last_unstale":"2024-05-16T21:32:54.150889+0000","last_undegraded":"2024-05-16T21:32:54.150889+0000","last_fullsized":"2024-05-16T21:32:54.150889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146071+0000","last_change":"2024-05-16T21:32:54.129694+0000","last_active":"2024-05-16T21:32:54.146071+0000","last_peered":"2024-05-16T21:32:54.146071+0000","last_clean":"2024-05-16T21:32:54.146071+0000","last_became_active":"2024-05-16T21:32:54.128684+0000","last_became_peered":"2024-05-16T21:32:54.128684+0000","last_unstale":"2024-05-16T21:32:54.146071+0000","last_undegraded":"2024-05-16T21:32:54.146071+0000","last_fullsized":"2024-05-16T21:32:54.146071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:32.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.154560+0000","last_change":"2024-05-16T21:32:54.152246+0000","last_active":"2024-05-16T21:32:54.154560+0000","last_peered":"2024-05-16T21:32:54.154560+0000","last_clean":"2024-05-16T21:32:54.154560+0000","last_became_active":"2024-05-16T21:32:54.151908+0000","last_became_peered":"2024-05-16T21:32:54.151908+0000","last_unstale":"2024-05-16T21:32:54.154560+0000","last_undegraded":"2024-05-16T21:32:54.154560+0000","last_fullsized":"2024-05-16T21:32:54.154560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:47:37.614752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159230+0000","last_change":"2024-05-16T21:32:54.153823+0000","last_active":"2024-05-16T21:32:54.159230+0000","last_peered":"2024-05-16T21:32:54.159230+0000","last_clean":"2024-05-16T21:32:54.159230+0000","last_became_active":"2024-05-16T21:32:54.153033+0000","last_became_peered":"2024-05-16T21:32:54.153033+0000","last_unstale":"2024-05-16T21:32:54.159230+0000","last_undegraded":"2024-05-16T21:32:54.159230+0000","last_fullsized":"2024-05-16T21:32:54.159230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:43:50.481487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142440+0000","last_change":"2024-05-16T21:32:54.138206+0000","last_active":"2024-05-16T21:32:54.142440+0000","last_peered":"2024-05-16T21:32:54.142440+0000","last_clean":"2024-05-16T21:32:54.142440+0000","last_became_active":"2024-05-16T21:32:54.137910+0000","last_became_peered":"2024-05-16T21:32:54.137910+0000","last_unstale":"2024-05-16T21:32:54.142440+0000","last_undegraded":"2024-05-16T21:32:54.142440+0000","last_fullsized":"2024-05-16T21:32:54.142440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:22:36.765504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150980+0000","last_change":"2024-05-16T21:32:54.146830+0000","last_active":"2024-05-16T21:32:54.150980+0000","last_peered":"2024-05-16T21:32:54.150980+0000","last_clean":"2024-05-16T21:32:54.150980+0000","last_became_active":"2024-05-16T21:32:54.146504+0000","last_became_peered":"2024-05-16T21:32:54.146504+0000","last_unstale":"2024-05-16T21:32:54.150980+0000","last_undegraded":"2024-05-16T21:32:54.150980+0000","last_fullsized":"2024-05-16T21:32:54.150980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:35:35.435211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142260+0000","last_change":"2024-05-16T21:32:54.136878+0000","last_active":"2024-05-16T21:32:54.142260+0000","last_peered":"2024-05-16T21:32:54.142260+0000","last_clean":"2024-05-16T21:32:54.142260+0000","last_became_active":"2024-05-16T21:32:54.136508+0000","last_became_peered":"2024-05-16T21:32:54.136508+0000","last_unstale":"2024-05-16T21:32:54.142260+0000","last_undegraded":"2024-05-16T21:32:54.142260+0000","last_fullsized":"2024-05-16T21:32:54.142260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:31:54.037731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146920+0000","last_change":"2024-05-16T21:32:54.145500+0000","last_active":"2024-05-16T21:32:54.146920+0000","last_peered":"2024-05-16T21:32:54.146920+0000","last_clean":"2024-05-16T21:32:54.146920+0000","last_became_active":"2024-05-16T21:32:54.144987+0000","last_became_peered":"2024-05-16T21:32:54.144987+0000","last_unstale":"2024-05-16T21:32:54.146920+0000","last_undegraded":"2024-05-16T21:32:54.146920+0000","last_fullsized":"2024-05-16T21:32:54.146920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:35:35.435211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.133680+0000","last_change":"2024-05-16T21:32:54.130888+0000","last_active":"2024-05-16T21:32:54.133680+0000","last_peered":"2024-05-16T21:32:54.133680+0000","last_clean":"2024-05-16T21:32:54.133680+0000","last_became_active":"2024-05-16T21:32:54.130586+0000","last_became_peered":"2024-05-16T21:32:54.130586+0000","last_unstale":"2024-05-16T21:32:54.133680+0000","last_undegraded":"2024-05-16T21:32:54.133680+0000","last_fullsized":"2024-05-16T21:32:54.133680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:22:36.765504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.139648+0000","last_change":"2024-05-16T21:32:54.135547+0000","last_active":"2024-05-16T21:32:54.139648+0000","last_peered":"2024-05-16T21:32:54.139648+0000","last_clean":"2024-05-16T21:32:54.139648+0000","last_became_active":"2024-05-16T21:32:54.135220+0000","last_became_peered":"2024-05-16T21:32:54.135220+0000","last_unstale":"2024-05-16T21:32:54.139648+0000","last_undegraded":"2024-05-16T21:32:54.139648+0000","last_fullsized":"2024-05-16T21:32:54.139648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:35:35.435211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153153+0000","last_change":"2024-05-16T21:32:53.137267+0000","last_active":"2024-05-16T21:32:54.153153+0000","last_peered":"2024-05-16T21:32:54.153153+0000","last_clean":"2024-05-16T21:32:54.153153+0000","last_became_active":"2024-05-16T21:32:53.136931+0000","last_became_peered":"2024-05-16T21:32:53.136931+0000","last_unstale":"2024-05-16T21:32:54.153153+0000","last_undegraded":"2024-05-16T21:32:54.153153+0000","last_fullsized":"2024-05-16T21:32:54.153153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:42:08.686074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146591+0000","last_change":"2024-05-16T21:32:54.144520+0000","last_active":"2024-05-16T21:32:54.146591+0000","last_peered":"2024-05-16T21:32:54.146591+0000","last_clean":"2024-05-16T21:32:54.146591+0000","last_became_active":"2024-05-16T21:32:54.143938+0000","last_became_peered":"2024-05-16T21:32:54.143938+0000","last_unstale":"2024-05-16T21:32:54.146591+0000","last_undegraded":"2024-05-16T21:32:54.146591+0000","last_fullsized":"2024-05-16T21:32:54.146591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:15:36.925732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148123+0000","last_change":"2024-05-16T21:32:53.137146+0000","last_active":"2024-05-16T21:32:54.148123+0000","last_peered":"2024-05-16T21:32:54.148123+0000","last_clean":"2024-05-16T21:32:54.148123+0000","last_became_active":"2024-05-16T21:32:53.136829+0000","last_became_peered":"2024-05-16T21:32:53.136829+0000","last_unstale":"2024-05-16T21:32:54.148123+0000","last_undegraded":"2024-05-16T21:32:54.148123+0000","last_fullsized":"2024-05-16T21:32:54.148123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:22.602871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148405+0000","last_change":"2024-05-16T21:32:54.145161+0000","last_active":"2024-05-16T21:32:54.148405+0000","last_peered":"2024-05-16T21:32:54.148405+0000","last_clean":"2024-05-16T21:32:54.148405+0000","last_became_active":"2024-05-16T21:32:54.144436+0000","last_became_peered":"2024-05-16T21:32:54.144436+0000","last_unstale":"2024-05-16T21:32:54.148405+0000","last_undegraded":"2024-05-16T21:32:54.148405+0000","last_fullsized":"2024-05-16T21:32:54.148405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:15:36.925732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157997+0000","last_change":"2024-05-16T21:32:53.141768+0000","last_active":"2024-05-16T21:32:54.157997+0000","last_peered":"2024-05-16T21:32:54.157997+0000","last_clean":"2024-05-16T21:32:54.157997+0000","last_became_active":"2024-05-16T21:32:53.141412+0000","last_became_peered":"2024-05-16T21:32:53.141412+0000","last_unstale":"2024-05-16T21:32:54.157997+0000","last_undegraded":"2024-05-16T21:32:54.157997+0000","last_fullsized":"2024-05-16T21:32:54.157997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:43:49.479291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159254+0000","last_change":"2024-05-16T21:32:54.154158+0000","last_active":"2024-05-16T21:32:54.159254+0000","last_peered":"2024-05-16T21:32:54.159254+0000","last_clean":"2024-05-16T21:32:54.159254+0000","last_became_active":"2024-05-16T21:32:54.153500+0000","last_became_peered":"2024-05-16T21:32:54.153500+0000","last_unstale":"2024-05-16T21:32:54.159254+0000","last_undegraded":"2024-05-16T21:32:54.159254+0000","last_fullsized":"2024-05-16T21:32:54.159254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:11:19.206103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.155628+0000","last_change":"2024-05-16T21:32:53.142514+0000","last_active":"2024-05-16T21:32:54.155628+0000","last_peered":"2024-05-16T21:32:54.155628+0000","last_clean":"2024-05-16T21:32:54.155628+0000","last_became_active":"2024-05-16T21:32:53.142168+0000","last_became_peered":"2024-05-16T21:32:53.142168+0000","last_unstale":"2024-05-16T21:32:54.155628+0000","last_undegraded":"2024-05-16T21:32:54.155628+0000","last_fullsized":"2024-05-16T21:32:54.155628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:00:03.260267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143165+0000","last_change":"2024-05-16T21:32:54.137943+0000","last_active":"2024-05-16T21:32:54.143165+0000","last_peered":"2024-05-16T21:32:54.143165+0000","last_clean":"2024-05-16T21:32:54.143165+0000","last_became_active":"2024-05-16T21:32:54.137626+0000","last_became_peered":"2024-05-16T21:32:54.137626+0000","last_unstale":"2024-05-16T21:32:54.143165+0000","last_undegraded":"2024-05-16T21:32:54.143165+0000","last_fullsized":"2024-05-16T21:32:54.143165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:44:08.058267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159833+0000","last_change":"2024-05-16T21:32:53.137666+0000","last_active":"2024-05-16T21:32:54.159833+0000","last_peered":"2024-05-16T21:32:54.159833+0000","last_clean":"2024-05-16T21:32:54.159833+0000","last_became_active":"2024-05-16T21:32:53.137331+0000","last_became_peered":"2024-05-16T21:32:53.137331+0000","last_unstale":"2024-05-16T21:32:54.159833+0000","last_undegraded":"2024-05-16T21:32:54.159833+0000","last_fullsized":"2024-05-16T21:32:54.159833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:37:24.501176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.141632+0000","last_change":"2024-05-16T21:32:54.139979+0000","last_active":"2024-05-16T21:32:54.141632+0000","last_peered":"2024-05-16T21:32:54.141632+0000","last_clean":"2024-05-16T21:32:54.141632+0000","last_became_active":"2024-05-16T21:32:54.139626+0000","last_became_peered":"2024-05-16T21:32:54.139626+0000","last_unstale":"2024-05-16T21:32:54.141632+0000","last_undegraded":"2024-05-16T21:32:54.141632+0000","last_fullsized":"2024-05-16T21:32:54.141632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:31:54.037731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156212+0000","last_change":"2024-05-16T21:32:53.135323+0000","last_active":"2024-05-16T21:32:54.156212+0000","last_peered":"2024-05-16T21:32:54.156212+0000","last_clean":"2024-05-16T21:32:54.156212+0000","last_became_active":"2024-05-16T21:32:53.134999+0000","last_became_peered":"2024-05-16T21:32:53.134999+0000","last_unstale":"2024-05-16T21:32:54.156212+0000","last_undegraded":"2024-05-16T21:32:54.156212+0000","last_fullsized":"2024-05-16T21:32:54.156212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:57.632776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146684+0000","last_change":"2024-05-16T21:32:54.141523+0000","last_active":"2024-05-16T21:32:54.146684+0000","last_peered":"2024-05-16T21:32:54.146684+0000","last_clean":"2024-05-16T21:32:54.146684+0000","last_became_active":"2024-05-16T21:32:54.141222+0000","last_became_peered":"2024-05-16T21:32:54.141222+0000","last_unstale":"2024-05-16T21:32:54.146684+0000","last_undegraded":"2024-05-16T21:32:54.146684+0000","last_fullsized":"2024-05-16T21:32:54.146684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:48:50.894630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142018+0000","last_change":"2024-05-16T21:32:53.135917+0000","last_active":"2024-05-16T21:32:54.142018+0000","last_peered":"2024-05-16T21:32:54.142018+0000","last_clean":"2024-05-16T21:32:54.142018+0000","last_became_active":"2024-05-16T21:32:53.135042+0000","last_became_peered":"2024-05-16T21:32:53.135042+0000","last_unstale":"2024-05-16T21:32:54.142018+0000","last_undegraded":"2024-05-16T21:32:54.142018+0000","last_fullsized":"2024-05-16T21:32:54.142018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:11:18.203907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.147792+0000","last_change":"2024-05-16T21:32:54.134707+0000","last_active":"2024-05-16T21:32:54.147792+0000","last_peered":"2024-05-16T21:32:54.147792+0000","last_clean":"2024-05-16T21:32:54.147792+0000","last_became_active":"2024-05-16T21:32:54.134369+0000","last_became_peered":"2024-05-16T21:32:54.134369+0000","last_unstale":"2024-05-16T21:32:54.147792+0000","last_undegraded":"2024-05-16T21:32:54.147792+0000","last_fullsized":"2024-05-16T21:32:54.147792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:22:36.765504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.125645+0000","last_change":"2024-05-16T21:32:53.139861+0000","last_active":"2024-05-16T21:32:54.125645+0000","last_peered":"2024-05-16T21:32:54.125645+0000","last_clean":"2024-05-16T21:32:54.125645+0000","last_became_active":"2024-05-16T21:32:53.139521+0000","last_became_peered":"2024-05-16T21:32:53.139521+0000","last_unstale":"2024-05-16T21:32:54.125645+0000","last_undegraded":"2024-05-16T21:32:54.125645+0000","last_fullsized":"2024-05-16T21:32:54.125645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:46:49.644248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.153538+0000","last_change":"2024-05-16T21:32:54.152611+0000","last_active":"2024-05-16T21:32:54.153538+0000","last_peered":"2024-05-16T21:32:54.153538+0000","last_clean":"2024-05-16T21:32:54.153538+0000","last_became_active":"2024-05-16T21:32:54.151931+0000","last_became_peered":"2024-05-16T21:32:54.151931+0000","last_unstale":"2024-05-16T21:32:54.153538+0000","last_undegraded":"2024-05-16T21:32:54.153538+0000","last_fullsized":"2024-05-16T21:32:54.153538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:11:19.206103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.136364+0000","last_change":"2024-05-16T21:32:53.137171+0000","last_active":"2024-05-16T21:32:54.136364+0000","last_peered":"2024-05-16T21:32:54.136364+0000","last_clean":"2024-05-16T21:32:54.136364+0000","last_became_active":"2024-05-16T21:32:53.136850+0000","last_became_peered":"2024-05-16T21:32:53.136850+0000","last_unstale":"2024-05-16T21:32:54.136364+0000","last_undegraded":"2024-05-16T21:32:54.136364+0000","last_fullsized":"2024-05-16T21:32:54.136364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:31:53.035536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.159553+0000","last_change":"2024-05-16T21:32:54.156144+0000","last_active":"2024-05-16T21:32:54.159553+0000","last_peered":"2024-05-16T21:32:54.159553+0000","last_clean":"2024-05-16T21:32:54.159553+0000","last_became_active":"2024-05-16T21:32:54.155821+0000","last_became_peered":"2024-05-16T21:32:54.155821+0000","last_unstale":"2024-05-16T21:32:54.159553+0000","last_undegraded":"2024-05-16T21:32:54.159553+0000","last_fullsized":"2024-05-16T21:32:54.159553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:56:25.106364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.130958+0000","last_change":"2024-05-16T21:32:53.129813+0000","last_active":"2024-05-16T21:32:54.130958+0000","last_peered":"2024-05-16T21:32:54.130958+0000","last_clean":"2024-05-16T21:32:54.130958+0000","last_became_active":"2024-05-16T21:32:53.129475+0000","last_became_peered":"2024-05-16T21:32:53.129475+0000","last_unstale":"2024-05-16T21:32:54.130958+0000","last_undegraded":"2024-05-16T21:32:54.130958+0000","last_fullsized":"2024-05-16T21:32:54.130958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:48:49.892434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.158577+0000","last_change":"2024-05-16T21:32:54.154533+0000","last_active":"2024-05-16T21:32:54.158577+0000","last_peered":"2024-05-16T21:32:54.158577+0000","last_clean":"2024-05-16T21:32:54.158577+0000","last_became_active":"2024-05-16T21:32:54.153982+0000","last_became_peered":"2024-05-16T21:32:54.153982+0000","last_unstale":"2024-05-16T21:32:54.158577+0000","last_undegraded":"2024-05-16T21:32:54.158577+0000","last_fullsized":"2024-05-16T21:32:54.158577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:49:37.926528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.151864+0000","last_change":"2024-05-16T21:32:53.137882+0000","last_active":"2024-05-16T21:32:54.151864+0000","last_peered":"2024-05-16T21:32:54.151864+0000","last_clean":"2024-05-16T21:32:54.151864+0000","last_became_active":"2024-05-16T21:32:53.137168+0000","last_became_peered":"2024-05-16T21:32:53.137168+0000","last_unstale":"2024-05-16T21:32:54.151864+0000","last_undegraded":"2024-05-16T21:32:54.151864+0000","last_fullsized":"2024-05-16T21:32:54.151864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:31.298953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156714+0000","last_change":"2024-05-16T21:32:54.155820+0000","last_active":"2024-05-16T21:32:54.156714+0000","last_peered":"2024-05-16T21:32:54.156714+0000","last_clean":"2024-05-16T21:32:54.156714+0000","last_became_active":"2024-05-16T21:32:54.155417+0000","last_became_peered":"2024-05-16T21:32:54.155417+0000","last_unstale":"2024-05-16T21:32:54.156714+0000","last_undegraded":"2024-05-16T21:32:54.156714+0000","last_fullsized":"2024-05-16T21:32:54.156714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:40:43.130391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.163034+0000","last_change":"2024-05-16T21:32:53.142859+0000","last_active":"2024-05-16T21:32:54.163034+0000","last_peered":"2024-05-16T21:32:54.163034+0000","last_clean":"2024-05-16T21:32:54.163034+0000","last_became_active":"2024-05-16T21:32:53.142517+0000","last_became_peered":"2024-05-16T21:32:53.142517+0000","last_unstale":"2024-05-16T21:32:54.163034+0000","last_undegraded":"2024-05-16T21:32:54.163034+0000","last_fullsized":"2024-05-16T21:32:54.163034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:17.103689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148253+0000","last_change":"2024-05-16T21:32:54.135310+0000","last_active":"2024-05-16T21:32:54.148253+0000","last_peered":"2024-05-16T21:32:54.148253+0000","last_clean":"2024-05-16T21:32:54.148253+0000","last_became_active":"2024-05-16T21:32:54.134969+0000","last_became_peered":"2024-05-16T21:32:54.134969+0000","last_unstale":"2024-05-16T21:32:54.148253+0000","last_undegraded":"2024-05-16T21:32:54.148253+0000","last_fullsized":"2024-05-16T21:32:54.148253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:17:51.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150834+0000","last_change":"2024-05-16T21:32:53.140228+0000","last_active":"2024-05-16T21:32:54.150834+0000","last_peered":"2024-05-16T21:32:54.150834+0000","last_clean":"2024-05-16T21:32:54.150834+0000","last_became_active":"2024-05-16T21:32:53.139153+0000","last_became_peered":"2024-05-16T21:32:53.139153+0000","last_unstale":"2024-05-16T21:32:54.150834+0000","last_undegraded":"2024-05-16T21:32:54.150834+0000","last_fullsized":"2024-05-16T21:32:54.150834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:20:22.736654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148401+0000","last_change":"2024-05-16T21:32:54.147162+0000","last_active":"2024-05-16T21:32:54.148401+0000","last_peered":"2024-05-16T21:32:54.148401+0000","last_clean":"2024-05-16T21:32:54.148401+0000","last_became_active":"2024-05-16T21:32:54.146870+0000","last_became_peered":"2024-05-16T21:32:54.146870+0000","last_unstale":"2024-05-16T21:32:54.148401+0000","last_undegraded":"2024-05-16T21:32:54.148401+0000","last_fullsized":"2024-05-16T21:32:54.148401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:40:43.130391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.124578+0000","last_change":"2024-05-16T21:32:53.142261+0000","last_active":"2024-05-16T21:32:54.124578+0000","last_peered":"2024-05-16T21:32:54.124578+0000","last_clean":"2024-05-16T21:32:54.124578+0000","last_became_active":"2024-05-16T21:32:53.141950+0000","last_became_peered":"2024-05-16T21:32:53.141950+0000","last_unstale":"2024-05-16T21:32:54.124578+0000","last_undegraded":"2024-05-16T21:32:54.124578+0000","last_fullsized":"2024-05-16T21:32:54.124578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:48:49.892434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143188+0000","last_change":"2024-05-16T21:32:54.137110+0000","last_active":"2024-05-16T21:32:54.143188+0000","last_peered":"2024-05-16T21:32:54.143188+0000","last_clean":"2024-05-16T21:32:54.143188+0000","last_became_active":"2024-05-16T21:32:54.136772+0000","last_became_peered":"2024-05-16T21:32:54.136772+0000","last_unstale":"2024-05-16T21:32:54.143188+0000","last_undegraded":"2024-05-16T21:32:54.143188+0000","last_fullsized":"2024-05-16T21:32:54.143188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:17:51.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142222+0000","last_change":"2024-05-16T21:32:53.136255+0000","last_active":"2024-05-16T21:32:54.142222+0000","last_peered":"2024-05-16T21:32:54.142222+0000","last_clean":"2024-05-16T21:32:54.142222+0000","last_became_active":"2024-05-16T21:32:53.135532+0000","last_became_peered":"2024-05-16T21:32:53.135532+0000","last_unstale":"2024-05-16T21:32:54.142222+0000","last_undegraded":"2024-05-16T21:32:54.142222+0000","last_fullsized":"2024-05-16T21:32:54.142222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:37:56.739149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.150369+0000","last_change":"2024-05-16T21:32:54.147585+0000","last_active":"2024-05-16T21:32:54.150369+0000","last_peered":"2024-05-16T21:32:54.150369+0000","last_clean":"2024-05-16T21:32:54.150369+0000","last_became_active":"2024-05-16T21:32:54.147200+0000","last_became_peered":"2024-05-16T21:32:54.147200+0000","last_unstale":"2024-05-16T21:32:54.150369+0000","last_undegraded":"2024-05-16T21:32:54.150369+0000","last_fullsized":"2024-05-16T21:32:54.150369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:58.708662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.161787+0000","last_change":"2024-05-16T21:32:53.138971+0000","last_active":"2024-05-16T21:32:54.161787+0000","last_peered":"2024-05-16T21:32:54.161787+0000","last_clean":"2024-05-16T21:32:54.161787+0000","last_became_active":"2024-05-16T21:32:53.138553+0000","last_became_peered":"2024-05-16T21:32:53.138553+0000","last_unstale":"2024-05-16T21:32:54.161787+0000","last_undegraded":"2024-05-16T21:32:54.161787+0000","last_fullsized":"2024-05-16T21:32:54.161787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:17:50.300525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143190+0000","last_change":"2024-05-16T21:32:54.134975+0000","last_active":"2024-05-16T21:32:54.143190+0000","last_peered":"2024-05-16T21:32:54.143190+0000","last_clean":"2024-05-16T21:32:54.143190+0000","last_became_active":"2024-05-16T21:32:54.134641+0000","last_became_peered":"2024-05-16T21:32:54.134641+0000","last_unstale":"2024-05-16T21:32:54.143190+0000","last_undegraded":"2024-05-16T21:32:54.143190+0000","last_fullsized":"2024-05-16T21:32:54.143190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:13.090850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.161950+0000","last_change":"2024-05-16T21:32:53.145021+0000","last_active":"2024-05-16T21:32:54.161950+0000","last_peered":"2024-05-16T21:32:54.161950+0000","last_clean":"2024-05-16T21:32:54.161950+0000","last_became_active":"2024-05-16T21:32:53.144647+0000","last_became_peered":"2024-05-16T21:32:53.144647+0000","last_unstale":"2024-05-16T21:32:54.161950+0000","last_undegraded":"2024-05-16T21:32:54.161950+0000","last_fullsized":"2024-05-16T21:32:54.161950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:15:35.923536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148105+0000","last_change":"2024-05-16T21:32:54.145225+0000","last_active":"2024-05-16T21:32:54.148105+0000","last_peered":"2024-05-16T21:32:54.148105+0000","last_clean":"2024-05-16T21:32:54.148105+0000","last_became_active":"2024-05-16T21:32:54.144898+0000","last_became_peered":"2024-05-16T21:32:54.144898+0000","last_unstale":"2024-05-16T21:32:54.148105+0000","last_undegraded":"2024-05-16T21:32:54.148105+0000","last_fullsized":"2024-05-16T21:32:54.148105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:44:08.058267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.149261+0000","last_change":"2024-05-16T21:32:53.141127+0000","last_active":"2024-05-16T21:32:54.149261+0000","last_peered":"2024-05-16T21:32:54.149261+0000","last_clean":"2024-05-16T21:32:54.149261+0000","last_became_active":"2024-05-16T21:32:53.140779+0000","last_became_peered":"2024-05-16T21:32:53.140779+0000","last_unstale":"2024-05-16T21:32:54.149261+0000","last_undegraded":"2024-05-16T21:32:54.149261+0000","last_fullsized":"2024-05-16T21:32:54.149261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:41:39.604044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.148917+0000","last_change":"2024-05-16T21:32:54.140534+0000","last_active":"2024-05-16T21:32:54.148917+0000","last_peered":"2024-05-16T21:32:54.148917+0000","last_clean":"2024-05-16T21:32:54.148917+0000","last_became_active":"2024-05-16T21:32:54.140209+0000","last_became_peered":"2024-05-16T21:32:54.140209+0000","last_unstale":"2024-05-16T21:32:54.148917+0000","last_undegraded":"2024-05-16T21:32:54.148917+0000","last_fullsized":"2024-05-16T21:32:54.148917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:44:08.058267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157756+0000","last_change":"2024-05-16T21:32:53.133833+0000","last_active":"2024-05-16T21:32:54.157756+0000","last_peered":"2024-05-16T21:32:54.157756+0000","last_clean":"2024-05-16T21:32:54.157756+0000","last_became_active":"2024-05-16T21:32:53.133363+0000","last_became_peered":"2024-05-16T21:32:53.133363+0000","last_unstale":"2024-05-16T21:32:54.157756+0000","last_undegraded":"2024-05-16T21:32:54.157756+0000","last_fullsized":"2024-05-16T21:32:54.157756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:02:48.185229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.145515+0000","last_change":"2024-05-16T21:32:54.142801+0000","last_active":"2024-05-16T21:32:54.145515+0000","last_peered":"2024-05-16T21:32:54.145515+0000","last_clean":"2024-05-16T21:32:54.145515+0000","last_became_active":"2024-05-16T21:32:54.142465+0000","last_became_peered":"2024-05-16T21:32:54.142465+0000","last_unstale":"2024-05-16T21:32:54.145515+0000","last_undegraded":"2024-05-16T21:32:54.145515+0000","last_fullsized":"2024-05-16T21:32:54.145515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:25:32.750107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.125674+0000","last_change":"2024-05-16T21:32:53.138797+0000","last_active":"2024-05-16T21:32:54.125674+0000","last_peered":"2024-05-16T21:32:54.125674+0000","last_clean":"2024-05-16T21:32:54.125674+0000","last_became_active":"2024-05-16T21:32:53.138490+0000","last_became_peered":"2024-05-16T21:32:53.138490+0000","last_unstale":"2024-05-16T21:32:54.125674+0000","last_undegraded":"2024-05-16T21:32:54.125674+0000","last_fullsized":"2024-05-16T21:32:54.125674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:28.402007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157362+0000","last_change":"2024-05-16T21:32:54.148195+0000","last_active":"2024-05-16T21:32:54.157362+0000","last_peered":"2024-05-16T21:32:54.157362+0000","last_clean":"2024-05-16T21:32:54.157362+0000","last_became_active":"2024-05-16T21:32:54.146503+0000","last_became_peered":"2024-05-16T21:32:54.146503+0000","last_unstale":"2024-05-16T21:32:54.157362+0000","last_undegraded":"2024-05-16T21:32:54.157362+0000","last_fullsized":"2024-05-16T21:32:54.157362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:47.599008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.161185+0000","last_change":"2024-05-16T21:32:53.140212+0000","last_active":"2024-05-16T21:32:54.161185+0000","last_peered":"2024-05-16T21:32:54.161185+0000","last_clean":"2024-05-16T21:32:54.161185+0000","last_became_active":"2024-05-16T21:32:53.139927+0000","last_became_peered":"2024-05-16T21:32:53.139927+0000","last_unstale":"2024-05-16T21:32:54.161185+0000","last_undegraded":"2024-05-16T21:32:54.161185+0000","last_fullsized":"2024-05-16T21:32:54.161185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:12.088655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157255+0000","last_change":"2024-05-16T21:32:54.145872+0000","last_active":"2024-05-16T21:32:54.157255+0000","last_peered":"2024-05-16T21:32:54.157255+0000","last_clean":"2024-05-16T21:32:54.157255+0000","last_became_active":"2024-05-16T21:32:54.144613+0000","last_became_peered":"2024-05-16T21:32:54.144613+0000","last_unstale":"2024-05-16T21:32:54.157255+0000","last_undegraded":"2024-05-16T21:32:54.157255+0000","last_fullsized":"2024-05-16T21:32:54.157255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:57.460053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.135182+0000","last_change":"2024-05-16T21:32:53.142397+0000","last_active":"2024-05-16T21:32:54.135182+0000","last_peered":"2024-05-16T21:32:54.135182+0000","last_clean":"2024-05-16T21:32:54.135182+0000","last_became_active":"2024-05-16T21:32:53.142046+0000","last_became_peered":"2024-05-16T21:32:53.142046+0000","last_unstale":"2024-05-16T21:32:54.135182+0000","last_undegraded":"2024-05-16T21:32:54.135182+0000","last_fullsized":"2024-05-16T21:32:54.135182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:12.088655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157155+0000","last_change":"2024-05-16T21:32:54.144768+0000","last_active":"2024-05-16T21:32:54.157155+0000","last_peered":"2024-05-16T21:32:54.157155+0000","last_clean":"2024-05-16T21:32:54.157155+0000","last_became_active":"2024-05-16T21:32:54.144392+0000","last_became_peered":"2024-05-16T21:32:54.144392+0000","last_unstale":"2024-05-16T21:32:54.157155+0000","last_undegraded":"2024-05-16T21:32:54.157155+0000","last_fullsized":"2024-05-16T21:32:54.157155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:23:06.096891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.128958+0000","last_change":"2024-05-16T21:32:53.140626+0000","last_active":"2024-05-16T21:32:54.128958+0000","last_peered":"2024-05-16T21:32:54.128958+0000","last_clean":"2024-05-16T21:32:54.128958+0000","last_became_active":"2024-05-16T21:32:53.140222+0000","last_became_peered":"2024-05-16T21:32:53.140222+0000","last_unstale":"2024-05-16T21:32:54.128958+0000","last_undegraded":"2024-05-16T21:32:54.128958+0000","last_fullsized":"2024-05-16T21:32:54.128958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:48:28.454557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.143382+0000","last_change":"2024-05-16T21:32:54.141417+0000","last_active":"2024-05-16T21:32:54.143382+0000","last_peered":"2024-05-16T21:32:54.143382+0000","last_clean":"2024-05-16T21:32:54.143382+0000","last_became_active":"2024-05-16T21:32:54.141091+0000","last_became_peered":"2024-05-16T21:32:54.141091+0000","last_unstale":"2024-05-16T21:32:54.143382+0000","last_undegraded":"2024-05-16T21:32:54.143382+0000","last_fullsized":"2024-05-16T21:32:54.143382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:11:19.206103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.132672+0000","last_change":"2024-05-16T21:32:53.138194+0000","last_active":"2024-05-16T21:32:54.132672+0000","last_peered":"2024-05-16T21:32:54.132672+0000","last_clean":"2024-05-16T21:32:54.132672+0000","last_became_active":"2024-05-16T21:32:53.137844+0000","last_became_peered":"2024-05-16T21:32:53.137844+0000","last_unstale":"2024-05-16T21:32:54.132672+0000","last_undegraded":"2024-05-16T21:32:54.132672+0000","last_fullsized":"2024-05-16T21:32:54.132672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:57.706466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.157343+0000","last_change":"2024-05-16T21:32:54.147962+0000","last_active":"2024-05-16T21:32:54.157343+0000","last_peered":"2024-05-16T21:32:54.157343+0000","last_clean":"2024-05-16T21:32:54.157343+0000","last_became_active":"2024-05-16T21:32:54.147031+0000","last_became_peered":"2024-05-16T21:32:54.147031+0000","last_unstale":"2024-05-16T21:32:54.157343+0000","last_undegraded":"2024-05-16T21:32:54.157343+0000","last_fullsized":"2024-05-16T21:32:54.157343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:21:14.403465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.158462+0000","last_change":"2024-05-16T21:32:53.139362+0000","last_active":"2024-05-16T21:32:54.158462+0000","last_peered":"2024-05-16T21:32:54.158462+0000","last_clean":"2024-05-16T21:32:54.158462+0000","last_became_active":"2024-05-16T21:32:53.138984+0000","last_became_peered":"2024-05-16T21:32:53.138984+0000","last_unstale":"2024-05-16T21:32:54.158462+0000","last_undegraded":"2024-05-16T21:32:54.158462+0000","last_fullsized":"2024-05-16T21:32:54.158462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:35:34.433016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156694+0000","last_change":"2024-05-16T21:32:54.155787+0000","last_active":"2024-05-16T21:32:54.156694+0000","last_peered":"2024-05-16T21:32:54.156694+0000","last_clean":"2024-05-16T21:32:54.156694+0000","last_became_active":"2024-05-16T21:32:54.155457+0000","last_became_peered":"2024-05-16T21:32:54.155457+0000","last_unstale":"2024-05-16T21:32:54.156694+0000","last_undegraded":"2024-05-16T21:32:54.156694+0000","last_fullsized":"2024-05-16T21:32:54.156694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:03.463751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.131150+0000","last_change":"2024-05-16T21:32:53.140786+0000","last_active":"2024-05-16T21:32:54.131150+0000","last_peered":"2024-05-16T21:32:54.131150+0000","last_clean":"2024-05-16T21:32:54.131150+0000","last_became_active":"2024-05-16T21:32:53.140379+0000","last_became_peered":"2024-05-16T21:32:53.140379+0000","last_unstale":"2024-05-16T21:32:54.131150+0000","last_undegraded":"2024-05-16T21:32:54.131150+0000","last_fullsized":"2024-05-16T21:32:54.131150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:35.683086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156928+0000","last_change":"2024-05-16T21:32:54.152369+0000","last_active":"2024-05-16T21:32:54.156928+0000","last_peered":"2024-05-16T21:32:54.156928+0000","last_clean":"2024-05-16T21:32:54.156928+0000","last_became_active":"2024-05-16T21:32:54.152051+0000","last_became_peered":"2024-05-16T21:32:54.152051+0000","last_unstale":"2024-05-16T21:32:54.156928+0000","last_undegraded":"2024-05-16T21:32:54.156928+0000","last_fullsized":"2024-05-16T21:32:54.156928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:32.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.125907+0000","last_change":"2024-05-16T21:32:53.139849+0000","last_active":"2024-05-16T21:32:54.125907+0000","last_peered":"2024-05-16T21:32:54.125907+0000","last_clean":"2024-05-16T21:32:54.125907+0000","last_became_active":"2024-05-16T21:32:53.139201+0000","last_became_peered":"2024-05-16T21:32:53.139201+0000","last_unstale":"2024-05-16T21:32:54.125907+0000","last_undegraded":"2024-05-16T21:32:54.125907+0000","last_fullsized":"2024-05-16T21:32:54.125907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:57.706466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.141900+0000","last_change":"2024-05-16T21:32:54.140332+0000","last_active":"2024-05-16T21:32:54.141900+0000","last_peered":"2024-05-16T21:32:54.141900+0000","last_clean":"2024-05-16T21:32:54.141900+0000","last_became_active":"2024-05-16T21:32:54.140025+0000","last_became_peered":"2024-05-16T21:32:54.140025+0000","last_unstale":"2024-05-16T21:32:54.141900+0000","last_undegraded":"2024-05-16T21:32:54.141900+0000","last_fullsized":"2024-05-16T21:32:54.141900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:48:50.894630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.130809+0000","last_change":"2024-05-16T21:32:53.136949+0000","last_active":"2024-05-16T21:32:54.130809+0000","last_peered":"2024-05-16T21:32:54.130809+0000","last_clean":"2024-05-16T21:32:54.130809+0000","last_became_active":"2024-05-16T21:32:53.136619+0000","last_became_peered":"2024-05-16T21:32:53.136619+0000","last_unstale":"2024-05-16T21:32:54.130809+0000","last_undegraded":"2024-05-16T21:32:54.130809+0000","last_fullsized":"2024-05-16T21:32:54.130809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:42:08.686074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.142296+0000","last_change":"2024-05-16T21:32:54.139316+0000","last_active":"2024-05-16T21:32:54.142296+0000","last_peered":"2024-05-16T21:32:54.142296+0000","last_clean":"2024-05-16T21:32:54.142296+0000","last_became_active":"2024-05-16T21:32:54.139058+0000","last_became_peered":"2024-05-16T21:32:54.139058+0000","last_unstale":"2024-05-16T21:32:54.142296+0000","last_undegraded":"2024-05-16T21:32:54.142296+0000","last_fullsized":"2024-05-16T21:32:54.142296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:51:58.708662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.124808+0000","last_change":"2024-05-16T21:32:53.139710+0000","last_active":"2024-05-16T21:32:54.124808+0000","last_peered":"2024-05-16T21:32:54.124808+0000","last_clean":"2024-05-16T21:32:54.124808+0000","last_became_active":"2024-05-16T21:32:53.139312+0000","last_became_peered":"2024-05-16T21:32:53.139312+0000","last_unstale":"2024-05-16T21:32:54.124808+0000","last_undegraded":"2024-05-16T21:32:54.124808+0000","last_fullsized":"2024-05-16T21:32:54.124808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:41:35.683086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.158645+0000","last_change":"2024-05-16T21:32:54.155347+0000","last_active":"2024-05-16T21:32:54.158645+0000","last_peered":"2024-05-16T21:32:54.158645+0000","last_clean":"2024-05-16T21:32:54.158645+0000","last_became_active":"2024-05-16T21:32:54.155048+0000","last_became_peered":"2024-05-16T21:32:54.155048+0000","last_unstale":"2024-05-16T21:32:54.158645+0000","last_undegraded":"2024-05-16T21:32:54.158645+0000","last_fullsized":"2024-05-16T21:32:54.158645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:13:30.272913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.129543+0000","last_change":"2024-05-16T21:32:53.137119+0000","last_active":"2024-05-16T21:32:54.129543+0000","last_peered":"2024-05-16T21:32:54.129543+0000","last_clean":"2024-05-16T21:32:54.129543+0000","last_became_active":"2024-05-16T21:32:53.135346+0000","last_became_peered":"2024-05-16T21:32:53.135346+0000","last_unstale":"2024-05-16T21:32:54.129543+0000","last_undegraded":"2024-05-16T21:32:54.129543+0000","last_fullsized":"2024-05-16T21:32:54.129543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:22.602871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.156797+0000","last_change":"2024-05-16T21:32:54.156237+0000","last_active":"2024-05-16T21:32:54.156797+0000","last_peered":"2024-05-16T21:32:54.156797+0000","last_clean":"2024-05-16T21:32:54.156797+0000","last_became_active":"2024-05-16T21:32:54.155843+0000","last_became_peered":"2024-05-16T21:32:54.155843+0000","last_unstale":"2024-05-16T21:32:54.156797+0000","last_undegraded":"2024-05-16T21:32:54.156797+0000","last_fullsized":"2024-05-16T21:32:54.156797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:32.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.136944+0000","last_change":"2024-05-16T21:32:53.137100+0000","last_active":"2024-05-16T21:32:54.136944+0000","last_peered":"2024-05-16T21:32:54.136944+0000","last_clean":"2024-05-16T21:32:54.136944+0000","last_became_active":"2024-05-16T21:32:53.136765+0000","last_became_peered":"2024-05-16T21:32:53.136765+0000","last_unstale":"2024-05-16T21:32:54.136944+0000","last_undegraded":"2024-05-16T21:32:54.136944+0000","last_fullsized":"2024-05-16T21:32:54.136944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:44:07.056072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.146985+0000","last_change":"2024-05-16T21:32:54.145196+0000","last_active":"2024-05-16T21:32:54.146985+0000","last_peered":"2024-05-16T21:32:54.146985+0000","last_clean":"2024-05-16T21:32:54.146985+0000","last_became_active":"2024-05-16T21:32:54.144867+0000","last_became_peered":"2024-05-16T21:32:54.144867+0000","last_unstale":"2024-05-16T21:32:54.146985+0000","last_undegraded":"2024-05-16T21:32:54.146985+0000","last_fullsized":"2024-05-16T21:32:54.146985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:53.114627+0000","last_clean_scrub_stamp":"2024-05-16T21:32:53.114627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:37:57.741344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.131641+0000","last_change":"2024-05-16T21:32:53.139918+0000","last_active":"2024-05-16T21:32:54.131641+0000","last_peered":"2024-05-16T21:32:54.131641+0000","last_clean":"2024-05-16T21:32:54.131641+0000","last_became_active":"2024-05-16T21:32:53.139563+0000","last_became_peered":"2024-05-16T21:32:53.139563+0000","last_unstale":"2024-05-16T21:32:54.131641+0000","last_undegraded":"2024-05-16T21:32:54.131641+0000","last_fullsized":"2024-05-16T21:32:54.131641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:52.112431+0000","last_clean_scrub_stamp":"2024-05-16T21:32:52.112431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:22.602871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":126,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-16T21:32:54.126725+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T21:32:54.126725+0000","last_peered":"2024-05-16T21:32:54.126725+0000","last_clean":"2024-05-16T21:32:54.126725+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T21:32:54.126725+0000","last_undegraded":"2024-05-16T21:32:54.126725+0000","last_fullsized":"2024-05-16T21:32:54.126725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":711033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":344064,"data_stored":128056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":717808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T21:32:58.581 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T21:32:58.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-16T21:32:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.734+0000 7fbffbb0d640 1 Processor -- start 2024-05-16T21:32:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.734+0000 7fbffbb0d640 1 -- start start 2024-05-16T21:32:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.735+0000 7fbffbb0d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbff40bf050 0x7fbff4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.735+0000 7fbffbb0d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff406e140 con 0x7fbff40bd6d0 2024-05-16T21:32:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.735+0000 7fbffbb0d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff40c36f0 con 0x7fbff4151fc0 2024-05-16T21:32:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.735+0000 7fbffbb0d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbff4152530 con 0x7fbff40bf050 2024-05-16T21:32:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.735+0000 7fbffa0aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbff40bf050 0x7fbff4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.735+0000 7fbff90a8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbff40bd6d0 0x7fbff40be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54398/0 (socket says 172.21.15.5:54398) 2024-05-16T21:32:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.735+0000 7fbff90a8640 1 -- 172.21.15.5:0/1166545257 learned_addr learned my addr 172.21.15.5:0/1166545257 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.736+0000 7fbffa0aa640 1 -- 172.21.15.5:0/1166545257 >> v1:172.21.15.157:6789/0 conn(0x7fbff4151fc0 legacy=0x7fbff406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.736+0000 7fbffa0aa640 1 -- 172.21.15.5:0/1166545257 >> v1:172.21.15.5:6789/0 conn(0x7fbff40bd6d0 legacy=0x7fbff40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.736+0000 7fbffa0aa640 1 -- 172.21.15.5:0/1166545257 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff4152810 con 0x7fbff40bf050 2024-05-16T21:32:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.736+0000 7fbffa0aa640 1 --2- 172.21.15.5:0/1166545257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff4159ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009d90 tx=0x7fbfec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c815fa1b159e35 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbff88a7640 1 -- 172.21.15.5:0/1166545257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec007740 con 0x7fbff40bf050 2024-05-16T21:32:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbff88a7640 1 -- 172.21.15.5:0/1166545257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec0078e0 con 0x7fbff40bf050 2024-05-16T21:32:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbff88a7640 1 -- 172.21.15.5:0/1166545257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec007cb0 con 0x7fbff40bf050 2024-05-16T21:32:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbffbb0d640 1 -- 172.21.15.5:0/1166545257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 msgr2=0x7fbff4159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbffbb0d640 1 --2- 172.21.15.5:0/1166545257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff4159ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009d90 tx=0x7fbfec02a6f0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbffbb0d640 1 -- 172.21.15.5:0/1166545257 shutdown_connections 2024-05-16T21:32:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbffbb0d640 1 --2- 172.21.15.5:0/1166545257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff4159ea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbffbb0d640 1 -- 172.21.15.5:0/1166545257 >> 172.21.15.5:0/1166545257 conn(0x7fbff40c3d20 msgr2=0x7fbff40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbffbb0d640 1 -- 172.21.15.5:0/1166545257 shutdown_connections 2024-05-16T21:32:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.737+0000 7fbffbb0d640 1 -- 172.21.15.5:0/1166545257 wait complete. 2024-05-16T21:32:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.739+0000 7fbffbb0d640 1 Processor -- start 2024-05-16T21:32:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.739+0000 7fbffbb0d640 1 -- start start 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbffbb0d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbff40bd6d0 0x7fbff414ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbffbb0d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbffbb0d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbff4151fc0 0x7fbff40b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbffbb0d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbff40a2ed0 con 0x7fbff40bf050 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbffbb0d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbff40bdae0 con 0x7fbff40bd6d0 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbffbb0d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbff40a3050 con 0x7fbff4151fc0 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff90a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff90a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff414b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46702/0 (socket says 172.21.15.5:46702) 2024-05-16T21:32:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff90a8640 1 -- 172.21.15.5:0/2083327451 learned_addr learned my addr 172.21.15.5:0/2083327451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff98a9640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbff40bd6d0 0x7fbff414ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbffa0aa640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbff4151fc0 0x7fbff40b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff90a8640 1 -- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbff4151fc0 msgr2=0x7fbff40b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff90a8640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbff4151fc0 0x7fbff40b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff90a8640 1 -- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbff40bd6d0 msgr2=0x7fbff414ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff90a8640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbff40bd6d0 0x7fbff414ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.740+0000 7fbff90a8640 1 -- 172.21.15.5:0/2083327451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff40ba6d0 con 0x7fbff40bf050 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.741+0000 7fbff90a8640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff414b0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400c3d0 tx=0x7fbfe400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.741+0000 7fbfea7fc640 1 -- 172.21.15.5:0/2083327451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4017070 con 0x7fbff40bf050 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.741+0000 7fbfea7fc640 1 -- 172.21.15.5:0/2083327451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe4005ce0 con 0x7fbff40bf050 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.741+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff414f450 con 0x7fbff40bf050 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.741+0000 7fbfea7fc640 1 -- 172.21.15.5:0/2083327451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4007310 con 0x7fbff40bf050 2024-05-16T21:32:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.741+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff40ba110 con 0x7fbff40bf050 2024-05-16T21:32:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.742+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff41e4690 con 0x7fbff40bf050 2024-05-16T21:32:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.743+0000 7fbfea7fc640 1 -- 172.21.15.5:0/2083327451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbfe401a070 con 0x7fbff40bf050 2024-05-16T21:32:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.743+0000 7fbfea7fc640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbfd80762d0 0x7fbfd80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.743+0000 7fbfea7fc640 1 -- 172.21.15.5:0/2083327451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbfe4096940 con 0x7fbff40bf050 2024-05-16T21:32:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.743+0000 7fbff98a9640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbfd80762d0 0x7fbfd80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.744+0000 7fbff98a9640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbfd80762d0 0x7fbfd80787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbff0000f60 tx=0x7fbff0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:58.748+0000 7fbfea7fc640 1 -- 172.21.15.5:0/2083327451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbff406e140 con 0x7fbff40bf050 2024-05-16T21:32:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.010+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbff40b9f00 con 0x7fbff40bf050 2024-05-16T21:32:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.013+0000 7fbfea7fc640 1 -- 172.21.15.5:0/2083327451 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fbfe40602a0 con 0x7fbff40bf050 2024-05-16T21:32:59.015 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-05-16T21:32:59.015 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAxe0ZmPwp5BBAApGZXcUeCgiYeu7NGIhsvXg== 2024-05-16T21:32:59.015 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-05-16T21:32:59.015 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-05-16T21:32:59.016 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-16T21:32:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-05-16T21:32:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbfd80762d0 msgr2=0x7fbfd80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbfd80762d0 0x7fbfd80787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbff0000f60 tx=0x7fbff0009040 comp rx=0 tx=0).stop 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 msgr2=0x7fbff414b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff414b0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400c3d0 tx=0x7fbfe400c890 comp rx=0 tx=0).stop 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 shutdown_connections 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbfd80762d0 0x7fbfd80787e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbff4151fc0 0x7fbff40b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbff40bf050 0x7fbff414b0c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 --2- 172.21.15.5:0/2083327451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbff40bd6d0 0x7fbff414ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 >> 172.21.15.5:0/2083327451 conn(0x7fbff40c3d20 msgr2=0x7fbff40c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 shutdown_connections 2024-05-16T21:32:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.015+0000 7fbffbb0d640 1 -- 172.21.15.5:0/2083327451 wait complete. 2024-05-16T21:32:59.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:32:59.062 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-05-16T21:32:59.061+0000 7ff6a0540640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T21:32:59.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.138+0000 7fc692af9640 1 Processor -- start 2024-05-16T21:32:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.138+0000 7fc692af9640 1 -- start start 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc692af9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68c0bd6d0 0x7fc68c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc692af9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68c06e140 con 0x7fc68c0bee80 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc692af9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68c0c36f0 con 0x7fc68c151fc0 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc692af9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc68c152530 con 0x7fc68c0bd6d0 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc691096640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc68c0bee80 0x7fc68c158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54404/0 (socket says 172.21.15.5:54404) 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc691096640 1 -- 172.21.15.5:0/750865483 learned_addr learned my addr 172.21.15.5:0/750865483 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc68bfff640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68c0bd6d0 0x7fc68c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380858393 0 0) 0x7fc684001490 con 0x7fc68c0bee80 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.139+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc67c003520 con 0x7fc68c0bee80 2024-05-16T21:32:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061365407 0 0) 0x7fc68c0c36f0 con 0x7fc68c151fc0 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc684001490 con 0x7fc68c151fc0 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3065219286 0 0) 0x7fc67c003520 con 0x7fc68c0bee80 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68c0bd6d0 msgr2=0x7fc68c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68c0bd6d0 0x7fc68c0be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 >> v1:172.21.15.157:6789/0 conn(0x7fc68c151fc0 legacy=0x7fc68c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c152810 con 0x7fc68c0bee80 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fc684001bc0 con 0x7fc68c0bee80 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 >> v1:172.21.15.5:6789/0 conn(0x7fc68c0bee80 legacy=0x7fc68c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68c0bd6d0 0x7fc67c003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc67c004210 0x7fc67c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c004db0 0x7fc67c005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c152530 con 0x7fc67c004db0 2024-05-16T21:32:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c00bc70 con 0x7fc67c004210 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc67c00be70 con 0x7fc68c0bd6d0 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc691096640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c004db0 0x7fc67c005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc690895640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68c0bd6d0 0x7fc67c003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc68bfff640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc67c004210 0x7fc67c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc691096640 1 -- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68c0bd6d0 msgr2=0x7fc67c003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc691096640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68c0bd6d0 0x7fc67c003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc691096640 1 -- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc67c004210 msgr2=0x7fc67c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc691096640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc67c004210 0x7fc67c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.140+0000 7fc691096640 1 -- 172.21.15.5:0/750865483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67c003520 con 0x7fc67c004db0 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.141+0000 7fc691096640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c004db0 0x7fc67c005280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc68400a870 tx=0x7fc67c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73475e2a57d2b647 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.141+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68400a4c0 con 0x7fc67c004db0 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.141+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68402f070 con 0x7fc67c004db0 2024-05-16T21:32:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.141+0000 7fc68b7fe640 1 -- 172.21.15.5:0/750865483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68402bc40 con 0x7fc67c004db0 2024-05-16T21:32:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.142+0000 7fc692af9640 1 -- 172.21.15.5:0/750865483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c004db0 msgr2=0x7fc67c005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.142+0000 7fc692af9640 1 --2- 172.21.15.5:0/750865483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c004db0 0x7fc67c005280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc68400a870 tx=0x7fc67c005830 comp rx=0 tx=0).stop 2024-05-16T21:32:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.142+0000 7fc691096640 1 -- 172.21.15.5:0/750865483 reap_dead start 2024-05-16T21:32:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.142+0000 7fc692af9640 1 -- 172.21.15.5:0/750865483 shutdown_connections 2024-05-16T21:32:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.142+0000 7fc692af9640 1 -- 172.21.15.5:0/750865483 >> 172.21.15.5:0/750865483 conn(0x7fc68c0c3d20 msgr2=0x7fc68c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.142+0000 7fc692af9640 1 -- 172.21.15.5:0/750865483 shutdown_connections 2024-05-16T21:32:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.142+0000 7fc692af9640 1 -- 172.21.15.5:0/750865483 wait complete. 2024-05-16T21:32:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.143+0000 7fc692af9640 1 Processor -- start 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.143+0000 7fc692af9640 1 -- start start 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc692af9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc67c004db0 0x7fc68c1e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc692af9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc68c1505f0 0x7fc68c1e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc692af9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc68c1e72f0 0x7fc68c1e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc692af9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c0bdae0 con 0x7fc68c1505f0 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc692af9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c0c0070 con 0x7fc68c1e72f0 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc692af9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc68c0a2ed0 con 0x7fc67c004db0 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc68c1505f0 0x7fc68c1e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc68c1505f0 0x7fc68c1e6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46718/0 (socket says 172.21.15.5:46718) 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 -- 172.21.15.5:0/1446786182 learned_addr learned my addr 172.21.15.5:0/1446786182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc690895640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc67c004db0 0x7fc68c1e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc691096640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc68c1e72f0 0x7fc68c1e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 -- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc67c004db0 msgr2=0x7fc68c1e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc67c004db0 0x7fc68c1e7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 -- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc68c1e72f0 msgr2=0x7fc68c1e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc68c1e72f0 0x7fc68c1e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 -- 172.21.15.5:0/1446786182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c1e8100 con 0x7fc68c1505f0 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc691096640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc68c1e72f0 0x7fc68c1e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc68bfff640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc68c1505f0 0x7fc68c1e6db0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6780119a0 tx=0x7fc678011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc6897fa640 1 -- 172.21.15.5:0/1446786182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67800faf0 con 0x7fc68c1505f0 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc6897fa640 1 -- 172.21.15.5:0/1446786182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67800fc90 con 0x7fc68c1505f0 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68c1e58e0 con 0x7fc68c1505f0 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc6897fa640 1 -- 172.21.15.5:0/1446786182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc678014440 con 0x7fc68c1505f0 2024-05-16T21:32:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.145+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68c14f830 con 0x7fc68c1505f0 2024-05-16T21:32:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.147+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc68c050940 con 0x7fc68c1505f0 2024-05-16T21:32:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.147+0000 7fc6897fa640 1 -- 172.21.15.5:0/1446786182 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc678012040 con 0x7fc68c1505f0 2024-05-16T21:32:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.148+0000 7fc6897fa640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6700762d0 0x7fc6700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.148+0000 7fc6897fa640 1 -- 172.21.15.5:0/1446786182 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc678097bc0 con 0x7fc68c1505f0 2024-05-16T21:32:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.148+0000 7fc690895640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6700762d0 0x7fc6700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.149+0000 7fc690895640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6700762d0 0x7fc6700787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc6800019f0 tx=0x7fc680009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.153+0000 7fc6897fa640 1 -- 172.21.15.5:0/1446786182 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc678019030 con 0x7fc68c1505f0 2024-05-16T21:32:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.387+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc68c06eb40 con 0x7fc68c1505f0 2024-05-16T21:32:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.387+0000 7fc6897fa640 1 -- 172.21.15.5:0/1446786182 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4353 (secure 0 0 0) 0x7fc678061520 con 0x7fc68c1505f0 2024-05-16T21:32:59.389 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:32:59.389 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2890333934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2890333934},{"type":"v1","addr":"172.21.15.5:6834","nonce":2890333934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3111678801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3111678801},{"type":"v1","addr":"172.21.15.157:6835","nonce":3111678801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:53.518776+0000","modified":"2024-05-16T21:32:56.567421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4692},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4692":{"gid":4692,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2543237506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543237506},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543237506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4692,"qdb_cluster":[4692]},"id":2}]} 2024-05-16T21:32:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-05-16T21:32:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6700762d0 msgr2=0x7fc6700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6700762d0 0x7fc6700787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc6800019f0 tx=0x7fc680009040 comp rx=0 tx=0).stop 2024-05-16T21:32:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc68c1505f0 msgr2=0x7fc68c1e6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc68c1505f0 0x7fc68c1e6db0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6780119a0 tx=0x7fc678011e60 comp rx=0 tx=0).stop 2024-05-16T21:32:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 shutdown_connections 2024-05-16T21:32:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc6700762d0 0x7fc6700787e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc68c1e72f0 0x7fc68c1e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc68c1505f0 0x7fc68c1e6db0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 --2- 172.21.15.5:0/1446786182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc67c004db0 0x7fc68c1e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 >> 172.21.15.5:0/1446786182 conn(0x7fc68c0c3d20 msgr2=0x7fc68c1d7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 shutdown_connections 2024-05-16T21:32:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.389+0000 7fc692af9640 1 -- 172.21.15.5:0/1446786182 wait complete. 2024-05-16T21:32:59.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T21:32:53.518776+0000', 'modified': '2024-05-16T21:32:56.567421+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4692}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4692': {'gid': 4692, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/2543237506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 2543237506}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 2543237506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4692, 'qdb_cluster': [4692]} 2024-05-16T21:32:59.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-16T21:32:59.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-16T21:32:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.817+0000 7fec69d3f640 1 Processor -- start 2024-05-16T21:32:59.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.817+0000 7fec69d3f640 1 -- start start 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec69d3f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec6414e360 0x7fec641522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec69d3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640bf9b0 0x7fec640bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec69d3f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec640c1390 con 0x7fec64148770 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec69d3f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fec64151e40 con 0x7fec6414e360 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec69d3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec640c0620 con 0x7fec640bf9b0 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec62ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec64148770 0x7fec640c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54408/0 (socket says 172.21.15.5:54408) 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec62ffd640 1 -- 172.21.15.5:0/2446676070 learned_addr learned my addr 172.21.15.5:0/2446676070 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec637fe640 1 --2- 172.21.15.5:0/2446676070 >> v2:172.21.15.157:3300/0 conn(0x7fec6414e360 0x7fec641522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec63fff640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640bf9b0 0x7fec640bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143183521 0 0) 0x7fec58001110 con 0x7fec64148770 2024-05-16T21:32:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec4c003520 con 0x7fec64148770 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3279914171 0 0) 0x7fec4c003520 con 0x7fec64148770 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640bf9b0 msgr2=0x7fec640bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640bf9b0 0x7fec640bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 >> v2:172.21.15.157:3300/0 conn(0x7fec6414e360 msgr2=0x7fec641522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 --2- 172.21.15.5:0/2446676070 >> v2:172.21.15.157:3300/0 conn(0x7fec6414e360 0x7fec641522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec64151ad0 con 0x7fec64148770 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.818+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fec580018e0 con 0x7fec64148770 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 >> v1:172.21.15.5:6789/0 conn(0x7fec64148770 legacy=0x7fec640c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec627fc640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec627fc640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640bf9b0 0x7fec4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec627fc640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004d40 0x7fec4c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec64151e40 con 0x7fec4c003a00 2024-05-16T21:32:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fec640c0620 con 0x7fec4c004d40 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c00baf0 con 0x7fec640bf9b0 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec637fe640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec62ffd640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640bf9b0 0x7fec4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec63fff640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004d40 0x7fec4c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec637fe640 1 -- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640bf9b0 msgr2=0x7fec4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec637fe640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec640bf9b0 0x7fec4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec637fe640 1 -- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004d40 msgr2=0x7fec4c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec637fe640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004d40 0x7fec4c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.819+0000 7fec637fe640 1 -- 172.21.15.5:0/2446676070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c003520 con 0x7fec4c003a00 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.820+0000 7fec637fe640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec4c003e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec54009ac0 tx=0x7fec4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c677ff3cc664e53 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.820+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54036070 con 0x7fec4c003a00 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.820+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54031400 con 0x7fec4c003a00 2024-05-16T21:32:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.820+0000 7fec627fc640 1 -- 172.21.15.5:0/2446676070 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54009690 con 0x7fec4c003a00 2024-05-16T21:32:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.820+0000 7fec69d3f640 1 -- 172.21.15.5:0/2446676070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 msgr2=0x7fec4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.820+0000 7fec69d3f640 1 --2- 172.21.15.5:0/2446676070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec4c003e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec54009ac0 tx=0x7fec4c005830 comp rx=0 tx=0).stop 2024-05-16T21:32:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.820+0000 7fec63fff640 1 -- 172.21.15.5:0/2446676070 reap_dead start 2024-05-16T21:32:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.821+0000 7fec69d3f640 1 -- 172.21.15.5:0/2446676070 shutdown_connections 2024-05-16T21:32:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.821+0000 7fec69d3f640 1 -- 172.21.15.5:0/2446676070 >> 172.21.15.5:0/2446676070 conn(0x7fec640c17c0 msgr2=0x7fec640c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.821+0000 7fec69d3f640 1 -- 172.21.15.5:0/2446676070 shutdown_connections 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.821+0000 7fec69d3f640 1 -- 172.21.15.5:0/2446676070 wait complete. 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.822+0000 7fec69d3f640 1 Processor -- start 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.822+0000 7fec69d3f640 1 -- start start 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec69d3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec641e4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec69d3f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec641d9320 0x7fec641459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec69d3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec64145ef0 0x7fec641e7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec69d3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec640bff40 con 0x7fec4c003a00 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec69d3f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fec640bfdc0 con 0x7fec641d9320 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec69d3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec640c00c0 con 0x7fec64145ef0 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec641e4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec641e4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46734/0 (socket says 172.21.15.5:46734) 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.823+0000 7fec637fe640 1 -- 172.21.15.5:0/1338256946 learned_addr learned my addr 172.21.15.5:0/1338256946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec63fff640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec64145ef0 0x7fec641e7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec62ffd640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec641d9320 0x7fec641459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec637fe640 1 -- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec64145ef0 msgr2=0x7fec641e7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec637fe640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec64145ef0 0x7fec641e7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec637fe640 1 -- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec641d9320 msgr2=0x7fec641459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec637fe640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec641d9320 0x7fec641459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec637fe640 1 -- 172.21.15.5:0/1338256946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec641e4ab0 con 0x7fec4c003a00 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec63fff640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec64145ef0 0x7fec641e7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec62ffd640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec641d9320 0x7fec641459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec637fe640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec641e4570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fec5402ac80 tx=0x7fec54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec4bfff640 1 -- 172.21.15.5:0/1338256946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54040020 con 0x7fec4c003a00 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec4bfff640 1 -- 172.21.15.5:0/1338256946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54003950 con 0x7fec4c003a00 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec4bfff640 1 -- 172.21.15.5:0/1338256946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54036040 con 0x7fec4c003a00 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec69d3f640 1 -- 172.21.15.5:0/1338256946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec641d7730 con 0x7fec4c003a00 2024-05-16T21:32:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.824+0000 7fec69d3f640 1 -- 172.21.15.5:0/1338256946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec641d9f10 con 0x7fec4c003a00 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.826+0000 7fec4bfff640 1 -- 172.21.15.5:0/1338256946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fec54043020 con 0x7fec4c003a00 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.826+0000 7fec4bfff640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec500762d0 0x7fec500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.826+0000 7fec4bfff640 1 -- 172.21.15.5:0/1338256946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fec540b77e0 con 0x7fec4c003a00 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.827+0000 7fec62ffd640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec500762d0 0x7fec500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.827+0000 7fec62ffd640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec500762d0 0x7fec500787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec58001eb0 tx=0x7fec58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.827+0000 7fec70bf6740 1 Processor -- start 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.828+0000 7fec70bf6740 1 -- start start 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6751b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd639670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd27b590 0x561dfd66a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec70bf6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561dfd5aff10 con 0x561dfd29c270 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec70bf6740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561dfd59fab0 con 0x561dfd27b590 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec70bf6740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x561dfd5a3af0 con 0x561dfd2733b0 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6751b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6751b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46738/0 (socket says 172.21.15.5:46738) 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 -- 172.21.15.5:0/1133032572 learned_addr learned my addr 172.21.15.5:0/1133032572 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec63fff640 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd27b590 0x561dfd66a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec62ffd640 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd639670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 -- 172.21.15.5:0/1133032572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 msgr2=0x561dfd639670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd639670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 -- 172.21.15.5:0/1133032572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd27b590 msgr2=0x561dfd66a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd27b590 0x561dfd66a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 -- 172.21.15.5:0/1133032572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dfd5635d0 con 0x561dfd29c270 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.829+0000 7fec637fe640 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6751b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec540b5c50 tx=0x7fec540801b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ba25dd553054f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.830+0000 7fec497fa640 1 -- 172.21.15.5:0/1133032572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54089160 con 0x561dfd29c270 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.830+0000 7fec497fa640 1 -- 172.21.15.5:0/1133032572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54080a40 con 0x561dfd29c270 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.830+0000 7fec497fa640 1 -- 172.21.15.5:0/1133032572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54084df0 con 0x561dfd29c270 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.830+0000 7fec70bf6740 1 -- 172.21.15.5:0/1133032572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 msgr2=0x561dfd6751b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.830+0000 7fec70bf6740 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6751b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec540b5c50 tx=0x7fec540801b0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.830+0000 7fec70bf6740 1 -- 172.21.15.5:0/1133032572 shutdown_connections 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.830+0000 7fec70bf6740 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd27b590 0x561dfd66a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.831+0000 7fec70bf6740 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd639670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.831+0000 7fec70bf6740 1 --2- 172.21.15.5:0/1133032572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6751b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.831+0000 7fec70bf6740 1 -- 172.21.15.5:0/1133032572 >> 172.21.15.5:0/1133032572 conn(0x561dfd2903c0 msgr2=0x561dfd6748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.831+0000 7fec70bf6740 1 -- 172.21.15.5:0/1133032572 shutdown_connections 2024-05-16T21:32:59.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.831+0000 7fec70bf6740 1 -- 172.21.15.5:0/1133032572 wait complete. 2024-05-16T21:32:59.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.831+0000 7fec70bf6740 1 -- start start 2024-05-16T21:32:59.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.831+0000 7fec70bf6740 1 Processor -- start 2024-05-16T21:32:59.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.832+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd65b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.832+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd65baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.832+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd29c270 0x561dfd65bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.832+0000 7fec70bf6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561dfd285850 con 0x561dfd27b590 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.832+0000 7fec70bf6740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561dfd55bc10 con 0x561dfd29c270 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.832+0000 7fec70bf6740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x561dfd5a3af0 con 0x561dfd2733b0 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec70bf6740 10 client.0 _ll_register_callbacks cb 0x561dfd55f150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd65baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd65baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46742/0 (socket says 172.21.15.5:46742) 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 -- 172.21.15.5:0/2663205641 learned_addr learned my addr 172.21.15.5:0/2663205641 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec63fff640 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd29c270 0x561dfd65bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec637fe640 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd65b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 -- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 msgr2=0x561dfd65b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd65b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 -- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd29c270 msgr2=0x561dfd65bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd29c270 0x561dfd65bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 -- 172.21.15.5:0/2663205641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dfd2b42d0 con 0x561dfd27b590 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec637fe640 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd65b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec62ffd640 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd65baa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fec58014680 tx=0x7fec640b8ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce036b4f4d1d1f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec427fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec427fc640 1 -- 172.21.15.5:0/2663205641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5801a030 con 0x561dfd27b590 2024-05-16T21:32:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec70bf6740 1 -- 172.21.15.5:0/2663205641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec54080a40 con 0x561dfd27b590 2024-05-16T21:32:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec427fc640 1 -- 172.21.15.5:0/2663205641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fec580217b0 con 0x561dfd27b590 2024-05-16T21:32:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec427fc640 1 -- 172.21.15.5:0/2663205641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fec5802f050 con 0x561dfd27b590 2024-05-16T21:32:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec70bf6740 10 client.4848 fetch_fsmap learned FSMap version 16 2024-05-16T21:32:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.833+0000 7fec70bf6740 1 -- 172.21.15.5:0/2663205641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x561dfd37e6b0 con 0x561dfd27b590 2024-05-16T21:32:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec427fc640 1 -- 172.21.15.5:0/2663205641 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54080a40 con 0x561dfd27b590 2024-05-16T21:32:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec427fc640 1 -- 172.21.15.5:0/2663205641 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 16) ==== 2889+0+0 (secure 0 0 0) 0x7fec58032020 con 0x561dfd27b590 2024-05-16T21:32:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec70bf6740 10 client.4848 fetch_fsmap finished waiting for FSMap version 16 2024-05-16T21:32:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec70bf6740 10 client.4848 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec70bf6740 20 client.4848 populate_metadata read hostname 'smithi005' 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec70bf6740 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] conn(0x561dfd25ae40 0x561dfd6843f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec70bf6740 4 client.4848 mds_command: new command op to 4692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec70bf6740 1 -- 172.21.15.5:0/2663205641 --> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dfd5b1e60 con 0x561dfd25ae40 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec637fe640 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] conn(0x561dfd25ae40 0x561dfd6843f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec427fc640 10 client.4848 ms_handle_connect on v2:172.21.15.5:6833/2543237506 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.834+0000 7fec637fe640 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] conn(0x561dfd25ae40 0x561dfd6843f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd1ba0284d0b6c1 server_cookie=bc39c12cf68eac45 in_seq=0 out_seq=0 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec427fc640 1 -- 172.21.15.5:0/2663205641 <== mds.0 v2:172.21.15.5:6833/2543237506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561dfd5b1e60 con 0x561dfd25ae40 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec427fc640 10 client.4848 handle_command_reply: tid=0 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 client.4848 shutdown 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 -- 172.21.15.5:0/2663205641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 msgr2=0x561dfd65baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd65baa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fec58014680 tx=0x7fec640b8ac0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 -- 172.21.15.5:0/2663205641 shutdown_connections 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd29c270 0x561dfd65bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] conn(0x561dfd25ae40 0x561dfd6843f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd65baa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 --2- 172.21.15.5:0/2663205641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd2733b0 0x561dfd65b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec427fc640 0 client.4848 ms_handle_reset on v2:172.21.15.5:6833/2543237506 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 -- 172.21.15.5:0/2663205641 >> 172.21.15.5:0/2663205641 conn(0x561dfd2903c0 msgr2=0x561dfd63d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 -- 172.21.15.5:0/2663205641 shutdown_connections 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.835+0000 7fec70bf6740 1 -- 172.21.15.5:0/2663205641 wait complete. 2024-05-16T21:32:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.836+0000 7fec70bf6740 20 client.4848 trim_cache size 0 max 16384 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.854+0000 7fec70bf6740 1 Processor -- start 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.854+0000 7fec70bf6740 1 -- start start 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.855+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 0x561dfd67e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.855+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd63cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd29c270 0x561dfd66d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec70bf6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec641f1920 con 0x561dfd27b590 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec70bf6740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fec641e8550 con 0x561dfd2733b0 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec70bf6740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec641f09d0 con 0x561dfd29c270 2024-05-16T21:32:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd63cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd63cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46746/0 (socket says 172.21.15.5:46746) 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 -- 172.21.15.5:0/3996382214 learned_addr learned my addr 172.21.15.5:0/3996382214 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec637fe640 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 0x561dfd67e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec63fff640 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd29c270 0x561dfd66d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 -- 172.21.15.5:0/3996382214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd29c270 msgr2=0x561dfd66d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd29c270 0x561dfd66d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 -- 172.21.15.5:0/3996382214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 msgr2=0x561dfd67e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 0x561dfd67e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 -- 172.21.15.5:0/3996382214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dfd66fc00 con 0x561dfd27b590 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec62ffd640 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd63cf40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fec58014f80 tx=0x7fec58021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afd29f539a8d9ee server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec48ff9640 1 -- 172.21.15.5:0/3996382214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58037020 con 0x561dfd27b590 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec48ff9640 1 -- 172.21.15.5:0/3996382214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec58027070 con 0x561dfd27b590 2024-05-16T21:32:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.856+0000 7fec48ff9640 1 -- 172.21.15.5:0/3996382214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5801a070 con 0x561dfd27b590 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 -- 172.21.15.5:0/3996382214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 msgr2=0x561dfd63cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd63cf40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fec58014f80 tx=0x7fec58021000 comp rx=0 tx=0).stop 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 -- 172.21.15.5:0/3996382214 shutdown_connections 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd29c270 0x561dfd66d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd27b590 0x561dfd63cf40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 --2- 172.21.15.5:0/3996382214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 0x561dfd67e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 -- 172.21.15.5:0/3996382214 >> 172.21.15.5:0/3996382214 conn(0x561dfd2903c0 msgr2=0x561dfd66ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 -- 172.21.15.5:0/3996382214 shutdown_connections 2024-05-16T21:32:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.857+0000 7fec70bf6740 1 -- 172.21.15.5:0/3996382214 wait complete. 2024-05-16T21:32:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.858+0000 7fec70bf6740 1 -- start start 2024-05-16T21:32:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.858+0000 7fec70bf6740 1 Processor -- start 2024-05-16T21:32:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 0x561dfd6f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd27b590 0x561dfd6f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec70bf6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec70bf6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561dfd59fab0 con 0x561dfd29c270 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec70bf6740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561dfd5aff10 con 0x561dfd2733b0 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec70bf6740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x561dfd680db0 con 0x561dfd27b590 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec70bf6740 10 client.0 _ll_register_callbacks cb 0x7fec58010dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46756/0 (socket says 172.21.15.5:46756) 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec63fff640 1 -- 172.21.15.5:0/241187510 learned_addr learned my addr 172.21.15.5:0/241187510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec62ffd640 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd27b590 0x561dfd6f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec637fe640 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 0x561dfd6f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec63fff640 1 -- 172.21.15.5:0/241187510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd27b590 msgr2=0x561dfd6f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec63fff640 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd27b590 0x561dfd6f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec63fff640 1 -- 172.21.15.5:0/241187510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 msgr2=0x561dfd6f19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.859+0000 7fec63fff640 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 0x561dfd6f19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec63fff640 1 -- 172.21.15.5:0/241187510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dfd671ff0 con 0x561dfd29c270 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec63fff640 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6f2430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fec640a0fb0 tx=0x7fec5c0046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b184be7d3ddc0c0f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec427fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec427fc640 1 -- 172.21.15.5:0/241187510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c018d90 con 0x561dfd29c270 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec427fc640 1 -- 172.21.15.5:0/241187510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fec5c021440 con 0x561dfd29c270 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 1 -- 172.21.15.5:0/241187510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec58027070 con 0x561dfd29c270 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec427fc640 1 -- 172.21.15.5:0/241187510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fec5c029050 con 0x561dfd29c270 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 10 client.4854 fetch_fsmap learned FSMap version 16 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 1 -- 172.21.15.5:0/241187510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x561dfd65d930 con 0x561dfd29c270 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec427fc640 1 -- 172.21.15.5:0/241187510 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec58027070 con 0x561dfd29c270 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec427fc640 1 -- 172.21.15.5:0/241187510 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 16) ==== 2889+0+0 (secure 0 0 0) 0x7fec5c02c020 con 0x561dfd29c270 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 10 client.4854 fetch_fsmap finished waiting for FSMap version 16 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 10 client.4854 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-16T21:32:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 20 client.4854 populate_metadata read hostname 'smithi005' 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] conn(0x561dfd6ee6c0 0x561dfd6eead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 4 client.4854 mds_command: new command op to 4692 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec70bf6740 1 -- 172.21.15.5:0/241187510 --> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] -- command(tid 0: {"prefix": "status"}) -- 0x561dfd5ab640 con 0x561dfd6ee6c0 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.860+0000 7fec637fe640 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] conn(0x561dfd6ee6c0 0x561dfd6eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec427fc640 10 client.4854 ms_handle_connect on v2:172.21.15.5:6833/2543237506 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec637fe640 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] conn(0x561dfd6ee6c0 0x561dfd6eead0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7261b9d1128af26 server_cookie=e3021826b0fa699e in_seq=0 out_seq=0 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec427fc640 1 -- 172.21.15.5:0/241187510 <== mds.0 v2:172.21.15.5:6833/2543237506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561dfd5ab640 con 0x561dfd6ee6c0 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec427fc640 10 client.4854 handle_command_reply: tid=0 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 client.4854 shutdown 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 -- 172.21.15.5:0/241187510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 msgr2=0x561dfd6f2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6f2430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fec640a0fb0 tx=0x7fec5c0046a0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 -- 172.21.15.5:0/241187510 shutdown_connections 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.5:6833/2543237506,v1:172.21.15.5:6835/2543237506] conn(0x561dfd6ee6c0 0x561dfd6eead0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561dfd29c270 0x561dfd6f2430 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561dfd27b590 0x561dfd6f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec427fc640 0 client.4854 ms_handle_reset on v2:172.21.15.5:6833/2543237506 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 --2- 172.21.15.5:0/241187510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561dfd2733b0 0x561dfd6f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 -- 172.21.15.5:0/241187510 >> 172.21.15.5:0/241187510 conn(0x561dfd2903c0 msgr2=0x561dfd694b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 -- 172.21.15.5:0/241187510 shutdown_connections 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.861+0000 7fec70bf6740 1 -- 172.21.15.5:0/241187510 wait complete. 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec70bf6740 20 client.4854 trim_cache size 0 max 16384 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "4223c61e-038a-4696-b0eb-6b69d601e381", 2024-05-16T21:32:59.869 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4692, 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.7403362949999996, 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 16, 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 31, 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 31, 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 12.637750891 2024-05-16T21:32:59.870 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T21:32:59.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 -- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec500762d0 msgr2=0x7fec500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec500762d0 0x7fec500787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec58001eb0 tx=0x7fec58009040 comp rx=0 tx=0).stop 2024-05-16T21:32:59.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 -- 172.21.15.5:0/1338256946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 msgr2=0x7fec641e4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec641e4570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fec5402ac80 tx=0x7fec54004730 comp rx=0 tx=0).stop 2024-05-16T21:32:59.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 -- 172.21.15.5:0/1338256946 shutdown_connections 2024-05-16T21:32:59.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fec500762d0 0x7fec500787e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec64145ef0 0x7fec641e7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec641d9320 0x7fec641459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 --2- 172.21.15.5:0/1338256946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c003a00 0x7fec641e4570 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 -- 172.21.15.5:0/1338256946 >> 172.21.15.5:0/1338256946 conn(0x7fec640c17c0 msgr2=0x7fec64147ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 -- 172.21.15.5:0/1338256946 shutdown_connections 2024-05-16T21:32:59.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.862+0000 7fec69d3f640 1 -- 172.21.15.5:0/1338256946 wait complete. 2024-05-16T21:32:59.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-16T21:32:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.984+0000 7f2591f3f640 1 Processor -- start 2024-05-16T21:32:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.984+0000 7f2591f3f640 1 -- start start 2024-05-16T21:32:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.985+0000 7f2591f3f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f258c14e360 0x7f258c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.985+0000 7f2591f3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f258c148770 0x7f258c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.985+0000 7f2591f3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c0bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.985+0000 7f2591f3f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f258c151e40 con 0x7f258c148770 2024-05-16T21:32:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.985+0000 7f2591f3f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f258c0c0620 con 0x7f258c14e360 2024-05-16T21:32:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.985+0000 7f2591f3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f258c151ad0 con 0x7f258c0bf9b0 2024-05-16T21:32:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f258c148770 0x7f258c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f258c148770 0x7f258c0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46758/0 (socket says 172.21.15.5:46758) 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258affd640 1 -- 172.21.15.5:0/2439360944 learned_addr learned my addr 172.21.15.5:0/2439360944 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258b7fe640 1 --2- 172.21.15.5:0/2439360944 >> v2:172.21.15.157:3300/0 conn(0x7f258c14e360 0x7f258c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258bfff640 1 --2- 172.21.15.5:0/2439360944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c0bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258affd640 1 -- 172.21.15.5:0/2439360944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 msgr2=0x7f258c0bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258affd640 1 --2- 172.21.15.5:0/2439360944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c0bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258affd640 1 -- 172.21.15.5:0/2439360944 >> v2:172.21.15.157:3300/0 conn(0x7f258c14e360 msgr2=0x7f258c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258affd640 1 --2- 172.21.15.5:0/2439360944 >> v2:172.21.15.157:3300/0 conn(0x7f258c14e360 0x7f258c1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258affd640 1 -- 172.21.15.5:0/2439360944 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c152810 con 0x7f258c148770 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258b7fe640 1 --2- 172.21.15.5:0/2439360944 >> v2:172.21.15.157:3300/0 conn(0x7f258c14e360 0x7f258c1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.986+0000 7f258bfff640 1 --2- 172.21.15.5:0/2439360944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c0bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.987+0000 7f258affd640 1 --2- 172.21.15.5:0/2439360944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c148770 0x7f258c0c0c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f258c0741b0 tx=0x7f258002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462c43eeef903eaa server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.987+0000 7f258a7fc640 1 -- 172.21.15.5:0/2439360944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580037070 con 0x7f258c148770 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.987+0000 7f258a7fc640 1 -- 172.21.15.5:0/2439360944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2580032440 con 0x7f258c148770 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.987+0000 7f258a7fc640 1 -- 172.21.15.5:0/2439360944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580032810 con 0x7f258c148770 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.987+0000 7f2591f3f640 1 -- 172.21.15.5:0/2439360944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c148770 msgr2=0x7f258c0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.988+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2439360944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c148770 0x7f258c0c0c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f258c0741b0 tx=0x7f258002a270 comp rx=0 tx=0).stop 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.988+0000 7f2591f3f640 1 -- 172.21.15.5:0/2439360944 shutdown_connections 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.988+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2439360944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c148770 0x7f258c0c0c80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.988+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2439360944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c0bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.988+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2439360944 >> v2:172.21.15.157:3300/0 conn(0x7f258c14e360 0x7f258c1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.988+0000 7f2591f3f640 1 -- 172.21.15.5:0/2439360944 >> 172.21.15.5:0/2439360944 conn(0x7f258c0c17c0 msgr2=0x7f258c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:32:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.988+0000 7f2591f3f640 1 -- 172.21.15.5:0/2439360944 shutdown_connections 2024-05-16T21:32:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.988+0000 7f2591f3f640 1 -- 172.21.15.5:0/2439360944 wait complete. 2024-05-16T21:32:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.989+0000 7f2591f3f640 1 Processor -- start 2024-05-16T21:32:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.989+0000 7f2591f3f640 1 -- start start 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.990+0000 7f2591f3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c072770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.990+0000 7f2591f3f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258c148770 0x7f258c0a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.990+0000 7f2591f3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c14e360 0x7f258c1e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.990+0000 7f2591f3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0c1340 con 0x7f258c14e360 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.990+0000 7f2591f3f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0c11c0 con 0x7f258c148770 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.990+0000 7f2591f3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f258c09fd50 con 0x7f258c0bf9b0 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c14e360 0x7f258c1e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c14e360 0x7f258c1e4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46768/0 (socket says 172.21.15.5:46768) 2024-05-16T21:32:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 -- 172.21.15.5:0/2091298052 learned_addr learned my addr 172.21.15.5:0/2091298052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258affd640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258c148770 0x7f258c0a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258b7fe640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 -- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 msgr2=0x7f258c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 -- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258c148770 msgr2=0x7f258c0a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258c148770 0x7f258c0a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 -- 172.21.15.5:0/2091298052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c1e5090 con 0x7f258c14e360 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f258bfff640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c14e360 0x7f258c1e4b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f258400cd40 tx=0x7f258400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f2573fff640 1 -- 172.21.15.5:0/2091298052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258400f680 con 0x7f258c14e360 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f2573fff640 1 -- 172.21.15.5:0/2091298052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258400f840 con 0x7f258c14e360 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c0a1610 con 0x7f258c14e360 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f2573fff640 1 -- 172.21.15.5:0/2091298052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258400fc30 con 0x7f258c14e360 2024-05-16T21:32:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.991+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c1e4630 con 0x7f258c14e360 2024-05-16T21:32:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.992+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c1e5260 con 0x7f258c14e360 2024-05-16T21:32:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.993+0000 7f2573fff640 1 -- 172.21.15.5:0/2091298052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f25840213f0 con 0x7f258c14e360 2024-05-16T21:32:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.993+0000 7f2573fff640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2578076300 0x7f2578078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:32:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.994+0000 7f2573fff640 1 -- 172.21.15.5:0/2091298052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2584098160 con 0x7f258c14e360 2024-05-16T21:32:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.994+0000 7f258b7fe640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2578076300 0x7f2578078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:32:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.994+0000 7f258b7fe640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2578076300 0x7f2578078810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f257c00aac0 tx=0x7f257c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:00.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:32:59.998+0000 7f2573fff640 1 -- 172.21.15.5:0/2091298052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f258c1e5260 con 0x7f258c14e360 2024-05-16T21:33:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.229+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f258c14c240 con 0x7f258c14e360 2024-05-16T21:33:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.229+0000 7f2573fff640 1 -- 172.21.15.5:0/2091298052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f2584014030 con 0x7f258c14e360 2024-05-16T21:33:00.231 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-16T21:33:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2578076300 msgr2=0x7f2578078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2578076300 0x7f2578078810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f257c00aac0 tx=0x7f257c008040 comp rx=0 tx=0).stop 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c14e360 msgr2=0x7f258c1e4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c14e360 0x7f258c1e4b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f258400cd40 tx=0x7f258400a650 comp rx=0 tx=0).stop 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 shutdown_connections 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2578076300 0x7f2578078810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c14e360 0x7f258c1e4b50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f258c148770 0x7f258c0a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 --2- 172.21.15.5:0/2091298052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f258c0bf9b0 0x7f258c072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 >> 172.21.15.5:0/2091298052 conn(0x7f258c0c17c0 msgr2=0x7f258c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 shutdown_connections 2024-05-16T21:33:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:00.231+0000 7f2591f3f640 1 -- 172.21.15.5:0/2091298052 wait complete. 2024-05-16T21:33:00.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-16T21:33:00.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-16T21:33:00.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-05-16T21:33:00.245 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-16T21:33:00.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:00.245 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-16T21:33:00.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-16T21:33:00.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-16T21:33:00.245 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T21:33:00.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:00.245 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-05-16T21:33:00.304 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-16T21:33:00.304 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-16T21:33:00.304 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-05-16T21:33:00.304 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:00.304 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-05-16T21:33:00.304 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42590sec preferred_lft 42590sec 2024-05-16T21:33:00.305 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 1e:b3:75:33:8c:51 brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::50bb:f9ff:fed5:1762/64 scope link 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 1e:b3:75:33:8c:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::1cb3:75ff:fe33:8c51/64 scope link 2024-05-16T21:33:00.306 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:00.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:00.307 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-16T21:33:00.383 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-05-16T21:33:00.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:00.387 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-05-16T21:33:00.434 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-05-16T21:33:00.434 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-16T21:33:00.434 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-16T21:33:00.434 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-16T21:33:00.434 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-16T21:33:00.435 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T21:33:00.435 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-05-16T21:33:00.435 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-16T21:33:00.435 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-16T21:33:00.435 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-16T21:33:00.435 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-05-16T21:33:00.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T21:33:00.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:00.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:00.632 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-05-16T21:33:00.675 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-16T21:33:00.676 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T21:33:00.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:00.676 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-05-16T21:33:00.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T21:33:00.801 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:00.853 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-16T21:33:00.853 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T21:33:00.853 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:00.903 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-16T21:33:00.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:00.903 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:33:01.106 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:33:01.106 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:33:01.106 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:33:01.133 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:33:01.133 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:33:01.133 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:33:01.133 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-05-16T21:33:01.134 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T21:33:01.168 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:33:01.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:33:01.168 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:33:01.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-05-16T21:33:01.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T21:33:01.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.157:6789,172.21.15.157:6790" 2024-05-16T21:33:01.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.157:6789,172.21.15.157:6790:/ 2024-05-16T21:33:01.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4223c61e-038a-4696-b0eb-6b69d601e381" will pass to kernel 2024-05-16T21:33:01.170 INFO:teuthology.orchestra.run.smithi181.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-16T21:33:01.170 INFO:teuthology.orchestra.run.smithi181.stdout: You just mounted a file system that supports labels which does not 2024-05-16T21:33:01.170 INFO:teuthology.orchestra.run.smithi181.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-16T21:33:01.170 INFO:teuthology.orchestra.run.smithi181.stdout: applications will generate AVC messages and not be allowed access to 2024-05-16T21:33:01.170 INFO:teuthology.orchestra.run.smithi181.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-16T21:33:01.176 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-16T21:33:01.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:01.176 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:01.250 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T21:33:01.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:01.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:01.376 INFO:teuthology.orchestra.run.smithi181.stdout:client4863 2024-05-16T21:33:01.377 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:33:01.377 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:33:01.428 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt --help') 2024-05-16T21:33:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:01.631 INFO:teuthology.orchestra.run.smithi181.stdout:fscrypt - A tool for managing Linux native filesystem encryption 2024-05-16T21:33:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout:Usage: 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: fscrypt COMMAND [arguments] [options] 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout:Commands: 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: setup - perform global setup or filesystem setup 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: encrypt - enable filesystem encryption for a directory 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: unlock - unlock an encrypted directory 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: lock - lock an encrypted directory 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: purge - Remove a filesystem's keys 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: status - print the global, filesystem, or file status 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: metadata - [ADVANCED] manipulate the policy or protector metadata 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.632 INFO:teuthology.orchestra.run.smithi181.stdout:Options: 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: --verbose Prints additional debug messages to standard 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: output. 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: --quiet Prints nothing to standard output except for 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: errors. Selects the default for any options that 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: would normally show a prompt. 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: --help Prints help screen for commands and subcommands. 2024-05-16T21:33:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:01.645 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --help') 2024-05-16T21:33:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout:fscrypt setup - perform global setup or filesystem setup 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout:Usage: 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout: fscrypt setup [MOUNTPOINT] [options] 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout:Description: 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout: This command creates fscrypt's global config file and/or prepares a filesystem 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout: for use with fscrypt. 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.795 INFO:teuthology.orchestra.run.smithi181.stdout: (1) When used without MOUNTPOINT, this command creates the global config file 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: /etc/fscrypt.conf and the fscrypt metadata directory for the root filesystem 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: (i.e. /.fscrypt). This requires root privileges. The passphrase hashing 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: parameters in /etc/fscrypt.conf are automatically set to an appropriate 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: hardness, as determined by --time=TIME. The root filesystem's metadata 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: directory is created even if the root filesystem doesn't support encryption 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: itself, since it's where login passphrase protectors are stored. 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: (2) When used with MOUNTPOINT, this command creates the fscrypt metadata 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: directory for the filesystem mounted at MOUNTPOINT. This allows fscrypt to be 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: used on that filesystem, provided that any kernel and filesystem-specific 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: prerequisites are also met (see the README). This may require root privileges. 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.796 INFO:teuthology.orchestra.run.smithi181.stdout:Options: 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: --time=TIME Set the global options so that passphrase hashing 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: takes TIME long. TIME should be formatted as a 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: sequence of decimal numbers, each with optional 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: fraction and a unit suffix, such as "300ms", 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: "1.5s" or "2h45m". Valid time units are "ms", 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: "s", "m", and "h". (default: 1s) 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: --force Suppresses all confirmation prompts and warnings, 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: causing any action to automatically proceed. 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: WARNING: This bypasses confirmations for 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: protective operations, use with care. 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: --all-users When setting up a filesystem for fscrypt, allow 2024-05-16T21:33:01.797 INFO:teuthology.orchestra.run.smithi181.stdout: users other than the calling user (typically 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: root) to create fscrypt policies and protectors 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: on the filesystem. Note that this will create a 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: world-writable directory, which users could use 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: to fill up the entire filesystem. Hence, this 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: option may not be appropriate for some systems. 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: --verbose Prints additional debug messages to standard 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: output. 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: --quiet Prints nothing to standard output except for 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: errors. Selects the default for any options that 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: would normally show a prompt. 2024-05-16T21:33:01.798 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.799 INFO:teuthology.orchestra.run.smithi181.stdout: --help Prints help screen for commands and subcommands. 2024-05-16T21:33:01.799 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:01.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:01.809 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --force --quiet') 2024-05-16T21:33:01.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:05.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:05.055 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-16T21:33:05.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:05.182 INFO:teuthology.orchestra.run.smithi181.stdout:filesystems supporting encryption: 0 2024-05-16T21:33:05.182 INFO:teuthology.orchestra.run.smithi181.stdout:filesystems with fscrypt metadata: 1 2024-05-16T21:33:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:05.182 INFO:teuthology.orchestra.run.smithi181.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-16T21:33:05.182 INFO:teuthology.orchestra.run.smithi181.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-16T21:33:05.182 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-16T21:33:05.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:05.195 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-16T21:33:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:05.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:05.366 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-16T21:33:05.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:05.506 INFO:teuthology.orchestra.run.smithi181.stdout:filesystems supporting encryption: 1 2024-05-16T21:33:05.506 INFO:teuthology.orchestra.run.smithi181.stdout:filesystems with fscrypt metadata: 2 2024-05-16T21:33:05.506 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:05.506 INFO:teuthology.orchestra.run.smithi181.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-16T21:33:05.507 INFO:teuthology.orchestra.run.smithi181.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-16T21:33:05.507 INFO:teuthology.orchestra.run.smithi181.stdout:/home/ubuntu/cephtest/mnt.0 ceph supported Yes 2024-05-16T21:33:05.507 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-16T21:33:05.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:05.518 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo dd if=/dev/urandom of=/tmp/key bs=32 count=1') 2024-05-16T21:33:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:05.636 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-16T21:33:05.636 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-16T21:33:05.636 INFO:teuthology.orchestra.run.smithi181.stderr:32 bytes copied, 0.000131566 s, 243 kB/s 2024-05-16T21:33:05.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:05.648 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p dir/') 2024-05-16T21:33:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:05.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:05.756 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt encrypt --quiet --source=raw_key --name=RkmZLPEh --no-recovery --skip-unlock --key=/tmp/key dir/') 2024-05-16T21:33:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:05.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:05.939 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt unlock --quiet --key=/tmp/key dir/') 2024-05-16T21:33:06.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:06.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:06.090 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'cp -av /usr/include dir//') 2024-05-16T21:33:06.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:06.378 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include' -> 'dir/include' 2024-05-16T21:33:06.378 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm' -> 'dir/include/asm' 2024-05-16T21:33:06.378 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/a.out.h' -> 'dir/include/asm/a.out.h' 2024-05-16T21:33:06.378 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/amd_hsmp.h' -> 'dir/include/asm/amd_hsmp.h' 2024-05-16T21:33:06.378 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/auxvec.h' -> 'dir/include/asm/auxvec.h' 2024-05-16T21:33:06.378 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/bitsperlong.h' -> 'dir/include/asm/bitsperlong.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/boot.h' -> 'dir/include/asm/boot.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/bootparam.h' -> 'dir/include/asm/bootparam.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/bpf_perf_event.h' -> 'dir/include/asm/bpf_perf_event.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/byteorder.h' -> 'dir/include/asm/byteorder.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/debugreg.h' -> 'dir/include/asm/debugreg.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/e820.h' -> 'dir/include/asm/e820.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/errno.h' -> 'dir/include/asm/errno.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/fcntl.h' -> 'dir/include/asm/fcntl.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/hw_breakpoint.h' -> 'dir/include/asm/hw_breakpoint.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/hwcap2.h' -> 'dir/include/asm/hwcap2.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/ioctl.h' -> 'dir/include/asm/ioctl.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/ioctls.h' -> 'dir/include/asm/ioctls.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/ipcbuf.h' -> 'dir/include/asm/ipcbuf.h' 2024-05-16T21:33:06.379 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/ist.h' -> 'dir/include/asm/ist.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/kvm.h' -> 'dir/include/asm/kvm.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/kvm_para.h' -> 'dir/include/asm/kvm_para.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/kvm_perf.h' -> 'dir/include/asm/kvm_perf.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/ldt.h' -> 'dir/include/asm/ldt.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/mce.h' -> 'dir/include/asm/mce.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/mman.h' -> 'dir/include/asm/mman.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/msgbuf.h' -> 'dir/include/asm/msgbuf.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/msr.h' -> 'dir/include/asm/msr.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/mtrr.h' -> 'dir/include/asm/mtrr.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/param.h' -> 'dir/include/asm/param.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/perf_regs.h' -> 'dir/include/asm/perf_regs.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/poll.h' -> 'dir/include/asm/poll.h' 2024-05-16T21:33:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/posix_types.h' -> 'dir/include/asm/posix_types.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/posix_types_32.h' -> 'dir/include/asm/posix_types_32.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/posix_types_64.h' -> 'dir/include/asm/posix_types_64.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/posix_types_x32.h' -> 'dir/include/asm/posix_types_x32.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/prctl.h' -> 'dir/include/asm/prctl.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/processor-flags.h' -> 'dir/include/asm/processor-flags.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/ptrace-abi.h' -> 'dir/include/asm/ptrace-abi.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/ptrace.h' -> 'dir/include/asm/ptrace.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/resource.h' -> 'dir/include/asm/resource.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/sembuf.h' -> 'dir/include/asm/sembuf.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/setup.h' -> 'dir/include/asm/setup.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/sgx.h' -> 'dir/include/asm/sgx.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/shmbuf.h' -> 'dir/include/asm/shmbuf.h' 2024-05-16T21:33:06.381 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/sigcontext.h' -> 'dir/include/asm/sigcontext.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/sigcontext32.h' -> 'dir/include/asm/sigcontext32.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/siginfo.h' -> 'dir/include/asm/siginfo.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/signal.h' -> 'dir/include/asm/signal.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/socket.h' -> 'dir/include/asm/socket.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/sockios.h' -> 'dir/include/asm/sockios.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/stat.h' -> 'dir/include/asm/stat.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/statfs.h' -> 'dir/include/asm/statfs.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/svm.h' -> 'dir/include/asm/svm.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/swab.h' -> 'dir/include/asm/swab.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/termbits.h' -> 'dir/include/asm/termbits.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/termios.h' -> 'dir/include/asm/termios.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/types.h' -> 'dir/include/asm/types.h' 2024-05-16T21:33:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/ucontext.h' -> 'dir/include/asm/ucontext.h' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/unistd.h' -> 'dir/include/asm/unistd.h' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/unistd_32.h' -> 'dir/include/asm/unistd_32.h' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/unistd_64.h' -> 'dir/include/asm/unistd_64.h' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/unistd_x32.h' -> 'dir/include/asm/unistd_x32.h' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/vm86.h' -> 'dir/include/asm/vm86.h' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/vmx.h' -> 'dir/include/asm/vmx.h' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm/vsyscall.h' -> 'dir/include/asm/vsyscall.h' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic' -> 'dir/include/asm-generic' 2024-05-16T21:33:06.383 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/auxvec.h' -> 'dir/include/asm-generic/auxvec.h' 2024-05-16T21:33:06.510 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/bitsperlong.h' -> 'dir/include/asm-generic/bitsperlong.h' 2024-05-16T21:33:06.511 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/bpf_perf_event.h' -> 'dir/include/asm-generic/bpf_perf_event.h' 2024-05-16T21:33:06.511 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/errno-base.h' -> 'dir/include/asm-generic/errno-base.h' 2024-05-16T21:33:06.511 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/errno.h' -> 'dir/include/asm-generic/errno.h' 2024-05-16T21:33:06.511 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/fcntl.h' -> 'dir/include/asm-generic/fcntl.h' 2024-05-16T21:33:06.511 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/hugetlb_encode.h' -> 'dir/include/asm-generic/hugetlb_encode.h' 2024-05-16T21:33:06.511 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/int-l64.h' -> 'dir/include/asm-generic/int-l64.h' 2024-05-16T21:33:06.511 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/int-ll64.h' -> 'dir/include/asm-generic/int-ll64.h' 2024-05-16T21:33:06.511 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/ioctl.h' -> 'dir/include/asm-generic/ioctl.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/ioctls.h' -> 'dir/include/asm-generic/ioctls.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/ipcbuf.h' -> 'dir/include/asm-generic/ipcbuf.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/kvm_para.h' -> 'dir/include/asm-generic/kvm_para.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/mman-common.h' -> 'dir/include/asm-generic/mman-common.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/mman.h' -> 'dir/include/asm-generic/mman.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/msgbuf.h' -> 'dir/include/asm-generic/msgbuf.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/param.h' -> 'dir/include/asm-generic/param.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/poll.h' -> 'dir/include/asm-generic/poll.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/posix_types.h' -> 'dir/include/asm-generic/posix_types.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/resource.h' -> 'dir/include/asm-generic/resource.h' 2024-05-16T21:33:06.512 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/sembuf.h' -> 'dir/include/asm-generic/sembuf.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/setup.h' -> 'dir/include/asm-generic/setup.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/shmbuf.h' -> 'dir/include/asm-generic/shmbuf.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/siginfo.h' -> 'dir/include/asm-generic/siginfo.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/signal-defs.h' -> 'dir/include/asm-generic/signal-defs.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/signal.h' -> 'dir/include/asm-generic/signal.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/socket.h' -> 'dir/include/asm-generic/socket.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/sockios.h' -> 'dir/include/asm-generic/sockios.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/stat.h' -> 'dir/include/asm-generic/stat.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/statfs.h' -> 'dir/include/asm-generic/statfs.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/swab.h' -> 'dir/include/asm-generic/swab.h' 2024-05-16T21:33:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/termbits.h' -> 'dir/include/asm-generic/termbits.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/termios.h' -> 'dir/include/asm-generic/termios.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/types.h' -> 'dir/include/asm-generic/types.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/ucontext.h' -> 'dir/include/asm-generic/ucontext.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/asm-generic/unistd.h' -> 'dir/include/asm-generic/unistd.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cpuidle.h' -> 'dir/include/cpuidle.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm' -> 'dir/include/drm' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/amdgpu_drm.h' -> 'dir/include/drm/amdgpu_drm.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/armada_drm.h' -> 'dir/include/drm/armada_drm.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/drm.h' -> 'dir/include/drm/drm.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/drm_fourcc.h' -> 'dir/include/drm/drm_fourcc.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/drm_mode.h' -> 'dir/include/drm/drm_mode.h' 2024-05-16T21:33:06.514 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/drm_sarea.h' -> 'dir/include/drm/drm_sarea.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/etnaviv_drm.h' -> 'dir/include/drm/etnaviv_drm.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/exynos_drm.h' -> 'dir/include/drm/exynos_drm.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/habanalabs_accel.h' -> 'dir/include/drm/habanalabs_accel.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/ivpu_accel.h' -> 'dir/include/drm/ivpu_accel.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/msm_drm.h' -> 'dir/include/drm/msm_drm.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/nouveau_drm.h' -> 'dir/include/drm/nouveau_drm.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/omap_drm.h' -> 'dir/include/drm/omap_drm.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/panfrost_drm.h' -> 'dir/include/drm/panfrost_drm.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/qaic_accel.h' -> 'dir/include/drm/qaic_accel.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/radeon_drm.h' -> 'dir/include/drm/radeon_drm.h' 2024-05-16T21:33:06.515 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/tegra_drm.h' -> 'dir/include/drm/tegra_drm.h' 2024-05-16T21:33:06.516 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/v3d_drm.h' -> 'dir/include/drm/v3d_drm.h' 2024-05-16T21:33:06.516 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/vc4_drm.h' -> 'dir/include/drm/vc4_drm.h' 2024-05-16T21:33:06.516 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/vgem_drm.h' -> 'dir/include/drm/vgem_drm.h' 2024-05-16T21:33:06.516 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/virtgpu_drm.h' -> 'dir/include/drm/virtgpu_drm.h' 2024-05-16T21:33:06.650 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/vmwgfx_drm.h' -> 'dir/include/drm/vmwgfx_drm.h' 2024-05-16T21:33:06.650 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/i915_drm.h' -> 'dir/include/drm/i915_drm.h' 2024-05-16T21:33:06.650 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/lima_drm.h' -> 'dir/include/drm/lima_drm.h' 2024-05-16T21:33:06.650 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/drm/qxl_drm.h' -> 'dir/include/drm/qxl_drm.h' 2024-05-16T21:33:06.650 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux' -> 'dir/include/linux' 2024-05-16T21:33:06.650 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/a.out.h' -> 'dir/include/linux/a.out.h' 2024-05-16T21:33:06.650 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/acct.h' -> 'dir/include/linux/acct.h' 2024-05-16T21:33:06.650 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/acrn.h' -> 'dir/include/linux/acrn.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/adb.h' -> 'dir/include/linux/adb.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/adfs_fs.h' -> 'dir/include/linux/adfs_fs.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/affs_hardblocks.h' -> 'dir/include/linux/affs_hardblocks.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/agpgart.h' -> 'dir/include/linux/agpgart.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/aio_abi.h' -> 'dir/include/linux/aio_abi.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/am437x-vpfe.h' -> 'dir/include/linux/am437x-vpfe.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/android' -> 'dir/include/linux/android' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/android/binder.h' -> 'dir/include/linux/android/binder.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/android/binderfs.h' -> 'dir/include/linux/android/binderfs.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/apm_bios.h' -> 'dir/include/linux/apm_bios.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/arcfb.h' -> 'dir/include/linux/arcfb.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/arm_sdei.h' -> 'dir/include/linux/arm_sdei.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/aspeed-lpc-ctrl.h' -> 'dir/include/linux/aspeed-lpc-ctrl.h' 2024-05-16T21:33:06.651 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/aspeed-p2a-ctrl.h' -> 'dir/include/linux/aspeed-p2a-ctrl.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atalk.h' -> 'dir/include/linux/atalk.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atm.h' -> 'dir/include/linux/atm.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atm_eni.h' -> 'dir/include/linux/atm_eni.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atm_he.h' -> 'dir/include/linux/atm_he.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atm_idt77105.h' -> 'dir/include/linux/atm_idt77105.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atm_nicstar.h' -> 'dir/include/linux/atm_nicstar.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atm_tcp.h' -> 'dir/include/linux/atm_tcp.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atm_zatm.h' -> 'dir/include/linux/atm_zatm.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmapi.h' -> 'dir/include/linux/atmapi.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmarp.h' -> 'dir/include/linux/atmarp.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmbr2684.h' -> 'dir/include/linux/atmbr2684.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmclip.h' -> 'dir/include/linux/atmclip.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmdev.h' -> 'dir/include/linux/atmdev.h' 2024-05-16T21:33:06.652 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmioc.h' -> 'dir/include/linux/atmioc.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmlec.h' -> 'dir/include/linux/atmlec.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmmpc.h' -> 'dir/include/linux/atmmpc.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmppp.h' -> 'dir/include/linux/atmppp.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmsap.h' -> 'dir/include/linux/atmsap.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/atmsvc.h' -> 'dir/include/linux/atmsvc.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/audit.h' -> 'dir/include/linux/audit.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/auto_dev-ioctl.h' -> 'dir/include/linux/auto_dev-ioctl.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/auto_fs.h' -> 'dir/include/linux/auto_fs.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/auto_fs4.h' -> 'dir/include/linux/auto_fs4.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/auxvec.h' -> 'dir/include/linux/auxvec.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ax25.h' -> 'dir/include/linux/ax25.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/batadv_packet.h' -> 'dir/include/linux/batadv_packet.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/batman_adv.h' -> 'dir/include/linux/batman_adv.h' 2024-05-16T21:33:06.653 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/baycom.h' -> 'dir/include/linux/baycom.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bcm933xx_hcs.h' -> 'dir/include/linux/bcm933xx_hcs.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bfs_fs.h' -> 'dir/include/linux/bfs_fs.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/binfmts.h' -> 'dir/include/linux/binfmts.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/blkpg.h' -> 'dir/include/linux/blkpg.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/blktrace_api.h' -> 'dir/include/linux/blktrace_api.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/blkzoned.h' -> 'dir/include/linux/blkzoned.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bpf.h' -> 'dir/include/linux/bpf.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bpf_common.h' -> 'dir/include/linux/bpf_common.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bpf_perf_event.h' -> 'dir/include/linux/bpf_perf_event.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bpfilter.h' -> 'dir/include/linux/bpfilter.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bpqether.h' -> 'dir/include/linux/bpqether.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bsg.h' -> 'dir/include/linux/bsg.h' 2024-05-16T21:33:06.654 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/bt-bmc.h' -> 'dir/include/linux/bt-bmc.h' 2024-05-16T21:33:06.814 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/btf.h' -> 'dir/include/linux/btf.h' 2024-05-16T21:33:06.814 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/btrfs.h' -> 'dir/include/linux/btrfs.h' 2024-05-16T21:33:06.814 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/btrfs_tree.h' -> 'dir/include/linux/btrfs_tree.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/byteorder' -> 'dir/include/linux/byteorder' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/byteorder/big_endian.h' -> 'dir/include/linux/byteorder/big_endian.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/byteorder/little_endian.h' -> 'dir/include/linux/byteorder/little_endian.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cachefiles.h' -> 'dir/include/linux/cachefiles.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/caif' -> 'dir/include/linux/caif' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/caif/caif_socket.h' -> 'dir/include/linux/caif/caif_socket.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/caif/if_caif.h' -> 'dir/include/linux/caif/if_caif.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can.h' -> 'dir/include/linux/can.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can' -> 'dir/include/linux/can' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can/bcm.h' -> 'dir/include/linux/can/bcm.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can/error.h' -> 'dir/include/linux/can/error.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can/gw.h' -> 'dir/include/linux/can/gw.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can/isotp.h' -> 'dir/include/linux/can/isotp.h' 2024-05-16T21:33:06.815 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can/j1939.h' -> 'dir/include/linux/can/j1939.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can/netlink.h' -> 'dir/include/linux/can/netlink.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can/raw.h' -> 'dir/include/linux/can/raw.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/can/vxcan.h' -> 'dir/include/linux/can/vxcan.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/capability.h' -> 'dir/include/linux/capability.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/capi.h' -> 'dir/include/linux/capi.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cciss_defs.h' -> 'dir/include/linux/cciss_defs.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cciss_ioctl.h' -> 'dir/include/linux/cciss_ioctl.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ccs.h' -> 'dir/include/linux/ccs.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cdrom.h' -> 'dir/include/linux/cdrom.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cec-funcs.h' -> 'dir/include/linux/cec-funcs.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cec.h' -> 'dir/include/linux/cec.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cfm_bridge.h' -> 'dir/include/linux/cfm_bridge.h' 2024-05-16T21:33:06.816 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cgroupstats.h' -> 'dir/include/linux/cgroupstats.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/chio.h' -> 'dir/include/linux/chio.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cifs' -> 'dir/include/linux/cifs' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cifs/cifs_mount.h' -> 'dir/include/linux/cifs/cifs_mount.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cifs/cifs_netlink.h' -> 'dir/include/linux/cifs/cifs_netlink.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/close_range.h' -> 'dir/include/linux/close_range.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cm4000_cs.h' -> 'dir/include/linux/cm4000_cs.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cn_proc.h' -> 'dir/include/linux/cn_proc.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/coda.h' -> 'dir/include/linux/coda.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/coff.h' -> 'dir/include/linux/coff.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/connector.h' -> 'dir/include/linux/connector.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/const.h' -> 'dir/include/linux/const.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/coresight-stm.h' -> 'dir/include/linux/coresight-stm.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cramfs_fs.h' -> 'dir/include/linux/cramfs_fs.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cryptouser.h' -> 'dir/include/linux/cryptouser.h' 2024-05-16T21:33:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cuda.h' -> 'dir/include/linux/cuda.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cxl_mem.h' -> 'dir/include/linux/cxl_mem.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/cycx_cfm.h' -> 'dir/include/linux/cycx_cfm.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dcbnl.h' -> 'dir/include/linux/dcbnl.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dccp.h' -> 'dir/include/linux/dccp.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/devlink.h' -> 'dir/include/linux/devlink.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dlm.h' -> 'dir/include/linux/dlm.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dlm_device.h' -> 'dir/include/linux/dlm_device.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dlm_netlink.h' -> 'dir/include/linux/dlm_netlink.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dlm_plock.h' -> 'dir/include/linux/dlm_plock.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dlmconstants.h' -> 'dir/include/linux/dlmconstants.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dm-ioctl.h' -> 'dir/include/linux/dm-ioctl.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dm-log-userspace.h' -> 'dir/include/linux/dm-log-userspace.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dma-buf.h' -> 'dir/include/linux/dma-buf.h' 2024-05-16T21:33:06.818 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dma-heap.h' -> 'dir/include/linux/dma-heap.h' 2024-05-16T21:33:06.819 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dn.h' -> 'dir/include/linux/dn.h' 2024-05-16T21:33:06.819 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dns_resolver.h' -> 'dir/include/linux/dns_resolver.h' 2024-05-16T21:33:06.819 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dpll.h' -> 'dir/include/linux/dpll.h' 2024-05-16T21:33:06.990 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb' -> 'dir/include/linux/dvb' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb/audio.h' -> 'dir/include/linux/dvb/audio.h' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb/ca.h' -> 'dir/include/linux/dvb/ca.h' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb/dmx.h' -> 'dir/include/linux/dvb/dmx.h' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb/frontend.h' -> 'dir/include/linux/dvb/frontend.h' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb/net.h' -> 'dir/include/linux/dvb/net.h' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb/osd.h' -> 'dir/include/linux/dvb/osd.h' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb/version.h' -> 'dir/include/linux/dvb/version.h' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dvb/video.h' -> 'dir/include/linux/dvb/video.h' 2024-05-16T21:33:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/edd.h' -> 'dir/include/linux/edd.h' 2024-05-16T21:33:06.992 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/efs_fs_sb.h' -> 'dir/include/linux/efs_fs_sb.h' 2024-05-16T21:33:06.992 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/elf-em.h' -> 'dir/include/linux/elf-em.h' 2024-05-16T21:33:06.992 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/elf-fdpic.h' -> 'dir/include/linux/elf-fdpic.h' 2024-05-16T21:33:06.992 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/elf.h' -> 'dir/include/linux/elf.h' 2024-05-16T21:33:06.992 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/errno.h' -> 'dir/include/linux/errno.h' 2024-05-16T21:33:06.992 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/errqueue.h' -> 'dir/include/linux/errqueue.h' 2024-05-16T21:33:06.992 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/erspan.h' -> 'dir/include/linux/erspan.h' 2024-05-16T21:33:06.992 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ethtool.h' -> 'dir/include/linux/ethtool.h' 2024-05-16T21:33:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ethtool_netlink.h' -> 'dir/include/linux/ethtool_netlink.h' 2024-05-16T21:33:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/eventpoll.h' -> 'dir/include/linux/eventpoll.h' 2024-05-16T21:33:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/f2fs.h' -> 'dir/include/linux/f2fs.h' 2024-05-16T21:33:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fadvise.h' -> 'dir/include/linux/fadvise.h' 2024-05-16T21:33:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/falloc.h' -> 'dir/include/linux/falloc.h' 2024-05-16T21:33:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fanotify.h' -> 'dir/include/linux/fanotify.h' 2024-05-16T21:33:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fb.h' -> 'dir/include/linux/fb.h' 2024-05-16T21:33:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fcntl.h' -> 'dir/include/linux/fcntl.h' 2024-05-16T21:33:06.994 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fd.h' -> 'dir/include/linux/fd.h' 2024-05-16T21:33:06.994 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fdreg.h' -> 'dir/include/linux/fdreg.h' 2024-05-16T21:33:06.994 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fib_rules.h' -> 'dir/include/linux/fib_rules.h' 2024-05-16T21:33:06.994 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fiemap.h' -> 'dir/include/linux/fiemap.h' 2024-05-16T21:33:06.994 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/filter.h' -> 'dir/include/linux/filter.h' 2024-05-16T21:33:06.994 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/firewire-cdev.h' -> 'dir/include/linux/firewire-cdev.h' 2024-05-16T21:33:06.994 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/firewire-constants.h' -> 'dir/include/linux/firewire-constants.h' 2024-05-16T21:33:06.994 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fou.h' -> 'dir/include/linux/fou.h' 2024-05-16T21:33:06.995 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fpga-dfl.h' -> 'dir/include/linux/fpga-dfl.h' 2024-05-16T21:33:06.995 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fs.h' -> 'dir/include/linux/fs.h' 2024-05-16T21:33:06.995 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fscrypt.h' -> 'dir/include/linux/fscrypt.h' 2024-05-16T21:33:06.995 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fsi.h' -> 'dir/include/linux/fsi.h' 2024-05-16T21:33:06.995 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fsl_hypervisor.h' -> 'dir/include/linux/fsl_hypervisor.h' 2024-05-16T21:33:06.995 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fsl_mc.h' -> 'dir/include/linux/fsl_mc.h' 2024-05-16T21:33:06.995 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fsmap.h' -> 'dir/include/linux/fsmap.h' 2024-05-16T21:33:06.995 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fsverity.h' -> 'dir/include/linux/fsverity.h' 2024-05-16T21:33:06.996 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/fuse.h' -> 'dir/include/linux/fuse.h' 2024-05-16T21:33:06.996 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/futex.h' -> 'dir/include/linux/futex.h' 2024-05-16T21:33:06.996 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/gameport.h' -> 'dir/include/linux/gameport.h' 2024-05-16T21:33:06.996 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/gen_stats.h' -> 'dir/include/linux/gen_stats.h' 2024-05-16T21:33:06.996 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/genetlink.h' -> 'dir/include/linux/genetlink.h' 2024-05-16T21:33:06.996 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/genwqe' -> 'dir/include/linux/genwqe' 2024-05-16T21:33:06.996 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/genwqe/genwqe_card.h' -> 'dir/include/linux/genwqe/genwqe_card.h' 2024-05-16T21:33:06.996 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/gfs2_ondisk.h' -> 'dir/include/linux/gfs2_ondisk.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/gpio.h' -> 'dir/include/linux/gpio.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/gsmmux.h' -> 'dir/include/linux/gsmmux.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/gtp.h' -> 'dir/include/linux/gtp.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/handshake.h' -> 'dir/include/linux/handshake.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hdlc.h' -> 'dir/include/linux/hdlc.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hdlc' -> 'dir/include/linux/hdlc' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hdlc/ioctl.h' -> 'dir/include/linux/hdlc/ioctl.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hdlcdrv.h' -> 'dir/include/linux/hdlcdrv.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hdreg.h' -> 'dir/include/linux/hdreg.h' 2024-05-16T21:33:06.997 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hid.h' -> 'dir/include/linux/hid.h' 2024-05-16T21:33:06.998 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hiddev.h' -> 'dir/include/linux/hiddev.h' 2024-05-16T21:33:06.998 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hidraw.h' -> 'dir/include/linux/hidraw.h' 2024-05-16T21:33:06.998 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hpet.h' -> 'dir/include/linux/hpet.h' 2024-05-16T21:33:06.998 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hsi' -> 'dir/include/linux/hsi' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hsi/cs-protocol.h' -> 'dir/include/linux/hsi/cs-protocol.h' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hsi/hsi_char.h' -> 'dir/include/linux/hsi/hsi_char.h' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hsr_netlink.h' -> 'dir/include/linux/hsr_netlink.h' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hw_breakpoint.h' -> 'dir/include/linux/hw_breakpoint.h' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hyperv.h' -> 'dir/include/linux/hyperv.h' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/i2c-dev.h' -> 'dir/include/linux/i2c-dev.h' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/i2c.h' -> 'dir/include/linux/i2c.h' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/i2o-dev.h' -> 'dir/include/linux/i2o-dev.h' 2024-05-16T21:33:07.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/i8k.h' -> 'dir/include/linux/i8k.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/icmp.h' -> 'dir/include/linux/icmp.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/icmpv6.h' -> 'dir/include/linux/icmpv6.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/idxd.h' -> 'dir/include/linux/idxd.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if.h' -> 'dir/include/linux/if.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_addr.h' -> 'dir/include/linux/if_addr.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_addrlabel.h' -> 'dir/include/linux/if_addrlabel.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_alg.h' -> 'dir/include/linux/if_alg.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_arcnet.h' -> 'dir/include/linux/if_arcnet.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_arp.h' -> 'dir/include/linux/if_arp.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_bonding.h' -> 'dir/include/linux/if_bonding.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_bridge.h' -> 'dir/include/linux/if_bridge.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_cablemodem.h' -> 'dir/include/linux/if_cablemodem.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_eql.h' -> 'dir/include/linux/if_eql.h' 2024-05-16T21:33:07.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_ether.h' -> 'dir/include/linux/if_ether.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_fc.h' -> 'dir/include/linux/if_fc.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_fddi.h' -> 'dir/include/linux/if_fddi.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_hippi.h' -> 'dir/include/linux/if_hippi.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_infiniband.h' -> 'dir/include/linux/if_infiniband.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_link.h' -> 'dir/include/linux/if_link.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_ltalk.h' -> 'dir/include/linux/if_ltalk.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_macsec.h' -> 'dir/include/linux/if_macsec.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_packet.h' -> 'dir/include/linux/if_packet.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_phonet.h' -> 'dir/include/linux/if_phonet.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_plip.h' -> 'dir/include/linux/if_plip.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_ppp.h' -> 'dir/include/linux/if_ppp.h' 2024-05-16T21:33:07.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_pppol2tp.h' -> 'dir/include/linux/if_pppol2tp.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_pppox.h' -> 'dir/include/linux/if_pppox.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_slip.h' -> 'dir/include/linux/if_slip.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_team.h' -> 'dir/include/linux/if_team.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_tun.h' -> 'dir/include/linux/if_tun.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_tunnel.h' -> 'dir/include/linux/if_tunnel.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_vlan.h' -> 'dir/include/linux/if_vlan.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_x25.h' -> 'dir/include/linux/if_x25.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/if_xdp.h' -> 'dir/include/linux/if_xdp.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ife.h' -> 'dir/include/linux/ife.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/igmp.h' -> 'dir/include/linux/igmp.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/iio' -> 'dir/include/linux/iio' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/iio/buffer.h' -> 'dir/include/linux/iio/buffer.h' 2024-05-16T21:33:07.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/iio/events.h' -> 'dir/include/linux/iio/events.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/iio/types.h' -> 'dir/include/linux/iio/types.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ila.h' -> 'dir/include/linux/ila.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/in.h' -> 'dir/include/linux/in.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/in6.h' -> 'dir/include/linux/in6.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/in_route.h' -> 'dir/include/linux/in_route.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/inet_diag.h' -> 'dir/include/linux/inet_diag.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/inotify.h' -> 'dir/include/linux/inotify.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/input-event-codes.h' -> 'dir/include/linux/input-event-codes.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/input.h' -> 'dir/include/linux/input.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/io_uring.h' -> 'dir/include/linux/io_uring.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ioctl.h' -> 'dir/include/linux/ioctl.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/iommu.h' -> 'dir/include/linux/iommu.h' 2024-05-16T21:33:07.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/iommufd.h' -> 'dir/include/linux/iommufd.h' 2024-05-16T21:33:07.141 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ip.h' -> 'dir/include/linux/ip.h' 2024-05-16T21:33:07.141 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ip6_tunnel.h' -> 'dir/include/linux/ip6_tunnel.h' 2024-05-16T21:33:07.314 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ip_vs.h' -> 'dir/include/linux/ip_vs.h' 2024-05-16T21:33:07.314 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipc.h' -> 'dir/include/linux/ipc.h' 2024-05-16T21:33:07.314 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipmi.h' -> 'dir/include/linux/ipmi.h' 2024-05-16T21:33:07.314 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipmi_bmc.h' -> 'dir/include/linux/ipmi_bmc.h' 2024-05-16T21:33:07.314 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipmi_msgdefs.h' -> 'dir/include/linux/ipmi_msgdefs.h' 2024-05-16T21:33:07.314 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipmi_ssif_bmc.h' -> 'dir/include/linux/ipmi_ssif_bmc.h' 2024-05-16T21:33:07.314 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipv6.h' -> 'dir/include/linux/ipv6.h' 2024-05-16T21:33:07.314 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipv6_route.h' -> 'dir/include/linux/ipv6_route.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipx.h' -> 'dir/include/linux/ipx.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/irqnr.h' -> 'dir/include/linux/irqnr.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/isdn' -> 'dir/include/linux/isdn' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/isdn/capicmd.h' -> 'dir/include/linux/isdn/capicmd.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/iso_fs.h' -> 'dir/include/linux/iso_fs.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/isst_if.h' -> 'dir/include/linux/isst_if.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ivtv.h' -> 'dir/include/linux/ivtv.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ivtvfb.h' -> 'dir/include/linux/ivtvfb.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/jffs2.h' -> 'dir/include/linux/jffs2.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/joystick.h' -> 'dir/include/linux/joystick.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kcm.h' -> 'dir/include/linux/kcm.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kcmp.h' -> 'dir/include/linux/kcmp.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kcov.h' -> 'dir/include/linux/kcov.h' 2024-05-16T21:33:07.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kd.h' -> 'dir/include/linux/kd.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kdev_t.h' -> 'dir/include/linux/kdev_t.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kernel-page-flags.h' -> 'dir/include/linux/kernel-page-flags.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kernel.h' -> 'dir/include/linux/kernel.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kernelcapi.h' -> 'dir/include/linux/kernelcapi.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kexec.h' -> 'dir/include/linux/kexec.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/keyboard.h' -> 'dir/include/linux/keyboard.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/keyctl.h' -> 'dir/include/linux/keyctl.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kfd_ioctl.h' -> 'dir/include/linux/kfd_ioctl.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kfd_sysfs.h' -> 'dir/include/linux/kfd_sysfs.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kvm.h' -> 'dir/include/linux/kvm.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/kvm_para.h' -> 'dir/include/linux/kvm_para.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/l2tp.h' -> 'dir/include/linux/l2tp.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/landlock.h' -> 'dir/include/linux/landlock.h' 2024-05-16T21:33:07.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/libc-compat.h' -> 'dir/include/linux/libc-compat.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/limits.h' -> 'dir/include/linux/limits.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/lirc.h' -> 'dir/include/linux/lirc.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/llc.h' -> 'dir/include/linux/llc.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/loadpin.h' -> 'dir/include/linux/loadpin.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/loop.h' -> 'dir/include/linux/loop.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/lp.h' -> 'dir/include/linux/lp.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/lwtunnel.h' -> 'dir/include/linux/lwtunnel.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/magic.h' -> 'dir/include/linux/magic.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/major.h' -> 'dir/include/linux/major.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/map_to_7segment.h' -> 'dir/include/linux/map_to_7segment.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/matroxfb.h' -> 'dir/include/linux/matroxfb.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/max2175.h' -> 'dir/include/linux/max2175.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mdio.h' -> 'dir/include/linux/mdio.h' 2024-05-16T21:33:07.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/media-bus-format.h' -> 'dir/include/linux/media-bus-format.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/media.h' -> 'dir/include/linux/media.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mei.h' -> 'dir/include/linux/mei.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/membarrier.h' -> 'dir/include/linux/membarrier.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/memfd.h' -> 'dir/include/linux/memfd.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mempolicy.h' -> 'dir/include/linux/mempolicy.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/meye.h' -> 'dir/include/linux/meye.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mii.h' -> 'dir/include/linux/mii.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/minix_fs.h' -> 'dir/include/linux/minix_fs.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/misc' -> 'dir/include/linux/misc' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/misc/bcm_vk.h' -> 'dir/include/linux/misc/bcm_vk.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mman.h' -> 'dir/include/linux/mman.h' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mmc' -> 'dir/include/linux/mmc' 2024-05-16T21:33:07.318 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mmc/ioctl.h' -> 'dir/include/linux/mmc/ioctl.h' 2024-05-16T21:33:07.319 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mmtimer.h' -> 'dir/include/linux/mmtimer.h' 2024-05-16T21:33:07.319 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/module.h' -> 'dir/include/linux/module.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mount.h' -> 'dir/include/linux/mount.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mpls.h' -> 'dir/include/linux/mpls.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mpls_iptunnel.h' -> 'dir/include/linux/mpls_iptunnel.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mptcp.h' -> 'dir/include/linux/mptcp.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mptcp_pm.h' -> 'dir/include/linux/mptcp_pm.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mroute.h' -> 'dir/include/linux/mroute.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mroute6.h' -> 'dir/include/linux/mroute6.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mrp_bridge.h' -> 'dir/include/linux/mrp_bridge.h' 2024-05-16T21:33:07.445 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/msdos_fs.h' -> 'dir/include/linux/msdos_fs.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/msg.h' -> 'dir/include/linux/msg.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mtio.h' -> 'dir/include/linux/mtio.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nbd-netlink.h' -> 'dir/include/linux/nbd-netlink.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nbd.h' -> 'dir/include/linux/nbd.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ncsi.h' -> 'dir/include/linux/ncsi.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ndctl.h' -> 'dir/include/linux/ndctl.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/neighbour.h' -> 'dir/include/linux/neighbour.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/net.h' -> 'dir/include/linux/net.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/net_dropmon.h' -> 'dir/include/linux/net_dropmon.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/net_namespace.h' -> 'dir/include/linux/net_namespace.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/net_tstamp.h' -> 'dir/include/linux/net_tstamp.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netconf.h' -> 'dir/include/linux/netconf.h' 2024-05-16T21:33:07.446 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netdev.h' -> 'dir/include/linux/netdev.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter.h' -> 'dir/include/linux/netfilter.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter' -> 'dir/include/linux/netfilter' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/ipset' -> 'dir/include/linux/netfilter/ipset' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/ipset/ip_set.h' -> 'dir/include/linux/netfilter/ipset/ip_set.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/ipset/ip_set_bitmap.h' -> 'dir/include/linux/netfilter/ipset/ip_set_bitmap.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/ipset/ip_set_hash.h' -> 'dir/include/linux/netfilter/ipset/ip_set_hash.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/ipset/ip_set_list.h' -> 'dir/include/linux/netfilter/ipset/ip_set_list.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_conntrack_common.h' -> 'dir/include/linux/netfilter/nf_conntrack_common.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_conntrack_ftp.h' -> 'dir/include/linux/netfilter/nf_conntrack_ftp.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_conntrack_sctp.h' -> 'dir/include/linux/netfilter/nf_conntrack_sctp.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_conntrack_tcp.h' -> 'dir/include/linux/netfilter/nf_conntrack_tcp.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_conntrack_tuple_common.h' -> 'dir/include/linux/netfilter/nf_conntrack_tuple_common.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_log.h' -> 'dir/include/linux/netfilter/nf_log.h' 2024-05-16T21:33:07.447 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_nat.h' -> 'dir/include/linux/netfilter/nf_nat.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_synproxy.h' -> 'dir/include/linux/netfilter/nf_synproxy.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_tables.h' -> 'dir/include/linux/netfilter/nf_tables.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nf_tables_compat.h' -> 'dir/include/linux/netfilter/nf_tables_compat.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink.h' -> 'dir/include/linux/netfilter/nfnetlink.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_acct.h' -> 'dir/include/linux/netfilter/nfnetlink_acct.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_compat.h' -> 'dir/include/linux/netfilter/nfnetlink_compat.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_conntrack.h' -> 'dir/include/linux/netfilter/nfnetlink_conntrack.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_cthelper.h' -> 'dir/include/linux/netfilter/nfnetlink_cthelper.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_cttimeout.h' -> 'dir/include/linux/netfilter/nfnetlink_cttimeout.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_hook.h' -> 'dir/include/linux/netfilter/nfnetlink_hook.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_log.h' -> 'dir/include/linux/netfilter/nfnetlink_log.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_osf.h' -> 'dir/include/linux/netfilter/nfnetlink_osf.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/nfnetlink_queue.h' -> 'dir/include/linux/netfilter/nfnetlink_queue.h' 2024-05-16T21:33:07.448 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/x_tables.h' -> 'dir/include/linux/netfilter/x_tables.h' 2024-05-16T21:33:07.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_AUDIT.h' -> 'dir/include/linux/netfilter/xt_AUDIT.h' 2024-05-16T21:33:07.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_CHECKSUM.h' -> 'dir/include/linux/netfilter/xt_CHECKSUM.h' 2024-05-16T21:33:07.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_CLASSIFY.h' -> 'dir/include/linux/netfilter/xt_CLASSIFY.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_CONNMARK.h' -> 'dir/include/linux/netfilter/xt_CONNMARK.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_CONNSECMARK.h' -> 'dir/include/linux/netfilter/xt_CONNSECMARK.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_CT.h' -> 'dir/include/linux/netfilter/xt_CT.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_DSCP.h' -> 'dir/include/linux/netfilter/xt_DSCP.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_HMARK.h' -> 'dir/include/linux/netfilter/xt_HMARK.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_IDLETIMER.h' -> 'dir/include/linux/netfilter/xt_IDLETIMER.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_LED.h' -> 'dir/include/linux/netfilter/xt_LED.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_LOG.h' -> 'dir/include/linux/netfilter/xt_LOG.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_MARK.h' -> 'dir/include/linux/netfilter/xt_MARK.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_NFLOG.h' -> 'dir/include/linux/netfilter/xt_NFLOG.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_NFQUEUE.h' -> 'dir/include/linux/netfilter/xt_NFQUEUE.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_RATEEST.h' -> 'dir/include/linux/netfilter/xt_RATEEST.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_SECMARK.h' -> 'dir/include/linux/netfilter/xt_SECMARK.h' 2024-05-16T21:33:07.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_SYNPROXY.h' -> 'dir/include/linux/netfilter/xt_SYNPROXY.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_TCPMSS.h' -> 'dir/include/linux/netfilter/xt_TCPMSS.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_TCPOPTSTRIP.h' -> 'dir/include/linux/netfilter/xt_TCPOPTSTRIP.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_TEE.h' -> 'dir/include/linux/netfilter/xt_TEE.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_TPROXY.h' -> 'dir/include/linux/netfilter/xt_TPROXY.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_addrtype.h' -> 'dir/include/linux/netfilter/xt_addrtype.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_bpf.h' -> 'dir/include/linux/netfilter/xt_bpf.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_cgroup.h' -> 'dir/include/linux/netfilter/xt_cgroup.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_cluster.h' -> 'dir/include/linux/netfilter/xt_cluster.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_comment.h' -> 'dir/include/linux/netfilter/xt_comment.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_connbytes.h' -> 'dir/include/linux/netfilter/xt_connbytes.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_connlabel.h' -> 'dir/include/linux/netfilter/xt_connlabel.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_connlimit.h' -> 'dir/include/linux/netfilter/xt_connlimit.h' 2024-05-16T21:33:07.546 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_connmark.h' -> 'dir/include/linux/netfilter/xt_connmark.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_conntrack.h' -> 'dir/include/linux/netfilter/xt_conntrack.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_cpu.h' -> 'dir/include/linux/netfilter/xt_cpu.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_dccp.h' -> 'dir/include/linux/netfilter/xt_dccp.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_devgroup.h' -> 'dir/include/linux/netfilter/xt_devgroup.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_dscp.h' -> 'dir/include/linux/netfilter/xt_dscp.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_ecn.h' -> 'dir/include/linux/netfilter/xt_ecn.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_esp.h' -> 'dir/include/linux/netfilter/xt_esp.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_hashlimit.h' -> 'dir/include/linux/netfilter/xt_hashlimit.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_helper.h' -> 'dir/include/linux/netfilter/xt_helper.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_ipcomp.h' -> 'dir/include/linux/netfilter/xt_ipcomp.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_iprange.h' -> 'dir/include/linux/netfilter/xt_iprange.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_ipvs.h' -> 'dir/include/linux/netfilter/xt_ipvs.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_l2tp.h' -> 'dir/include/linux/netfilter/xt_l2tp.h' 2024-05-16T21:33:07.547 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_length.h' -> 'dir/include/linux/netfilter/xt_length.h' 2024-05-16T21:33:07.548 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_limit.h' -> 'dir/include/linux/netfilter/xt_limit.h' 2024-05-16T21:33:07.548 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_mac.h' -> 'dir/include/linux/netfilter/xt_mac.h' 2024-05-16T21:33:07.548 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_mark.h' -> 'dir/include/linux/netfilter/xt_mark.h' 2024-05-16T21:33:07.641 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_multiport.h' -> 'dir/include/linux/netfilter/xt_multiport.h' 2024-05-16T21:33:07.641 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_nfacct.h' -> 'dir/include/linux/netfilter/xt_nfacct.h' 2024-05-16T21:33:07.641 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_osf.h' -> 'dir/include/linux/netfilter/xt_osf.h' 2024-05-16T21:33:07.641 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_owner.h' -> 'dir/include/linux/netfilter/xt_owner.h' 2024-05-16T21:33:07.641 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_physdev.h' -> 'dir/include/linux/netfilter/xt_physdev.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_pkttype.h' -> 'dir/include/linux/netfilter/xt_pkttype.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_policy.h' -> 'dir/include/linux/netfilter/xt_policy.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_quota.h' -> 'dir/include/linux/netfilter/xt_quota.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_rateest.h' -> 'dir/include/linux/netfilter/xt_rateest.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_realm.h' -> 'dir/include/linux/netfilter/xt_realm.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_recent.h' -> 'dir/include/linux/netfilter/xt_recent.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_rpfilter.h' -> 'dir/include/linux/netfilter/xt_rpfilter.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_sctp.h' -> 'dir/include/linux/netfilter/xt_sctp.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_set.h' -> 'dir/include/linux/netfilter/xt_set.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_socket.h' -> 'dir/include/linux/netfilter/xt_socket.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_state.h' -> 'dir/include/linux/netfilter/xt_state.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_statistic.h' -> 'dir/include/linux/netfilter/xt_statistic.h' 2024-05-16T21:33:07.642 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_string.h' -> 'dir/include/linux/netfilter/xt_string.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_tcpmss.h' -> 'dir/include/linux/netfilter/xt_tcpmss.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_tcpudp.h' -> 'dir/include/linux/netfilter/xt_tcpudp.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_time.h' -> 'dir/include/linux/netfilter/xt_time.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter/xt_u32.h' -> 'dir/include/linux/netfilter/xt_u32.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_arp.h' -> 'dir/include/linux/netfilter_arp.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_arp' -> 'dir/include/linux/netfilter_arp' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_arp/arp_tables.h' -> 'dir/include/linux/netfilter_arp/arp_tables.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_arp/arpt_mangle.h' -> 'dir/include/linux/netfilter_arp/arpt_mangle.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge.h' -> 'dir/include/linux/netfilter_bridge.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge' -> 'dir/include/linux/netfilter_bridge' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_802_3.h' -> 'dir/include/linux/netfilter_bridge/ebt_802_3.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_among.h' -> 'dir/include/linux/netfilter_bridge/ebt_among.h' 2024-05-16T21:33:07.643 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_arp.h' -> 'dir/include/linux/netfilter_bridge/ebt_arp.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_arpreply.h' -> 'dir/include/linux/netfilter_bridge/ebt_arpreply.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_ip.h' -> 'dir/include/linux/netfilter_bridge/ebt_ip.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_ip6.h' -> 'dir/include/linux/netfilter_bridge/ebt_ip6.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_limit.h' -> 'dir/include/linux/netfilter_bridge/ebt_limit.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_log.h' -> 'dir/include/linux/netfilter_bridge/ebt_log.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_mark_m.h' -> 'dir/include/linux/netfilter_bridge/ebt_mark_m.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_mark_t.h' -> 'dir/include/linux/netfilter_bridge/ebt_mark_t.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_nat.h' -> 'dir/include/linux/netfilter_bridge/ebt_nat.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_nflog.h' -> 'dir/include/linux/netfilter_bridge/ebt_nflog.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_pkttype.h' -> 'dir/include/linux/netfilter_bridge/ebt_pkttype.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_redirect.h' -> 'dir/include/linux/netfilter_bridge/ebt_redirect.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_stp.h' -> 'dir/include/linux/netfilter_bridge/ebt_stp.h' 2024-05-16T21:33:07.644 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebt_vlan.h' -> 'dir/include/linux/netfilter_bridge/ebt_vlan.h' 2024-05-16T21:33:07.780 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_bridge/ebtables.h' -> 'dir/include/linux/netfilter_bridge/ebtables.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_decnet.h' -> 'dir/include/linux/netfilter_decnet.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4.h' -> 'dir/include/linux/netfilter_ipv4.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4' -> 'dir/include/linux/netfilter_ipv4' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ip_tables.h' -> 'dir/include/linux/netfilter_ipv4/ip_tables.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ipt_CLUSTERIP.h' -> 'dir/include/linux/netfilter_ipv4/ipt_CLUSTERIP.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ipt_ECN.h' -> 'dir/include/linux/netfilter_ipv4/ipt_ECN.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ipt_LOG.h' -> 'dir/include/linux/netfilter_ipv4/ipt_LOG.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ipt_REJECT.h' -> 'dir/include/linux/netfilter_ipv4/ipt_REJECT.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ipt_TTL.h' -> 'dir/include/linux/netfilter_ipv4/ipt_TTL.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ipt_ah.h' -> 'dir/include/linux/netfilter_ipv4/ipt_ah.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ipt_ecn.h' -> 'dir/include/linux/netfilter_ipv4/ipt_ecn.h' 2024-05-16T21:33:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv4/ipt_ttl.h' -> 'dir/include/linux/netfilter_ipv4/ipt_ttl.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6.h' -> 'dir/include/linux/netfilter_ipv6.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netlink.h' -> 'dir/include/linux/netlink.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netlink_diag.h' -> 'dir/include/linux/netlink_diag.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netrom.h' -> 'dir/include/linux/netrom.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nexthop.h' -> 'dir/include/linux/nexthop.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfc.h' -> 'dir/include/linux/nfc.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfs.h' -> 'dir/include/linux/nfs.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfs2.h' -> 'dir/include/linux/nfs2.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfs3.h' -> 'dir/include/linux/nfs3.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfs4.h' -> 'dir/include/linux/nfs4.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfs4_mount.h' -> 'dir/include/linux/nfs4_mount.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfs_fs.h' -> 'dir/include/linux/nfs_fs.h' 2024-05-16T21:33:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfs_idmap.h' -> 'dir/include/linux/nfs_idmap.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfs_mount.h' -> 'dir/include/linux/nfs_mount.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfsacl.h' -> 'dir/include/linux/nfsacl.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nilfs2_api.h' -> 'dir/include/linux/nilfs2_api.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nilfs2_ondisk.h' -> 'dir/include/linux/nilfs2_ondisk.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nitro_enclaves.h' -> 'dir/include/linux/nitro_enclaves.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nl80211.h' -> 'dir/include/linux/nl80211.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nsfs.h' -> 'dir/include/linux/nsfs.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nubus.h' -> 'dir/include/linux/nubus.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nvme_ioctl.h' -> 'dir/include/linux/nvme_ioctl.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nvram.h' -> 'dir/include/linux/nvram.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/omap3isp.h' -> 'dir/include/linux/omap3isp.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/omapfb.h' -> 'dir/include/linux/omapfb.h' 2024-05-16T21:33:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/oom.h' -> 'dir/include/linux/oom.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/openat2.h' -> 'dir/include/linux/openat2.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/openvswitch.h' -> 'dir/include/linux/openvswitch.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/packet_diag.h' -> 'dir/include/linux/packet_diag.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/param.h' -> 'dir/include/linux/param.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/parport.h' -> 'dir/include/linux/parport.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/patchkey.h' -> 'dir/include/linux/patchkey.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pci.h' -> 'dir/include/linux/pci.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pci_regs.h' -> 'dir/include/linux/pci_regs.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pcitest.h' -> 'dir/include/linux/pcitest.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/perf_event.h' -> 'dir/include/linux/perf_event.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/personality.h' -> 'dir/include/linux/personality.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pfkeyv2.h' -> 'dir/include/linux/pfkeyv2.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pfrut.h' -> 'dir/include/linux/pfrut.h' 2024-05-16T21:33:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pg.h' -> 'dir/include/linux/pg.h' 2024-05-16T21:33:07.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/phantom.h' -> 'dir/include/linux/phantom.h' 2024-05-16T21:33:07.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/phonet.h' -> 'dir/include/linux/phonet.h' 2024-05-16T21:33:07.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pidfd.h' -> 'dir/include/linux/pidfd.h' 2024-05-16T21:33:07.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pkt_cls.h' -> 'dir/include/linux/pkt_cls.h' 2024-05-16T21:33:07.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pkt_sched.h' -> 'dir/include/linux/pkt_sched.h' 2024-05-16T21:33:07.929 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pktcdvd.h' -> 'dir/include/linux/pktcdvd.h' 2024-05-16T21:33:07.929 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pmu.h' -> 'dir/include/linux/pmu.h' 2024-05-16T21:33:07.929 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/poll.h' -> 'dir/include/linux/poll.h' 2024-05-16T21:33:07.929 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/posix_acl.h' -> 'dir/include/linux/posix_acl.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/posix_acl_xattr.h' -> 'dir/include/linux/posix_acl_xattr.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/posix_types.h' -> 'dir/include/linux/posix_types.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ppdev.h' -> 'dir/include/linux/ppdev.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ppp-comp.h' -> 'dir/include/linux/ppp-comp.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ppp-ioctl.h' -> 'dir/include/linux/ppp-ioctl.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ppp_defs.h' -> 'dir/include/linux/ppp_defs.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pps.h' -> 'dir/include/linux/pps.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/pr.h' -> 'dir/include/linux/pr.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/prctl.h' -> 'dir/include/linux/prctl.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/psample.h' -> 'dir/include/linux/psample.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/psci.h' -> 'dir/include/linux/psci.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/psp-dbc.h' -> 'dir/include/linux/psp-dbc.h' 2024-05-16T21:33:07.930 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ptp_clock.h' -> 'dir/include/linux/ptp_clock.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ptrace.h' -> 'dir/include/linux/ptrace.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/qemu_fw_cfg.h' -> 'dir/include/linux/qemu_fw_cfg.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/qnx4_fs.h' -> 'dir/include/linux/qnx4_fs.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/qnxtypes.h' -> 'dir/include/linux/qnxtypes.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/qrtr.h' -> 'dir/include/linux/qrtr.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/quota.h' -> 'dir/include/linux/quota.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/radeonfb.h' -> 'dir/include/linux/radeonfb.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/random.h' -> 'dir/include/linux/random.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rds.h' -> 'dir/include/linux/rds.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/reboot.h' -> 'dir/include/linux/reboot.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/reiserfs_fs.h' -> 'dir/include/linux/reiserfs_fs.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/reiserfs_xattr.h' -> 'dir/include/linux/reiserfs_xattr.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/remoteproc_cdev.h' -> 'dir/include/linux/remoteproc_cdev.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/resource.h' -> 'dir/include/linux/resource.h' 2024-05-16T21:33:07.931 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rfkill.h' -> 'dir/include/linux/rfkill.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rio_cm_cdev.h' -> 'dir/include/linux/rio_cm_cdev.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rio_mport_cdev.h' -> 'dir/include/linux/rio_mport_cdev.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rkisp1-config.h' -> 'dir/include/linux/rkisp1-config.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/romfs_fs.h' -> 'dir/include/linux/romfs_fs.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rose.h' -> 'dir/include/linux/rose.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/route.h' -> 'dir/include/linux/route.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rpl.h' -> 'dir/include/linux/rpl.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rpl_iptunnel.h' -> 'dir/include/linux/rpl_iptunnel.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rpmsg.h' -> 'dir/include/linux/rpmsg.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rpmsg_types.h' -> 'dir/include/linux/rpmsg_types.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rseq.h' -> 'dir/include/linux/rseq.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rtc.h' -> 'dir/include/linux/rtc.h' 2024-05-16T21:33:07.932 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rtnetlink.h' -> 'dir/include/linux/rtnetlink.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/rxrpc.h' -> 'dir/include/linux/rxrpc.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/scc.h' -> 'dir/include/linux/scc.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sched.h' -> 'dir/include/linux/sched.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/scif_ioctl.h' -> 'dir/include/linux/scif_ioctl.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/screen_info.h' -> 'dir/include/linux/screen_info.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sctp.h' -> 'dir/include/linux/sctp.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/seccomp.h' -> 'dir/include/linux/seccomp.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/securebits.h' -> 'dir/include/linux/securebits.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sed-opal.h' -> 'dir/include/linux/sed-opal.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/seg6.h' -> 'dir/include/linux/seg6.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/seg6_genl.h' -> 'dir/include/linux/seg6_genl.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/seg6_hmac.h' -> 'dir/include/linux/seg6_hmac.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/seg6_iptunnel.h' -> 'dir/include/linux/seg6_iptunnel.h' 2024-05-16T21:33:07.933 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/seg6_local.h' -> 'dir/include/linux/seg6_local.h' 2024-05-16T21:33:07.934 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/selinux_netlink.h' -> 'dir/include/linux/selinux_netlink.h' 2024-05-16T21:33:07.934 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sem.h' -> 'dir/include/linux/sem.h' 2024-05-16T21:33:07.934 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/serial.h' -> 'dir/include/linux/serial.h' 2024-05-16T21:33:07.934 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/serial_core.h' -> 'dir/include/linux/serial_core.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/serial_reg.h' -> 'dir/include/linux/serial_reg.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/serio.h' -> 'dir/include/linux/serio.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sev-guest.h' -> 'dir/include/linux/sev-guest.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/shm.h' -> 'dir/include/linux/shm.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/signal.h' -> 'dir/include/linux/signal.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/signalfd.h' -> 'dir/include/linux/signalfd.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/smc.h' -> 'dir/include/linux/smc.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/smc_diag.h' -> 'dir/include/linux/smc_diag.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/smiapp.h' -> 'dir/include/linux/smiapp.h' 2024-05-16T21:33:08.058 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/snmp.h' -> 'dir/include/linux/snmp.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sock_diag.h' -> 'dir/include/linux/sock_diag.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/socket.h' -> 'dir/include/linux/socket.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sockios.h' -> 'dir/include/linux/sockios.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sonet.h' -> 'dir/include/linux/sonet.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sonypi.h' -> 'dir/include/linux/sonypi.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sound.h' -> 'dir/include/linux/sound.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/soundcard.h' -> 'dir/include/linux/soundcard.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/stat.h' -> 'dir/include/linux/stat.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/stddef.h' -> 'dir/include/linux/stddef.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/stm.h' -> 'dir/include/linux/stm.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/string.h' -> 'dir/include/linux/string.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/suspend_ioctls.h' -> 'dir/include/linux/suspend_ioctls.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/swab.h' -> 'dir/include/linux/swab.h' 2024-05-16T21:33:08.059 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/switchtec_ioctl.h' -> 'dir/include/linux/switchtec_ioctl.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sync_file.h' -> 'dir/include/linux/sync_file.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/synclink.h' -> 'dir/include/linux/synclink.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sysctl.h' -> 'dir/include/linux/sysctl.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sysinfo.h' -> 'dir/include/linux/sysinfo.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/target_core_user.h' -> 'dir/include/linux/target_core_user.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/taskstats.h' -> 'dir/include/linux/taskstats.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tcp.h' -> 'dir/include/linux/tcp.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tcp_metrics.h' -> 'dir/include/linux/tcp_metrics.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tdx-guest.h' -> 'dir/include/linux/tdx-guest.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/termios.h' -> 'dir/include/linux/termios.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/thermal.h' -> 'dir/include/linux/thermal.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/time.h' -> 'dir/include/linux/time.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/time_types.h' -> 'dir/include/linux/time_types.h' 2024-05-16T21:33:08.060 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/timerfd.h' -> 'dir/include/linux/timerfd.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/times.h' -> 'dir/include/linux/times.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/timex.h' -> 'dir/include/linux/timex.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tiocl.h' -> 'dir/include/linux/tiocl.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tipc.h' -> 'dir/include/linux/tipc.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tipc_config.h' -> 'dir/include/linux/tipc_config.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tipc_netlink.h' -> 'dir/include/linux/tipc_netlink.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tipc_sockets_diag.h' -> 'dir/include/linux/tipc_sockets_diag.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tls.h' -> 'dir/include/linux/tls.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/toshiba.h' -> 'dir/include/linux/toshiba.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tty.h' -> 'dir/include/linux/tty.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tty_flags.h' -> 'dir/include/linux/tty_flags.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/types.h' -> 'dir/include/linux/types.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/udf_fs_i.h' -> 'dir/include/linux/udf_fs_i.h' 2024-05-16T21:33:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/udmabuf.h' -> 'dir/include/linux/udmabuf.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/udp.h' -> 'dir/include/linux/udp.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/uhid.h' -> 'dir/include/linux/uhid.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/uinput.h' -> 'dir/include/linux/uinput.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/uio.h' -> 'dir/include/linux/uio.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/uleds.h' -> 'dir/include/linux/uleds.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ultrasound.h' -> 'dir/include/linux/ultrasound.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/um_timetravel.h' -> 'dir/include/linux/um_timetravel.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/un.h' -> 'dir/include/linux/un.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/unistd.h' -> 'dir/include/linux/unistd.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/unix_diag.h' -> 'dir/include/linux/unix_diag.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usbdevice_fs.h' -> 'dir/include/linux/usbdevice_fs.h' 2024-05-16T21:33:08.062 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usbip.h' -> 'dir/include/linux/usbip.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/userfaultfd.h' -> 'dir/include/linux/userfaultfd.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/userio.h' -> 'dir/include/linux/userio.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/utime.h' -> 'dir/include/linux/utime.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/utsname.h' -> 'dir/include/linux/utsname.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/uuid.h' -> 'dir/include/linux/uuid.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/uvcvideo.h' -> 'dir/include/linux/uvcvideo.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/v4l2-common.h' -> 'dir/include/linux/v4l2-common.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/v4l2-controls.h' -> 'dir/include/linux/v4l2-controls.h' 2024-05-16T21:33:08.202 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/v4l2-dv-timings.h' -> 'dir/include/linux/v4l2-dv-timings.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/v4l2-mediabus.h' -> 'dir/include/linux/v4l2-mediabus.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/v4l2-subdev.h' -> 'dir/include/linux/v4l2-subdev.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vbox_err.h' -> 'dir/include/linux/vbox_err.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vbox_vmmdev_types.h' -> 'dir/include/linux/vbox_vmmdev_types.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vboxguest.h' -> 'dir/include/linux/vboxguest.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vdpa.h' -> 'dir/include/linux/vdpa.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/version.h' -> 'dir/include/linux/version.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/veth.h' -> 'dir/include/linux/veth.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vfio.h' -> 'dir/include/linux/vfio.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vfio_ccw.h' -> 'dir/include/linux/vfio_ccw.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vfio_zdev.h' -> 'dir/include/linux/vfio_zdev.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vhost.h' -> 'dir/include/linux/vhost.h' 2024-05-16T21:33:08.203 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vhost_types.h' -> 'dir/include/linux/vhost_types.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/videodev2.h' -> 'dir/include/linux/videodev2.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_9p.h' -> 'dir/include/linux/virtio_9p.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_balloon.h' -> 'dir/include/linux/virtio_balloon.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_blk.h' -> 'dir/include/linux/virtio_blk.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_bt.h' -> 'dir/include/linux/virtio_bt.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_config.h' -> 'dir/include/linux/virtio_config.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_console.h' -> 'dir/include/linux/virtio_console.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_crypto.h' -> 'dir/include/linux/virtio_crypto.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_fs.h' -> 'dir/include/linux/virtio_fs.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_gpio.h' -> 'dir/include/linux/virtio_gpio.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_gpu.h' -> 'dir/include/linux/virtio_gpu.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_i2c.h' -> 'dir/include/linux/virtio_i2c.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_ids.h' -> 'dir/include/linux/virtio_ids.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_input.h' -> 'dir/include/linux/virtio_input.h' 2024-05-16T21:33:08.204 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_iommu.h' -> 'dir/include/linux/virtio_iommu.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_mem.h' -> 'dir/include/linux/virtio_mem.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_mmio.h' -> 'dir/include/linux/virtio_mmio.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_net.h' -> 'dir/include/linux/virtio_net.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_pci.h' -> 'dir/include/linux/virtio_pci.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_pcidev.h' -> 'dir/include/linux/virtio_pcidev.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_pmem.h' -> 'dir/include/linux/virtio_pmem.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_ring.h' -> 'dir/include/linux/virtio_ring.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_rng.h' -> 'dir/include/linux/virtio_rng.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_scmi.h' -> 'dir/include/linux/virtio_scmi.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_scsi.h' -> 'dir/include/linux/virtio_scsi.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_snd.h' -> 'dir/include/linux/virtio_snd.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_types.h' -> 'dir/include/linux/virtio_types.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/virtio_vsock.h' -> 'dir/include/linux/virtio_vsock.h' 2024-05-16T21:33:08.205 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vm_sockets.h' -> 'dir/include/linux/vm_sockets.h' 2024-05-16T21:33:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vm_sockets_diag.h' -> 'dir/include/linux/vm_sockets_diag.h' 2024-05-16T21:33:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vmcore.h' -> 'dir/include/linux/vmcore.h' 2024-05-16T21:33:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vsockmon.h' -> 'dir/include/linux/vsockmon.h' 2024-05-16T21:33:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vt.h' -> 'dir/include/linux/vt.h' 2024-05-16T21:33:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/vtpm_proxy.h' -> 'dir/include/linux/vtpm_proxy.h' 2024-05-16T21:33:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/wait.h' -> 'dir/include/linux/wait.h' 2024-05-16T21:33:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/watch_queue.h' -> 'dir/include/linux/watch_queue.h' 2024-05-16T21:33:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/watchdog.h' -> 'dir/include/linux/watchdog.h' 2024-05-16T21:33:08.362 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/wireguard.h' -> 'dir/include/linux/wireguard.h' 2024-05-16T21:33:08.362 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/wireless.h' -> 'dir/include/linux/wireless.h' 2024-05-16T21:33:08.362 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/wmi.h' -> 'dir/include/linux/wmi.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/wwan.h' -> 'dir/include/linux/wwan.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/x25.h' -> 'dir/include/linux/x25.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/xattr.h' -> 'dir/include/linux/xattr.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/xdp_diag.h' -> 'dir/include/linux/xdp_diag.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/xfrm.h' -> 'dir/include/linux/xfrm.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/xilinx-v4l2-controls.h' -> 'dir/include/linux/xilinx-v4l2-controls.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/zorro.h' -> 'dir/include/linux/zorro.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/zorro_ids.h' -> 'dir/include/linux/zorro_ids.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/dqblk_xfs.h' -> 'dir/include/linux/dqblk_xfs.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/hash_info.h' -> 'dir/include/linux/hash_info.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ioprio.h' -> 'dir/include/linux/ioprio.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/ipsec.h' -> 'dir/include/linux/ipsec.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/mqueue.h' -> 'dir/include/linux/mqueue.h' 2024-05-16T21:33:08.363 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netdevice.h' -> 'dir/include/linux/netdevice.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/psp-sev.h' -> 'dir/include/linux/psp-sev.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tee.h' -> 'dir/include/linux/tee.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6' -> 'dir/include/linux/netfilter_ipv6' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_HL.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_HL.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_LOG.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_LOG.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_NPT.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_NPT.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_REJECT.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_REJECT.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_ah.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_ah.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_frag.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_frag.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_hl.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_hl.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_ipv6header.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_ipv6header.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_mh.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_mh.h' 2024-05-16T21:33:08.364 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_opts.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_opts.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_rt.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_rt.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_srh.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_srh.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/netfilter_ipv6/ip6_tables.h' -> 'dir/include/linux/netfilter_ipv6/ip6_tables.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfsd' -> 'dir/include/linux/nfsd' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfsd/cld.h' -> 'dir/include/linux/nfsd/cld.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfsd/debug.h' -> 'dir/include/linux/nfsd/debug.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfsd/export.h' -> 'dir/include/linux/nfsd/export.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/nfsd/stats.h' -> 'dir/include/linux/nfsd/stats.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/raid' -> 'dir/include/linux/raid' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/raid/md_p.h' -> 'dir/include/linux/raid/md_p.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/raid/md_u.h' -> 'dir/include/linux/raid/md_u.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sched' -> 'dir/include/linux/sched' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sched/types.h' -> 'dir/include/linux/sched/types.h' 2024-05-16T21:33:08.365 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/spi' -> 'dir/include/linux/spi' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/spi/spi.h' -> 'dir/include/linux/spi/spi.h' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/spi/spidev.h' -> 'dir/include/linux/spi/spidev.h' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sunrpc' -> 'dir/include/linux/sunrpc' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/sunrpc/debug.h' -> 'dir/include/linux/sunrpc/debug.h' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/surface_aggregator' -> 'dir/include/linux/surface_aggregator' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/surface_aggregator/cdev.h' -> 'dir/include/linux/surface_aggregator/cdev.h' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/surface_aggregator/dtx.h' -> 'dir/include/linux/surface_aggregator/dtx.h' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act' -> 'dir/include/linux/tc_act' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_bpf.h' -> 'dir/include/linux/tc_act/tc_bpf.h' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_connmark.h' -> 'dir/include/linux/tc_act/tc_connmark.h' 2024-05-16T21:33:08.366 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_csum.h' -> 'dir/include/linux/tc_act/tc_csum.h' 2024-05-16T21:33:08.571 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_ct.h' -> 'dir/include/linux/tc_act/tc_ct.h' 2024-05-16T21:33:08.571 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_ctinfo.h' -> 'dir/include/linux/tc_act/tc_ctinfo.h' 2024-05-16T21:33:08.571 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_defact.h' -> 'dir/include/linux/tc_act/tc_defact.h' 2024-05-16T21:33:08.571 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_gact.h' -> 'dir/include/linux/tc_act/tc_gact.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_gate.h' -> 'dir/include/linux/tc_act/tc_gate.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_ife.h' -> 'dir/include/linux/tc_act/tc_ife.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_ipt.h' -> 'dir/include/linux/tc_act/tc_ipt.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_mirred.h' -> 'dir/include/linux/tc_act/tc_mirred.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_mpls.h' -> 'dir/include/linux/tc_act/tc_mpls.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_nat.h' -> 'dir/include/linux/tc_act/tc_nat.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_pedit.h' -> 'dir/include/linux/tc_act/tc_pedit.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_sample.h' -> 'dir/include/linux/tc_act/tc_sample.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_skbedit.h' -> 'dir/include/linux/tc_act/tc_skbedit.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_skbmod.h' -> 'dir/include/linux/tc_act/tc_skbmod.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_tunnel_key.h' -> 'dir/include/linux/tc_act/tc_tunnel_key.h' 2024-05-16T21:33:08.572 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_act/tc_vlan.h' -> 'dir/include/linux/tc_act/tc_vlan.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_ematch' -> 'dir/include/linux/tc_ematch' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_ematch/tc_em_cmp.h' -> 'dir/include/linux/tc_ematch/tc_em_cmp.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_ematch/tc_em_ipt.h' -> 'dir/include/linux/tc_ematch/tc_em_ipt.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_ematch/tc_em_meta.h' -> 'dir/include/linux/tc_ematch/tc_em_meta.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_ematch/tc_em_nbyte.h' -> 'dir/include/linux/tc_ematch/tc_em_nbyte.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/tc_ematch/tc_em_text.h' -> 'dir/include/linux/tc_ematch/tc_em_text.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb' -> 'dir/include/linux/usb' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/audio.h' -> 'dir/include/linux/usb/audio.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/cdc-wdm.h' -> 'dir/include/linux/usb/cdc-wdm.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/cdc.h' -> 'dir/include/linux/usb/cdc.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/ch11.h' -> 'dir/include/linux/usb/ch11.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/ch9.h' -> 'dir/include/linux/usb/ch9.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/charger.h' -> 'dir/include/linux/usb/charger.h' 2024-05-16T21:33:08.573 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/functionfs.h' -> 'dir/include/linux/usb/functionfs.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/g_printer.h' -> 'dir/include/linux/usb/g_printer.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/g_uvc.h' -> 'dir/include/linux/usb/g_uvc.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/gadgetfs.h' -> 'dir/include/linux/usb/gadgetfs.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/midi.h' -> 'dir/include/linux/usb/midi.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/raw_gadget.h' -> 'dir/include/linux/usb/raw_gadget.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/tmc.h' -> 'dir/include/linux/usb/tmc.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/linux/usb/video.h' -> 'dir/include/linux/usb/video.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/powercap.h' -> 'dir/include/powercap.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gnumake.h' -> 'dir/include/gnumake.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/a.out.h' -> 'dir/include/a.out.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/aio.h' -> 'dir/include/aio.h' 2024-05-16T21:33:08.574 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/aliases.h' -> 'dir/include/aliases.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/alloca.h' -> 'dir/include/alloca.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ar.h' -> 'dir/include/ar.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/argp.h' -> 'dir/include/argp.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/argz.h' -> 'dir/include/argz.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/assert.h' -> 'dir/include/assert.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/byteswap.h' -> 'dir/include/byteswap.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/complex.h' -> 'dir/include/complex.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cpio.h' -> 'dir/include/cpio.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ctype.h' -> 'dir/include/ctype.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/dirent.h' -> 'dir/include/dirent.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/dlfcn.h' -> 'dir/include/dlfcn.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/elf.h' -> 'dir/include/elf.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/endian.h' -> 'dir/include/endian.h' 2024-05-16T21:33:08.575 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/envz.h' -> 'dir/include/envz.h' 2024-05-16T21:33:08.576 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/err.h' -> 'dir/include/err.h' 2024-05-16T21:33:08.576 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/errno.h' -> 'dir/include/errno.h' 2024-05-16T21:33:08.576 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/error.h' -> 'dir/include/error.h' 2024-05-16T21:33:08.576 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/execinfo.h' -> 'dir/include/execinfo.h' 2024-05-16T21:33:08.576 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/fcntl.h' -> 'dir/include/fcntl.h' 2024-05-16T21:33:08.576 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/features-time64.h' -> 'dir/include/features-time64.h' 2024-05-16T21:33:08.576 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/features.h' -> 'dir/include/features.h' 2024-05-16T21:33:09.020 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/fenv.h' -> 'dir/include/fenv.h' 2024-05-16T21:33:09.020 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/fmtmsg.h' -> 'dir/include/fmtmsg.h' 2024-05-16T21:33:09.020 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/fnmatch.h' -> 'dir/include/fnmatch.h' 2024-05-16T21:33:09.020 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/fpu_control.h' -> 'dir/include/fpu_control.h' 2024-05-16T21:33:09.020 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/fstab.h' -> 'dir/include/fstab.h' 2024-05-16T21:33:09.020 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/fts.h' -> 'dir/include/fts.h' 2024-05-16T21:33:09.020 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ftw.h' -> 'dir/include/ftw.h' 2024-05-16T21:33:09.020 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gconv.h' -> 'dir/include/gconv.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/getopt.h' -> 'dir/include/getopt.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/glob.h' -> 'dir/include/glob.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gnu-versions.h' -> 'dir/include/gnu-versions.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/grp.h' -> 'dir/include/grp.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gshadow.h' -> 'dir/include/gshadow.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/iconv.h' -> 'dir/include/iconv.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ieee754.h' -> 'dir/include/ieee754.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ifaddrs.h' -> 'dir/include/ifaddrs.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/inttypes.h' -> 'dir/include/inttypes.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/langinfo.h' -> 'dir/include/langinfo.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/lastlog.h' -> 'dir/include/lastlog.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/libgen.h' -> 'dir/include/libgen.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/libintl.h' -> 'dir/include/libintl.h' 2024-05-16T21:33:09.021 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/limits.h' -> 'dir/include/limits.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/link.h' -> 'dir/include/link.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/locale.h' -> 'dir/include/locale.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/malloc.h' -> 'dir/include/malloc.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/math.h' -> 'dir/include/math.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mcheck.h' -> 'dir/include/mcheck.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/memory.h' -> 'dir/include/memory.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mntent.h' -> 'dir/include/mntent.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/monetary.h' -> 'dir/include/monetary.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mqueue.h' -> 'dir/include/mqueue.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netdb.h' -> 'dir/include/netdb.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/nl_types.h' -> 'dir/include/nl_types.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/nss.h' -> 'dir/include/nss.h' 2024-05-16T21:33:09.022 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/obstack.h' -> 'dir/include/obstack.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/paths.h' -> 'dir/include/paths.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/poll.h' -> 'dir/include/poll.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/printf.h' -> 'dir/include/printf.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/proc_service.h' -> 'dir/include/proc_service.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/pthread.h' -> 'dir/include/pthread.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/pty.h' -> 'dir/include/pty.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/pwd.h' -> 'dir/include/pwd.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/re_comp.h' -> 'dir/include/re_comp.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/regex.h' -> 'dir/include/regex.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/regexp.h' -> 'dir/include/regexp.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/resolv.h' -> 'dir/include/resolv.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sched.h' -> 'dir/include/sched.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/search.h' -> 'dir/include/search.h' 2024-05-16T21:33:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/semaphore.h' -> 'dir/include/semaphore.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/setjmp.h' -> 'dir/include/setjmp.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sgtty.h' -> 'dir/include/sgtty.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/shadow.h' -> 'dir/include/shadow.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/signal.h' -> 'dir/include/signal.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/spawn.h' -> 'dir/include/spawn.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/stab.h' -> 'dir/include/stab.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/stdc-predef.h' -> 'dir/include/stdc-predef.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/stdint.h' -> 'dir/include/stdint.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/stdio.h' -> 'dir/include/stdio.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/stdio_ext.h' -> 'dir/include/stdio_ext.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/stdlib.h' -> 'dir/include/stdlib.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/string.h' -> 'dir/include/string.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/strings.h' -> 'dir/include/strings.h' 2024-05-16T21:33:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/syscall.h' -> 'dir/include/syscall.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sysexits.h' -> 'dir/include/sysexits.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/syslog.h' -> 'dir/include/syslog.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/tar.h' -> 'dir/include/tar.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/termio.h' -> 'dir/include/termio.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/termios.h' -> 'dir/include/termios.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/tgmath.h' -> 'dir/include/tgmath.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/thread_db.h' -> 'dir/include/thread_db.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/threads.h' -> 'dir/include/threads.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/time.h' -> 'dir/include/time.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ttyent.h' -> 'dir/include/ttyent.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/uchar.h' -> 'dir/include/uchar.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ucontext.h' -> 'dir/include/ucontext.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ulimit.h' -> 'dir/include/ulimit.h' 2024-05-16T21:33:09.025 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/unistd.h' -> 'dir/include/unistd.h' 2024-05-16T21:33:09.026 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/utime.h' -> 'dir/include/utime.h' 2024-05-16T21:33:09.026 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/utmp.h' -> 'dir/include/utmp.h' 2024-05-16T21:33:09.026 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/utmpx.h' -> 'dir/include/utmpx.h' 2024-05-16T21:33:09.026 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/values.h' -> 'dir/include/values.h' 2024-05-16T21:33:09.026 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/wait.h' -> 'dir/include/wait.h' 2024-05-16T21:33:09.251 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/wchar.h' -> 'dir/include/wchar.h' 2024-05-16T21:33:09.251 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/wctype.h' -> 'dir/include/wctype.h' 2024-05-16T21:33:09.251 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/wordexp.h' -> 'dir/include/wordexp.h' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/crypt.h' -> 'dir/include/crypt.h' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/pcp' -> 'dir/include/pcp' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/pcp/builddefs' -> 'dir/include/pcp/builddefs' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/pcp/buildrules' -> 'dir/include/pcp/buildrules' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/attr' -> 'dir/include/attr' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/attr/attributes.h' -> 'dir/include/attr/attributes.h' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/attr/error_context.h' -> 'dir/include/attr/error_context.h' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/attr/libattr.h' -> 'dir/include/attr/libattr.h' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/attr/xattr.h' -> 'dir/include/attr/xattr.h' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gdb' -> 'dir/include/gdb' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gdb/jit-reader.h' -> 'dir/include/gdb/jit-reader.h' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/acl' -> 'dir/include/acl' 2024-05-16T21:33:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/acl/libacl.h' -> 'dir/include/acl/libacl.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/curses.h' -> 'dir/include/curses.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cursesapp.h' -> 'dir/include/cursesapp.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cursesf.h' -> 'dir/include/cursesf.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cursesm.h' -> 'dir/include/cursesm.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cursesp.h' -> 'dir/include/cursesp.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cursesw.h' -> 'dir/include/cursesw.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cursslk.h' -> 'dir/include/cursslk.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/eti.h' -> 'dir/include/eti.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/etip.h' -> 'dir/include/etip.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/form.h' -> 'dir/include/form.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/menu.h' -> 'dir/include/menu.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/nc_tparm.h' -> 'dir/include/nc_tparm.h' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses' -> 'dir/include/ncurses' 2024-05-16T21:33:09.253 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/curses.h' -> 'dir/include/ncurses/curses.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/cursesapp.h' -> 'dir/include/ncurses/cursesapp.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/cursesf.h' -> 'dir/include/ncurses/cursesf.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/cursesm.h' -> 'dir/include/ncurses/cursesm.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/cursesp.h' -> 'dir/include/ncurses/cursesp.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/cursesw.h' -> 'dir/include/ncurses/cursesw.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/cursslk.h' -> 'dir/include/ncurses/cursslk.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/eti.h' -> 'dir/include/ncurses/eti.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/etip.h' -> 'dir/include/ncurses/etip.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/form.h' -> 'dir/include/ncurses/form.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/menu.h' -> 'dir/include/ncurses/menu.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/nc_tparm.h' -> 'dir/include/ncurses/nc_tparm.h' 2024-05-16T21:33:09.254 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/ncurses.h' -> 'dir/include/ncurses/ncurses.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/ncurses_dll.h' -> 'dir/include/ncurses/ncurses_dll.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/panel.h' -> 'dir/include/ncurses/panel.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/term.h' -> 'dir/include/ncurses/term.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/term_entry.h' -> 'dir/include/ncurses/term_entry.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/termcap.h' -> 'dir/include/ncurses/termcap.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/tic.h' -> 'dir/include/ncurses/tic.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses/unctrl.h' -> 'dir/include/ncurses/unctrl.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses.h' -> 'dir/include/ncurses.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncurses_dll.h' -> 'dir/include/ncurses_dll.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw' -> 'dir/include/ncursesw' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/curses.h' -> 'dir/include/ncursesw/curses.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/cursesapp.h' -> 'dir/include/ncursesw/cursesapp.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/cursesf.h' -> 'dir/include/ncursesw/cursesf.h' 2024-05-16T21:33:09.255 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/cursesm.h' -> 'dir/include/ncursesw/cursesm.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/cursesp.h' -> 'dir/include/ncursesw/cursesp.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/cursesw.h' -> 'dir/include/ncursesw/cursesw.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/cursslk.h' -> 'dir/include/ncursesw/cursslk.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/eti.h' -> 'dir/include/ncursesw/eti.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/etip.h' -> 'dir/include/ncursesw/etip.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/form.h' -> 'dir/include/ncursesw/form.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/menu.h' -> 'dir/include/ncursesw/menu.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/nc_tparm.h' -> 'dir/include/ncursesw/nc_tparm.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/ncurses.h' -> 'dir/include/ncursesw/ncurses.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/ncurses_dll.h' -> 'dir/include/ncursesw/ncurses_dll.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/panel.h' -> 'dir/include/ncursesw/panel.h' 2024-05-16T21:33:09.256 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/term.h' -> 'dir/include/ncursesw/term.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/term_entry.h' -> 'dir/include/ncursesw/term_entry.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/termcap.h' -> 'dir/include/ncursesw/termcap.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/tic.h' -> 'dir/include/ncursesw/tic.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/ncursesw/unctrl.h' -> 'dir/include/ncursesw/unctrl.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/panel.h' -> 'dir/include/panel.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/term.h' -> 'dir/include/term.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/term_entry.h' -> 'dir/include/term_entry.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/termcap.h' -> 'dir/include/termcap.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/tic.h' -> 'dir/include/tic.h' 2024-05-16T21:33:09.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/unctrl.h' -> 'dir/include/unctrl.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc' -> 'dir/include/misc' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/cxl.h' -> 'dir/include/misc/cxl.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/fastrpc.h' -> 'dir/include/misc/fastrpc.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/habanalabs.h' -> 'dir/include/misc/habanalabs.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/ocxl.h' -> 'dir/include/misc/ocxl.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/pvpanic.h' -> 'dir/include/misc/pvpanic.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/uacce' -> 'dir/include/misc/uacce' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/uacce/hisi_qm.h' -> 'dir/include/misc/uacce/hisi_qm.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/uacce/uacce.h' -> 'dir/include/misc/uacce/uacce.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/misc/xilinx_sdfec.h' -> 'dir/include/misc/xilinx_sdfec.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mtd' -> 'dir/include/mtd' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mtd/inftl-user.h' -> 'dir/include/mtd/inftl-user.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mtd/mtd-abi.h' -> 'dir/include/mtd/mtd-abi.h' 2024-05-16T21:33:09.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mtd/mtd-user.h' -> 'dir/include/mtd/mtd-user.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mtd/nftl-user.h' -> 'dir/include/mtd/nftl-user.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/mtd/ubi-user.h' -> 'dir/include/mtd/ubi-user.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma' -> 'dir/include/rdma' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/bnxt_re-abi.h' -> 'dir/include/rdma/bnxt_re-abi.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/cxgb4-abi.h' -> 'dir/include/rdma/cxgb4-abi.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/efa-abi.h' -> 'dir/include/rdma/efa-abi.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/hfi' -> 'dir/include/rdma/hfi' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/hfi/hfi1_ioctl.h' -> 'dir/include/rdma/hfi/hfi1_ioctl.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/hfi/hfi1_user.h' -> 'dir/include/rdma/hfi/hfi1_user.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/hns-abi.h' -> 'dir/include/rdma/hns-abi.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/ib_user_ioctl_cmds.h' -> 'dir/include/rdma/ib_user_ioctl_cmds.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/ib_user_ioctl_verbs.h' -> 'dir/include/rdma/ib_user_ioctl_verbs.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/ib_user_mad.h' -> 'dir/include/rdma/ib_user_mad.h' 2024-05-16T21:33:09.424 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/ib_user_sa.h' -> 'dir/include/rdma/ib_user_sa.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/ib_user_verbs.h' -> 'dir/include/rdma/ib_user_verbs.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/irdma-abi.h' -> 'dir/include/rdma/irdma-abi.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/mana-abi.h' -> 'dir/include/rdma/mana-abi.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/mlx5-abi.h' -> 'dir/include/rdma/mlx5-abi.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/mlx5_user_ioctl_cmds.h' -> 'dir/include/rdma/mlx5_user_ioctl_cmds.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/mlx5_user_ioctl_verbs.h' -> 'dir/include/rdma/mlx5_user_ioctl_verbs.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/mthca-abi.h' -> 'dir/include/rdma/mthca-abi.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/ocrdma-abi.h' -> 'dir/include/rdma/ocrdma-abi.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/qedr-abi.h' -> 'dir/include/rdma/qedr-abi.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/rdma_netlink.h' -> 'dir/include/rdma/rdma_netlink.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/rdma_user_cm.h' -> 'dir/include/rdma/rdma_user_cm.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/rdma_user_ioctl.h' -> 'dir/include/rdma/rdma_user_ioctl.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/rdma_user_ioctl_cmds.h' -> 'dir/include/rdma/rdma_user_ioctl_cmds.h' 2024-05-16T21:33:09.425 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/rdma_user_rxe.h' -> 'dir/include/rdma/rdma_user_rxe.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/rvt-abi.h' -> 'dir/include/rdma/rvt-abi.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/siw-abi.h' -> 'dir/include/rdma/siw-abi.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/vmw_pvrdma-abi.h' -> 'dir/include/rdma/vmw_pvrdma-abi.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rdma/mlx4-abi.h' -> 'dir/include/rdma/mlx4-abi.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi' -> 'dir/include/scsi' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/cxlflash_ioctl.h' -> 'dir/include/scsi/cxlflash_ioctl.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/fc' -> 'dir/include/scsi/fc' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/fc/fc_els.h' -> 'dir/include/scsi/fc/fc_els.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/fc/fc_fs.h' -> 'dir/include/scsi/fc/fc_fs.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/fc/fc_gs.h' -> 'dir/include/scsi/fc/fc_gs.h' 2024-05-16T21:33:09.426 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/fc/fc_ns.h' -> 'dir/include/scsi/fc/fc_ns.h' 2024-05-16T21:33:09.607 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/scsi_bsg_fc.h' -> 'dir/include/scsi/scsi_bsg_fc.h' 2024-05-16T21:33:09.607 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/scsi_bsg_mpi3mr.h' -> 'dir/include/scsi/scsi_bsg_mpi3mr.h' 2024-05-16T21:33:09.607 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/scsi_bsg_ufs.h' -> 'dir/include/scsi/scsi_bsg_ufs.h' 2024-05-16T21:33:09.607 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/scsi_netlink.h' -> 'dir/include/scsi/scsi_netlink.h' 2024-05-16T21:33:09.607 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/scsi_netlink_fc.h' -> 'dir/include/scsi/scsi_netlink_fc.h' 2024-05-16T21:33:09.607 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/scsi.h' -> 'dir/include/scsi/scsi.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/scsi_ioctl.h' -> 'dir/include/scsi/scsi_ioctl.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/scsi/sg.h' -> 'dir/include/scsi/sg.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound' -> 'dir/include/sound' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/asequencer.h' -> 'dir/include/sound/asequencer.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/asoc.h' -> 'dir/include/sound/asoc.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/asound.h' -> 'dir/include/sound/asound.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/asound_fm.h' -> 'dir/include/sound/asound_fm.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/compress_offload.h' -> 'dir/include/sound/compress_offload.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/compress_params.h' -> 'dir/include/sound/compress_params.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/emu10k1.h' -> 'dir/include/sound/emu10k1.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/firewire.h' -> 'dir/include/sound/firewire.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/hdsp.h' -> 'dir/include/sound/hdsp.h' 2024-05-16T21:33:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/hdspm.h' -> 'dir/include/sound/hdspm.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/intel' -> 'dir/include/sound/intel' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/intel/avs' -> 'dir/include/sound/intel/avs' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/intel/avs/tokens.h' -> 'dir/include/sound/intel/avs/tokens.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/sb16_csp.h' -> 'dir/include/sound/sb16_csp.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/sfnt_info.h' -> 'dir/include/sound/sfnt_info.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/skl-tplg-interface.h' -> 'dir/include/sound/skl-tplg-interface.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/snd_ar_tokens.h' -> 'dir/include/sound/snd_ar_tokens.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/snd_sst_tokens.h' -> 'dir/include/sound/snd_sst_tokens.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/sof' -> 'dir/include/sound/sof' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/sof/abi.h' -> 'dir/include/sound/sof/abi.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/sof/fw.h' -> 'dir/include/sound/sof/fw.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/sof/header.h' -> 'dir/include/sound/sof/header.h' 2024-05-16T21:33:09.609 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/sof/tokens.h' -> 'dir/include/sound/sof/tokens.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/tlv.h' -> 'dir/include/sound/tlv.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sound/usb_stream.h' -> 'dir/include/sound/usb_stream.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/video' -> 'dir/include/video' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/video/edid.h' -> 'dir/include/video/edid.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/video/sisfb.h' -> 'dir/include/video/sisfb.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/video/uvesafb.h' -> 'dir/include/video/uvesafb.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xen' -> 'dir/include/xen' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xen/evtchn.h' -> 'dir/include/xen/evtchn.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xen/gntalloc.h' -> 'dir/include/xen/gntalloc.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xen/gntdev.h' -> 'dir/include/xen/gntdev.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xen/privcmd.h' -> 'dir/include/xen/privcmd.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/zconf.h' -> 'dir/include/zconf.h' 2024-05-16T21:33:09.610 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/zlib.h' -> 'dir/include/zlib.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9' -> 'dir/include/python3.9' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/Python-ast.h' -> 'dir/include/python3.9/Python-ast.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/Python.h' -> 'dir/include/python3.9/Python.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/abstract.h' -> 'dir/include/python3.9/abstract.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/asdl.h' -> 'dir/include/python3.9/asdl.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/ast.h' -> 'dir/include/python3.9/ast.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/bitset.h' -> 'dir/include/python3.9/bitset.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/bltinmodule.h' -> 'dir/include/python3.9/bltinmodule.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/boolobject.h' -> 'dir/include/python3.9/boolobject.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/bytearrayobject.h' -> 'dir/include/python3.9/bytearrayobject.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/bytesobject.h' -> 'dir/include/python3.9/bytesobject.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cellobject.h' -> 'dir/include/python3.9/cellobject.h' 2024-05-16T21:33:09.611 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/ceval.h' -> 'dir/include/python3.9/ceval.h' 2024-05-16T21:33:09.612 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/classobject.h' -> 'dir/include/python3.9/classobject.h' 2024-05-16T21:33:09.612 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/code.h' -> 'dir/include/python3.9/code.h' 2024-05-16T21:33:09.612 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/codecs.h' -> 'dir/include/python3.9/codecs.h' 2024-05-16T21:33:09.612 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/compile.h' -> 'dir/include/python3.9/compile.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/complexobject.h' -> 'dir/include/python3.9/complexobject.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/context.h' -> 'dir/include/python3.9/context.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/datetime.h' -> 'dir/include/python3.9/datetime.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/descrobject.h' -> 'dir/include/python3.9/descrobject.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/dictobject.h' -> 'dir/include/python3.9/dictobject.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/dynamic_annotations.h' -> 'dir/include/python3.9/dynamic_annotations.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/enumobject.h' -> 'dir/include/python3.9/enumobject.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/errcode.h' -> 'dir/include/python3.9/errcode.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/eval.h' -> 'dir/include/python3.9/eval.h' 2024-05-16T21:33:09.713 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/exports.h' -> 'dir/include/python3.9/exports.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/fileobject.h' -> 'dir/include/python3.9/fileobject.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/fileutils.h' -> 'dir/include/python3.9/fileutils.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/floatobject.h' -> 'dir/include/python3.9/floatobject.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/frameobject.h' -> 'dir/include/python3.9/frameobject.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/funcobject.h' -> 'dir/include/python3.9/funcobject.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/genericaliasobject.h' -> 'dir/include/python3.9/genericaliasobject.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/genobject.h' -> 'dir/include/python3.9/genobject.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/graminit.h' -> 'dir/include/python3.9/graminit.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/grammar.h' -> 'dir/include/python3.9/grammar.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/import.h' -> 'dir/include/python3.9/import.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/interpreteridobject.h' -> 'dir/include/python3.9/interpreteridobject.h' 2024-05-16T21:33:09.714 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/intrcheck.h' -> 'dir/include/python3.9/intrcheck.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/iterobject.h' -> 'dir/include/python3.9/iterobject.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/listobject.h' -> 'dir/include/python3.9/listobject.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/longintrepr.h' -> 'dir/include/python3.9/longintrepr.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/longobject.h' -> 'dir/include/python3.9/longobject.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/marshal.h' -> 'dir/include/python3.9/marshal.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/memoryobject.h' -> 'dir/include/python3.9/memoryobject.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/methodobject.h' -> 'dir/include/python3.9/methodobject.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/modsupport.h' -> 'dir/include/python3.9/modsupport.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/moduleobject.h' -> 'dir/include/python3.9/moduleobject.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/namespaceobject.h' -> 'dir/include/python3.9/namespaceobject.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/node.h' -> 'dir/include/python3.9/node.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/object.h' -> 'dir/include/python3.9/object.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/objimpl.h' -> 'dir/include/python3.9/objimpl.h' 2024-05-16T21:33:09.715 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/odictobject.h' -> 'dir/include/python3.9/odictobject.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyconfig-64.h' -> 'dir/include/python3.9/pyconfig-64.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/opcode.h' -> 'dir/include/python3.9/opcode.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/osdefs.h' -> 'dir/include/python3.9/osdefs.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/osmodule.h' -> 'dir/include/python3.9/osmodule.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/parsetok.h' -> 'dir/include/python3.9/parsetok.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/patchlevel.h' -> 'dir/include/python3.9/patchlevel.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/picklebufobject.h' -> 'dir/include/python3.9/picklebufobject.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/py_curses.h' -> 'dir/include/python3.9/py_curses.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyarena.h' -> 'dir/include/python3.9/pyarena.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pycapsule.h' -> 'dir/include/python3.9/pycapsule.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyconfig.h' -> 'dir/include/python3.9/pyconfig.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyctype.h' -> 'dir/include/python3.9/pyctype.h' 2024-05-16T21:33:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pydebug.h' -> 'dir/include/python3.9/pydebug.h' 2024-05-16T21:33:09.717 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pydtrace.h' -> 'dir/include/python3.9/pydtrace.h' 2024-05-16T21:33:09.717 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyerrors.h' -> 'dir/include/python3.9/pyerrors.h' 2024-05-16T21:33:09.717 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyexpat.h' -> 'dir/include/python3.9/pyexpat.h' 2024-05-16T21:33:09.717 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyfpe.h' -> 'dir/include/python3.9/pyfpe.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyframe.h' -> 'dir/include/python3.9/pyframe.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyhash.h' -> 'dir/include/python3.9/pyhash.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pylifecycle.h' -> 'dir/include/python3.9/pylifecycle.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pymacconfig.h' -> 'dir/include/python3.9/pymacconfig.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pymacro.h' -> 'dir/include/python3.9/pymacro.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pymath.h' -> 'dir/include/python3.9/pymath.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pymem.h' -> 'dir/include/python3.9/pymem.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pyport.h' -> 'dir/include/python3.9/pyport.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pystate.h' -> 'dir/include/python3.9/pystate.h' 2024-05-16T21:33:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pystrcmp.h' -> 'dir/include/python3.9/pystrcmp.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pystrhex.h' -> 'dir/include/python3.9/pystrhex.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pystrtod.h' -> 'dir/include/python3.9/pystrtod.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pythonrun.h' -> 'dir/include/python3.9/pythonrun.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pythread.h' -> 'dir/include/python3.9/pythread.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/pytime.h' -> 'dir/include/python3.9/pytime.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/rangeobject.h' -> 'dir/include/python3.9/rangeobject.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/setobject.h' -> 'dir/include/python3.9/setobject.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/sliceobject.h' -> 'dir/include/python3.9/sliceobject.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/structmember.h' -> 'dir/include/python3.9/structmember.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/structseq.h' -> 'dir/include/python3.9/structseq.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/symtable.h' -> 'dir/include/python3.9/symtable.h' 2024-05-16T21:33:09.796 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/sysmodule.h' -> 'dir/include/python3.9/sysmodule.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/token.h' -> 'dir/include/python3.9/token.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/traceback.h' -> 'dir/include/python3.9/traceback.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/tracemalloc.h' -> 'dir/include/python3.9/tracemalloc.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/tupleobject.h' -> 'dir/include/python3.9/tupleobject.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/typeslots.h' -> 'dir/include/python3.9/typeslots.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/ucnhash.h' -> 'dir/include/python3.9/ucnhash.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/unicodeobject.h' -> 'dir/include/python3.9/unicodeobject.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/warnings.h' -> 'dir/include/python3.9/warnings.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/weakrefobject.h' -> 'dir/include/python3.9/weakrefobject.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython' -> 'dir/include/python3.9/cpython' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/abstract.h' -> 'dir/include/python3.9/cpython/abstract.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/bytearrayobject.h' -> 'dir/include/python3.9/cpython/bytearrayobject.h' 2024-05-16T21:33:09.797 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/bytesobject.h' -> 'dir/include/python3.9/cpython/bytesobject.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/ceval.h' -> 'dir/include/python3.9/cpython/ceval.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/code.h' -> 'dir/include/python3.9/cpython/code.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/dictobject.h' -> 'dir/include/python3.9/cpython/dictobject.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/fileobject.h' -> 'dir/include/python3.9/cpython/fileobject.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/fileutils.h' -> 'dir/include/python3.9/cpython/fileutils.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/frameobject.h' -> 'dir/include/python3.9/cpython/frameobject.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/import.h' -> 'dir/include/python3.9/cpython/import.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/initconfig.h' -> 'dir/include/python3.9/cpython/initconfig.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/interpreteridobject.h' -> 'dir/include/python3.9/cpython/interpreteridobject.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/listobject.h' -> 'dir/include/python3.9/cpython/listobject.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/methodobject.h' -> 'dir/include/python3.9/cpython/methodobject.h' 2024-05-16T21:33:09.798 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/object.h' -> 'dir/include/python3.9/cpython/object.h' 2024-05-16T21:33:09.799 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/objimpl.h' -> 'dir/include/python3.9/cpython/objimpl.h' 2024-05-16T21:33:09.799 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/pyerrors.h' -> 'dir/include/python3.9/cpython/pyerrors.h' 2024-05-16T21:33:09.799 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/pylifecycle.h' -> 'dir/include/python3.9/cpython/pylifecycle.h' 2024-05-16T21:33:09.875 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/pymem.h' -> 'dir/include/python3.9/cpython/pymem.h' 2024-05-16T21:33:09.876 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/pystate.h' -> 'dir/include/python3.9/cpython/pystate.h' 2024-05-16T21:33:09.876 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/sysmodule.h' -> 'dir/include/python3.9/cpython/sysmodule.h' 2024-05-16T21:33:09.876 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/traceback.h' -> 'dir/include/python3.9/cpython/traceback.h' 2024-05-16T21:33:09.876 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/tupleobject.h' -> 'dir/include/python3.9/cpython/tupleobject.h' 2024-05-16T21:33:09.876 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/cpython/unicodeobject.h' -> 'dir/include/python3.9/cpython/unicodeobject.h' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal' -> 'dir/include/python3.9/internal' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pegen_interface.h' -> 'dir/include/python3.9/internal/pegen_interface.h' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_abstract.h' -> 'dir/include/python3.9/internal/pycore_abstract.h' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_accu.h' -> 'dir/include/python3.9/internal/pycore_accu.h' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_atomic.h' -> 'dir/include/python3.9/internal/pycore_atomic.h' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_bytes_methods.h' -> 'dir/include/python3.9/internal/pycore_bytes_methods.h' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_byteswap.h' -> 'dir/include/python3.9/internal/pycore_byteswap.h' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_call.h' -> 'dir/include/python3.9/internal/pycore_call.h' 2024-05-16T21:33:09.877 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_ceval.h' -> 'dir/include/python3.9/internal/pycore_ceval.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_code.h' -> 'dir/include/python3.9/internal/pycore_code.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_condvar.h' -> 'dir/include/python3.9/internal/pycore_condvar.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_context.h' -> 'dir/include/python3.9/internal/pycore_context.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_dtoa.h' -> 'dir/include/python3.9/internal/pycore_dtoa.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_fileutils.h' -> 'dir/include/python3.9/internal/pycore_fileutils.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_gc.h' -> 'dir/include/python3.9/internal/pycore_gc.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_getopt.h' -> 'dir/include/python3.9/internal/pycore_getopt.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_gil.h' -> 'dir/include/python3.9/internal/pycore_gil.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_hamt.h' -> 'dir/include/python3.9/internal/pycore_hamt.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_hashtable.h' -> 'dir/include/python3.9/internal/pycore_hashtable.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_import.h' -> 'dir/include/python3.9/internal/pycore_import.h' 2024-05-16T21:33:09.878 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_initconfig.h' -> 'dir/include/python3.9/internal/pycore_initconfig.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_interp.h' -> 'dir/include/python3.9/internal/pycore_interp.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_long.h' -> 'dir/include/python3.9/internal/pycore_long.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_object.h' -> 'dir/include/python3.9/internal/pycore_object.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_pathconfig.h' -> 'dir/include/python3.9/internal/pycore_pathconfig.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_pyerrors.h' -> 'dir/include/python3.9/internal/pycore_pyerrors.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_pyhash.h' -> 'dir/include/python3.9/internal/pycore_pyhash.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_pylifecycle.h' -> 'dir/include/python3.9/internal/pycore_pylifecycle.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_pymem.h' -> 'dir/include/python3.9/internal/pycore_pymem.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_pystate.h' -> 'dir/include/python3.9/internal/pycore_pystate.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_runtime.h' -> 'dir/include/python3.9/internal/pycore_runtime.h' 2024-05-16T21:33:09.879 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_sysmodule.h' -> 'dir/include/python3.9/internal/pycore_sysmodule.h' 2024-05-16T21:33:09.880 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_traceback.h' -> 'dir/include/python3.9/internal/pycore_traceback.h' 2024-05-16T21:33:09.880 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_tupleobject.h' -> 'dir/include/python3.9/internal/pycore_tupleobject.h' 2024-05-16T21:33:09.880 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/python3.9/internal/pycore_warnings.h' -> 'dir/include/python3.9/internal/pycore_warnings.h' 2024-05-16T21:33:10.071 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/lauxlib.h' -> 'dir/include/lauxlib.h' 2024-05-16T21:33:10.071 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/lua.h' -> 'dir/include/lua.h' 2024-05-16T21:33:10.071 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/lua.hpp' -> 'dir/include/lua.hpp' 2024-05-16T21:33:10.071 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/luaconf-x86_64.h' -> 'dir/include/luaconf-x86_64.h' 2024-05-16T21:33:10.071 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/luaconf.h' -> 'dir/include/luaconf.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys' -> 'dir/include/sys' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/acl.h' -> 'dir/include/sys/acl.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/sdt.h' -> 'dir/include/sys/sdt.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/sdt-config.h' -> 'dir/include/sys/sdt-config.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/auxv.h' -> 'dir/include/sys/auxv.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/bitypes.h' -> 'dir/include/sys/bitypes.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/cdefs.h' -> 'dir/include/sys/cdefs.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/debugreg.h' -> 'dir/include/sys/debugreg.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/dir.h' -> 'dir/include/sys/dir.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/elf.h' -> 'dir/include/sys/elf.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/epoll.h' -> 'dir/include/sys/epoll.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/errno.h' -> 'dir/include/sys/errno.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/eventfd.h' -> 'dir/include/sys/eventfd.h' 2024-05-16T21:33:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/fanotify.h' -> 'dir/include/sys/fanotify.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/fcntl.h' -> 'dir/include/sys/fcntl.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/file.h' -> 'dir/include/sys/file.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/fsuid.h' -> 'dir/include/sys/fsuid.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/gmon.h' -> 'dir/include/sys/gmon.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/gmon_out.h' -> 'dir/include/sys/gmon_out.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/inotify.h' -> 'dir/include/sys/inotify.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/io.h' -> 'dir/include/sys/io.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/ioctl.h' -> 'dir/include/sys/ioctl.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/ipc.h' -> 'dir/include/sys/ipc.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/kd.h' -> 'dir/include/sys/kd.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/klog.h' -> 'dir/include/sys/klog.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/mman.h' -> 'dir/include/sys/mman.h' 2024-05-16T21:33:10.073 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/mount.h' -> 'dir/include/sys/mount.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/msg.h' -> 'dir/include/sys/msg.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/mtio.h' -> 'dir/include/sys/mtio.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/param.h' -> 'dir/include/sys/param.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/pci.h' -> 'dir/include/sys/pci.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/perm.h' -> 'dir/include/sys/perm.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/personality.h' -> 'dir/include/sys/personality.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/poll.h' -> 'dir/include/sys/poll.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/prctl.h' -> 'dir/include/sys/prctl.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/procfs.h' -> 'dir/include/sys/procfs.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/profil.h' -> 'dir/include/sys/profil.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/ptrace.h' -> 'dir/include/sys/ptrace.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/queue.h' -> 'dir/include/sys/queue.h' 2024-05-16T21:33:10.074 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/quota.h' -> 'dir/include/sys/quota.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/random.h' -> 'dir/include/sys/random.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/raw.h' -> 'dir/include/sys/raw.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/reboot.h' -> 'dir/include/sys/reboot.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/reg.h' -> 'dir/include/sys/reg.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/resource.h' -> 'dir/include/sys/resource.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/rseq.h' -> 'dir/include/sys/rseq.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/select.h' -> 'dir/include/sys/select.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/sem.h' -> 'dir/include/sys/sem.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/sendfile.h' -> 'dir/include/sys/sendfile.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/shm.h' -> 'dir/include/sys/shm.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/signal.h' -> 'dir/include/sys/signal.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/signalfd.h' -> 'dir/include/sys/signalfd.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/single_threaded.h' -> 'dir/include/sys/single_threaded.h' 2024-05-16T21:33:10.075 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/socket.h' -> 'dir/include/sys/socket.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/socketvar.h' -> 'dir/include/sys/socketvar.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/soundcard.h' -> 'dir/include/sys/soundcard.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/stat.h' -> 'dir/include/sys/stat.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/statfs.h' -> 'dir/include/sys/statfs.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/statvfs.h' -> 'dir/include/sys/statvfs.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/swap.h' -> 'dir/include/sys/swap.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/syscall.h' -> 'dir/include/sys/syscall.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/sysinfo.h' -> 'dir/include/sys/sysinfo.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/syslog.h' -> 'dir/include/sys/syslog.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/sysmacros.h' -> 'dir/include/sys/sysmacros.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/termios.h' -> 'dir/include/sys/termios.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/time.h' -> 'dir/include/sys/time.h' 2024-05-16T21:33:10.076 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/timeb.h' -> 'dir/include/sys/timeb.h' 2024-05-16T21:33:10.306 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/timerfd.h' -> 'dir/include/sys/timerfd.h' 2024-05-16T21:33:10.306 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/times.h' -> 'dir/include/sys/times.h' 2024-05-16T21:33:10.306 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/timex.h' -> 'dir/include/sys/timex.h' 2024-05-16T21:33:10.306 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/ttychars.h' -> 'dir/include/sys/ttychars.h' 2024-05-16T21:33:10.306 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/ttydefaults.h' -> 'dir/include/sys/ttydefaults.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/types.h' -> 'dir/include/sys/types.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/ucontext.h' -> 'dir/include/sys/ucontext.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/uio.h' -> 'dir/include/sys/uio.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/un.h' -> 'dir/include/sys/un.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/unistd.h' -> 'dir/include/sys/unistd.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/user.h' -> 'dir/include/sys/user.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/utsname.h' -> 'dir/include/sys/utsname.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/vfs.h' -> 'dir/include/sys/vfs.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/vlimit.h' -> 'dir/include/sys/vlimit.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/vm86.h' -> 'dir/include/sys/vm86.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/vt.h' -> 'dir/include/sys/vt.h' 2024-05-16T21:33:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/wait.h' -> 'dir/include/sys/wait.h' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/xattr.h' -> 'dir/include/sys/xattr.h' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/acct.h' -> 'dir/include/sys/acct.h' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/platform' -> 'dir/include/sys/platform' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/sys/platform/x86.h' -> 'dir/include/sys/platform/x86.h' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++' -> 'dir/include/c++' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11' -> 'dir/include/c++/11' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/algorithm' -> 'dir/include/c++/11/algorithm' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/any' -> 'dir/include/c++/11/any' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/array' -> 'dir/include/c++/11/array' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/atomic' -> 'dir/include/c++/11/atomic' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward' -> 'dir/include/c++/11/backward' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward/auto_ptr.h' -> 'dir/include/c++/11/backward/auto_ptr.h' 2024-05-16T21:33:10.308 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward/backward_warning.h' -> 'dir/include/c++/11/backward/backward_warning.h' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward/binders.h' -> 'dir/include/c++/11/backward/binders.h' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward/hash_fun.h' -> 'dir/include/c++/11/backward/hash_fun.h' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward/hash_map' -> 'dir/include/c++/11/backward/hash_map' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward/hash_set' -> 'dir/include/c++/11/backward/hash_set' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward/hashtable.h' -> 'dir/include/c++/11/backward/hashtable.h' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/backward/strstream' -> 'dir/include/c++/11/backward/strstream' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/barrier' -> 'dir/include/c++/11/barrier' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bit' -> 'dir/include/c++/11/bit' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits' -> 'dir/include/c++/11/bits' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/algorithmfwd.h' -> 'dir/include/c++/11/bits/algorithmfwd.h' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/align.h' -> 'dir/include/c++/11/bits/align.h' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/alloc_traits.h' -> 'dir/include/c++/11/bits/alloc_traits.h' 2024-05-16T21:33:10.309 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/allocated_ptr.h' -> 'dir/include/c++/11/bits/allocated_ptr.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/allocator.h' -> 'dir/include/c++/11/bits/allocator.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/atomic_base.h' -> 'dir/include/c++/11/bits/atomic_base.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/atomic_futex.h' -> 'dir/include/c++/11/bits/atomic_futex.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/atomic_lockfree_defines.h' -> 'dir/include/c++/11/bits/atomic_lockfree_defines.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/atomic_timed_wait.h' -> 'dir/include/c++/11/bits/atomic_timed_wait.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/atomic_wait.h' -> 'dir/include/c++/11/bits/atomic_wait.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/basic_ios.h' -> 'dir/include/c++/11/bits/basic_ios.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/basic_ios.tcc' -> 'dir/include/c++/11/bits/basic_ios.tcc' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/basic_string.h' -> 'dir/include/c++/11/bits/basic_string.h' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/basic_string.tcc' -> 'dir/include/c++/11/bits/basic_string.tcc' 2024-05-16T21:33:10.310 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/boost_concept_check.h' -> 'dir/include/c++/11/bits/boost_concept_check.h' 2024-05-16T21:33:10.311 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/c++0x_warning.h' -> 'dir/include/c++/11/bits/c++0x_warning.h' 2024-05-16T21:33:10.311 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/char_traits.h' -> 'dir/include/c++/11/bits/char_traits.h' 2024-05-16T21:33:10.311 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/charconv.h' -> 'dir/include/c++/11/bits/charconv.h' 2024-05-16T21:33:10.311 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/codecvt.h' -> 'dir/include/c++/11/bits/codecvt.h' 2024-05-16T21:33:10.743 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/concept_check.h' -> 'dir/include/c++/11/bits/concept_check.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/cpp_type_traits.h' -> 'dir/include/c++/11/bits/cpp_type_traits.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/cxxabi_forced.h' -> 'dir/include/c++/11/bits/cxxabi_forced.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/cxxabi_init_exception.h' -> 'dir/include/c++/11/bits/cxxabi_init_exception.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/deque.tcc' -> 'dir/include/c++/11/bits/deque.tcc' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/enable_special_members.h' -> 'dir/include/c++/11/bits/enable_special_members.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/erase_if.h' -> 'dir/include/c++/11/bits/erase_if.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/exception.h' -> 'dir/include/c++/11/bits/exception.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/exception_defines.h' -> 'dir/include/c++/11/bits/exception_defines.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/exception_ptr.h' -> 'dir/include/c++/11/bits/exception_ptr.h' 2024-05-16T21:33:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/forward_list.h' -> 'dir/include/c++/11/bits/forward_list.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/forward_list.tcc' -> 'dir/include/c++/11/bits/forward_list.tcc' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/fs_dir.h' -> 'dir/include/c++/11/bits/fs_dir.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/fs_fwd.h' -> 'dir/include/c++/11/bits/fs_fwd.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/fs_ops.h' -> 'dir/include/c++/11/bits/fs_ops.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/fs_path.h' -> 'dir/include/c++/11/bits/fs_path.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/fstream.tcc' -> 'dir/include/c++/11/bits/fstream.tcc' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/functexcept.h' -> 'dir/include/c++/11/bits/functexcept.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/functional_hash.h' -> 'dir/include/c++/11/bits/functional_hash.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/gslice.h' -> 'dir/include/c++/11/bits/gslice.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/gslice_array.h' -> 'dir/include/c++/11/bits/gslice_array.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/hash_bytes.h' -> 'dir/include/c++/11/bits/hash_bytes.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/hashtable.h' -> 'dir/include/c++/11/bits/hashtable.h' 2024-05-16T21:33:10.745 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/hashtable_policy.h' -> 'dir/include/c++/11/bits/hashtable_policy.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/indirect_array.h' -> 'dir/include/c++/11/bits/indirect_array.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/invoke.h' -> 'dir/include/c++/11/bits/invoke.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ios_base.h' -> 'dir/include/c++/11/bits/ios_base.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/istream.tcc' -> 'dir/include/c++/11/bits/istream.tcc' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/iterator_concepts.h' -> 'dir/include/c++/11/bits/iterator_concepts.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/list.tcc' -> 'dir/include/c++/11/bits/list.tcc' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/locale_classes.h' -> 'dir/include/c++/11/bits/locale_classes.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/locale_classes.tcc' -> 'dir/include/c++/11/bits/locale_classes.tcc' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/locale_conv.h' -> 'dir/include/c++/11/bits/locale_conv.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/locale_facets.h' -> 'dir/include/c++/11/bits/locale_facets.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/locale_facets.tcc' -> 'dir/include/c++/11/bits/locale_facets.tcc' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/locale_facets_nonio.h' -> 'dir/include/c++/11/bits/locale_facets_nonio.h' 2024-05-16T21:33:10.746 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/locale_facets_nonio.tcc' -> 'dir/include/c++/11/bits/locale_facets_nonio.tcc' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/localefwd.h' -> 'dir/include/c++/11/bits/localefwd.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/mask_array.h' -> 'dir/include/c++/11/bits/mask_array.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/max_size_type.h' -> 'dir/include/c++/11/bits/max_size_type.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/memoryfwd.h' -> 'dir/include/c++/11/bits/memoryfwd.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/move.h' -> 'dir/include/c++/11/bits/move.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/nested_exception.h' -> 'dir/include/c++/11/bits/nested_exception.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/node_handle.h' -> 'dir/include/c++/11/bits/node_handle.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ostream.tcc' -> 'dir/include/c++/11/bits/ostream.tcc' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ostream_insert.h' -> 'dir/include/c++/11/bits/ostream_insert.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/parse_numbers.h' -> 'dir/include/c++/11/bits/parse_numbers.h' 2024-05-16T21:33:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/postypes.h' -> 'dir/include/c++/11/bits/postypes.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/predefined_ops.h' -> 'dir/include/c++/11/bits/predefined_ops.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ptr_traits.h' -> 'dir/include/c++/11/bits/ptr_traits.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/quoted_string.h' -> 'dir/include/c++/11/bits/quoted_string.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/random.h' -> 'dir/include/c++/11/bits/random.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/random.tcc' -> 'dir/include/c++/11/bits/random.tcc' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/range_access.h' -> 'dir/include/c++/11/bits/range_access.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ranges_algo.h' -> 'dir/include/c++/11/bits/ranges_algo.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ranges_algobase.h' -> 'dir/include/c++/11/bits/ranges_algobase.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ranges_base.h' -> 'dir/include/c++/11/bits/ranges_base.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ranges_cmp.h' -> 'dir/include/c++/11/bits/ranges_cmp.h' 2024-05-16T21:33:10.924 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ranges_uninitialized.h' -> 'dir/include/c++/11/bits/ranges_uninitialized.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/ranges_util.h' -> 'dir/include/c++/11/bits/ranges_util.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/refwrap.h' -> 'dir/include/c++/11/bits/refwrap.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex.h' -> 'dir/include/c++/11/bits/regex.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex.tcc' -> 'dir/include/c++/11/bits/regex.tcc' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_automaton.h' -> 'dir/include/c++/11/bits/regex_automaton.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_automaton.tcc' -> 'dir/include/c++/11/bits/regex_automaton.tcc' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_compiler.h' -> 'dir/include/c++/11/bits/regex_compiler.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_compiler.tcc' -> 'dir/include/c++/11/bits/regex_compiler.tcc' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_constants.h' -> 'dir/include/c++/11/bits/regex_constants.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_error.h' -> 'dir/include/c++/11/bits/regex_error.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_executor.h' -> 'dir/include/c++/11/bits/regex_executor.h' 2024-05-16T21:33:10.925 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_executor.tcc' -> 'dir/include/c++/11/bits/regex_executor.tcc' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_scanner.h' -> 'dir/include/c++/11/bits/regex_scanner.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/regex_scanner.tcc' -> 'dir/include/c++/11/bits/regex_scanner.tcc' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/semaphore_base.h' -> 'dir/include/c++/11/bits/semaphore_base.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/shared_ptr.h' -> 'dir/include/c++/11/bits/shared_ptr.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/shared_ptr_atomic.h' -> 'dir/include/c++/11/bits/shared_ptr_atomic.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/shared_ptr_base.h' -> 'dir/include/c++/11/bits/shared_ptr_base.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/slice_array.h' -> 'dir/include/c++/11/bits/slice_array.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/specfun.h' -> 'dir/include/c++/11/bits/specfun.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/sstream.tcc' -> 'dir/include/c++/11/bits/sstream.tcc' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/std_abs.h' -> 'dir/include/c++/11/bits/std_abs.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/std_function.h' -> 'dir/include/c++/11/bits/std_function.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/std_mutex.h' -> 'dir/include/c++/11/bits/std_mutex.h' 2024-05-16T21:33:10.926 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/std_thread.h' -> 'dir/include/c++/11/bits/std_thread.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_algo.h' -> 'dir/include/c++/11/bits/stl_algo.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_algobase.h' -> 'dir/include/c++/11/bits/stl_algobase.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_bvector.h' -> 'dir/include/c++/11/bits/stl_bvector.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_construct.h' -> 'dir/include/c++/11/bits/stl_construct.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_deque.h' -> 'dir/include/c++/11/bits/stl_deque.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_function.h' -> 'dir/include/c++/11/bits/stl_function.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_heap.h' -> 'dir/include/c++/11/bits/stl_heap.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_iterator.h' -> 'dir/include/c++/11/bits/stl_iterator.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_iterator_base_funcs.h' -> 'dir/include/c++/11/bits/stl_iterator_base_funcs.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_iterator_base_types.h' -> 'dir/include/c++/11/bits/stl_iterator_base_types.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_list.h' -> 'dir/include/c++/11/bits/stl_list.h' 2024-05-16T21:33:10.927 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_map.h' -> 'dir/include/c++/11/bits/stl_map.h' 2024-05-16T21:33:11.096 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_multimap.h' -> 'dir/include/c++/11/bits/stl_multimap.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_multiset.h' -> 'dir/include/c++/11/bits/stl_multiset.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_numeric.h' -> 'dir/include/c++/11/bits/stl_numeric.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_pair.h' -> 'dir/include/c++/11/bits/stl_pair.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_queue.h' -> 'dir/include/c++/11/bits/stl_queue.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_raw_storage_iter.h' -> 'dir/include/c++/11/bits/stl_raw_storage_iter.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_relops.h' -> 'dir/include/c++/11/bits/stl_relops.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_set.h' -> 'dir/include/c++/11/bits/stl_set.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_stack.h' -> 'dir/include/c++/11/bits/stl_stack.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_tempbuf.h' -> 'dir/include/c++/11/bits/stl_tempbuf.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_tree.h' -> 'dir/include/c++/11/bits/stl_tree.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_uninitialized.h' -> 'dir/include/c++/11/bits/stl_uninitialized.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stl_vector.h' -> 'dir/include/c++/11/bits/stl_vector.h' 2024-05-16T21:33:11.097 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stream_iterator.h' -> 'dir/include/c++/11/bits/stream_iterator.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/streambuf.tcc' -> 'dir/include/c++/11/bits/streambuf.tcc' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/streambuf_iterator.h' -> 'dir/include/c++/11/bits/streambuf_iterator.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/string_view.tcc' -> 'dir/include/c++/11/bits/string_view.tcc' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/stringfwd.h' -> 'dir/include/c++/11/bits/stringfwd.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/this_thread_sleep.h' -> 'dir/include/c++/11/bits/this_thread_sleep.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/uniform_int_dist.h' -> 'dir/include/c++/11/bits/uniform_int_dist.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/unique_lock.h' -> 'dir/include/c++/11/bits/unique_lock.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/unique_ptr.h' -> 'dir/include/c++/11/bits/unique_ptr.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/unordered_map.h' -> 'dir/include/c++/11/bits/unordered_map.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/unordered_set.h' -> 'dir/include/c++/11/bits/unordered_set.h' 2024-05-16T21:33:11.098 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/uses_allocator.h' -> 'dir/include/c++/11/bits/uses_allocator.h' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/uses_allocator_args.h' -> 'dir/include/c++/11/bits/uses_allocator_args.h' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/valarray_after.h' -> 'dir/include/c++/11/bits/valarray_after.h' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/valarray_array.h' -> 'dir/include/c++/11/bits/valarray_array.h' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/valarray_array.tcc' -> 'dir/include/c++/11/bits/valarray_array.tcc' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/valarray_before.h' -> 'dir/include/c++/11/bits/valarray_before.h' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bits/vector.tcc' -> 'dir/include/c++/11/bits/vector.tcc' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/bitset' -> 'dir/include/c++/11/bitset' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cassert' -> 'dir/include/c++/11/cassert' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ccomplex' -> 'dir/include/c++/11/ccomplex' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cctype' -> 'dir/include/c++/11/cctype' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cerrno' -> 'dir/include/c++/11/cerrno' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cfenv' -> 'dir/include/c++/11/cfenv' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cfloat' -> 'dir/include/c++/11/cfloat' 2024-05-16T21:33:11.099 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/charconv' -> 'dir/include/c++/11/charconv' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/chrono' -> 'dir/include/c++/11/chrono' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cinttypes' -> 'dir/include/c++/11/cinttypes' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ciso646' -> 'dir/include/c++/11/ciso646' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/climits' -> 'dir/include/c++/11/climits' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/clocale' -> 'dir/include/c++/11/clocale' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cmath' -> 'dir/include/c++/11/cmath' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/codecvt' -> 'dir/include/c++/11/codecvt' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/compare' -> 'dir/include/c++/11/compare' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/complex' -> 'dir/include/c++/11/complex' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/complex.h' -> 'dir/include/c++/11/complex.h' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/concepts' -> 'dir/include/c++/11/concepts' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/condition_variable' -> 'dir/include/c++/11/condition_variable' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/coroutine' -> 'dir/include/c++/11/coroutine' 2024-05-16T21:33:11.100 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/csetjmp' -> 'dir/include/c++/11/csetjmp' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/csignal' -> 'dir/include/c++/11/csignal' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cstdalign' -> 'dir/include/c++/11/cstdalign' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cstdarg' -> 'dir/include/c++/11/cstdarg' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cstdbool' -> 'dir/include/c++/11/cstdbool' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cstddef' -> 'dir/include/c++/11/cstddef' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cstdint' -> 'dir/include/c++/11/cstdint' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cstdio' -> 'dir/include/c++/11/cstdio' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cstdlib' -> 'dir/include/c++/11/cstdlib' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cstring' -> 'dir/include/c++/11/cstring' 2024-05-16T21:33:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ctgmath' -> 'dir/include/c++/11/ctgmath' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ctime' -> 'dir/include/c++/11/ctime' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cuchar' -> 'dir/include/c++/11/cuchar' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cwchar' -> 'dir/include/c++/11/cwchar' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cwctype' -> 'dir/include/c++/11/cwctype' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/cxxabi.h' -> 'dir/include/c++/11/cxxabi.h' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug' -> 'dir/include/c++/11/debug' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/assertions.h' -> 'dir/include/c++/11/debug/assertions.h' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/bitset' -> 'dir/include/c++/11/debug/bitset' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/debug.h' -> 'dir/include/c++/11/debug/debug.h' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/deque' -> 'dir/include/c++/11/debug/deque' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/formatter.h' -> 'dir/include/c++/11/debug/formatter.h' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/forward_list' -> 'dir/include/c++/11/debug/forward_list' 2024-05-16T21:33:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/functions.h' -> 'dir/include/c++/11/debug/functions.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/helper_functions.h' -> 'dir/include/c++/11/debug/helper_functions.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/list' -> 'dir/include/c++/11/debug/list' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/macros.h' -> 'dir/include/c++/11/debug/macros.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/map' -> 'dir/include/c++/11/debug/map' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/map.h' -> 'dir/include/c++/11/debug/map.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/multimap.h' -> 'dir/include/c++/11/debug/multimap.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/multiset.h' -> 'dir/include/c++/11/debug/multiset.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_base.h' -> 'dir/include/c++/11/debug/safe_base.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_container.h' -> 'dir/include/c++/11/debug/safe_container.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_iterator.h' -> 'dir/include/c++/11/debug/safe_iterator.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_iterator.tcc' -> 'dir/include/c++/11/debug/safe_iterator.tcc' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_local_iterator.h' -> 'dir/include/c++/11/debug/safe_local_iterator.h' 2024-05-16T21:33:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_local_iterator.tcc' -> 'dir/include/c++/11/debug/safe_local_iterator.tcc' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_sequence.h' -> 'dir/include/c++/11/debug/safe_sequence.h' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_sequence.tcc' -> 'dir/include/c++/11/debug/safe_sequence.tcc' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_unordered_base.h' -> 'dir/include/c++/11/debug/safe_unordered_base.h' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_unordered_container.h' -> 'dir/include/c++/11/debug/safe_unordered_container.h' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/safe_unordered_container.tcc' -> 'dir/include/c++/11/debug/safe_unordered_container.tcc' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/set' -> 'dir/include/c++/11/debug/set' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/set.h' -> 'dir/include/c++/11/debug/set.h' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/stl_iterator.h' -> 'dir/include/c++/11/debug/stl_iterator.h' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/string' -> 'dir/include/c++/11/debug/string' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/unordered_map' -> 'dir/include/c++/11/debug/unordered_map' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/unordered_set' -> 'dir/include/c++/11/debug/unordered_set' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/debug/vector' -> 'dir/include/c++/11/debug/vector' 2024-05-16T21:33:11.488 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/decimal' -> 'dir/include/c++/11/decimal' 2024-05-16T21:33:11.489 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/decimal/decimal' -> 'dir/include/c++/11/decimal/decimal' 2024-05-16T21:33:11.489 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/decimal/decimal.h' -> 'dir/include/c++/11/decimal/decimal.h' 2024-05-16T21:33:11.489 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/deque' -> 'dir/include/c++/11/deque' 2024-05-16T21:33:11.489 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/exception' -> 'dir/include/c++/11/exception' 2024-05-16T21:33:11.489 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/execution' -> 'dir/include/c++/11/execution' 2024-05-16T21:33:11.593 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental' -> 'dir/include/c++/11/experimental' 2024-05-16T21:33:11.593 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/algorithm' -> 'dir/include/c++/11/experimental/algorithm' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/any' -> 'dir/include/c++/11/experimental/any' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/array' -> 'dir/include/c++/11/experimental/array' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits' -> 'dir/include/c++/11/experimental/bits' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/fs_dir.h' -> 'dir/include/c++/11/experimental/bits/fs_dir.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/fs_fwd.h' -> 'dir/include/c++/11/experimental/bits/fs_fwd.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/fs_ops.h' -> 'dir/include/c++/11/experimental/bits/fs_ops.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/fs_path.h' -> 'dir/include/c++/11/experimental/bits/fs_path.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/lfts_config.h' -> 'dir/include/c++/11/experimental/bits/lfts_config.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/net.h' -> 'dir/include/c++/11/experimental/bits/net.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/numeric_traits.h' -> 'dir/include/c++/11/experimental/bits/numeric_traits.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/shared_ptr.h' -> 'dir/include/c++/11/experimental/bits/shared_ptr.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd.h' -> 'dir/include/c++/11/experimental/bits/simd.h' 2024-05-16T21:33:11.594 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_builtin.h' -> 'dir/include/c++/11/experimental/bits/simd_builtin.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_converter.h' -> 'dir/include/c++/11/experimental/bits/simd_converter.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_detail.h' -> 'dir/include/c++/11/experimental/bits/simd_detail.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_fixed_size.h' -> 'dir/include/c++/11/experimental/bits/simd_fixed_size.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_math.h' -> 'dir/include/c++/11/experimental/bits/simd_math.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_neon.h' -> 'dir/include/c++/11/experimental/bits/simd_neon.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_ppc.h' -> 'dir/include/c++/11/experimental/bits/simd_ppc.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_scalar.h' -> 'dir/include/c++/11/experimental/bits/simd_scalar.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_x86.h' -> 'dir/include/c++/11/experimental/bits/simd_x86.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/simd_x86_conversions.h' -> 'dir/include/c++/11/experimental/bits/simd_x86_conversions.h' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/bits/string_view.tcc' -> 'dir/include/c++/11/experimental/bits/string_view.tcc' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/buffer' -> 'dir/include/c++/11/experimental/buffer' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/chrono' -> 'dir/include/c++/11/experimental/chrono' 2024-05-16T21:33:11.595 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/deque' -> 'dir/include/c++/11/experimental/deque' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/executor' -> 'dir/include/c++/11/experimental/executor' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/filesystem' -> 'dir/include/c++/11/experimental/filesystem' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/forward_list' -> 'dir/include/c++/11/experimental/forward_list' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/functional' -> 'dir/include/c++/11/experimental/functional' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/internet' -> 'dir/include/c++/11/experimental/internet' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/io_context' -> 'dir/include/c++/11/experimental/io_context' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/iterator' -> 'dir/include/c++/11/experimental/iterator' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/list' -> 'dir/include/c++/11/experimental/list' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/map' -> 'dir/include/c++/11/experimental/map' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/memory' -> 'dir/include/c++/11/experimental/memory' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/memory_resource' -> 'dir/include/c++/11/experimental/memory_resource' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/net' -> 'dir/include/c++/11/experimental/net' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/netfwd' -> 'dir/include/c++/11/experimental/netfwd' 2024-05-16T21:33:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/numeric' -> 'dir/include/c++/11/experimental/numeric' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/optional' -> 'dir/include/c++/11/experimental/optional' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/propagate_const' -> 'dir/include/c++/11/experimental/propagate_const' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/random' -> 'dir/include/c++/11/experimental/random' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/ratio' -> 'dir/include/c++/11/experimental/ratio' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/regex' -> 'dir/include/c++/11/experimental/regex' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/set' -> 'dir/include/c++/11/experimental/set' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/simd' -> 'dir/include/c++/11/experimental/simd' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/socket' -> 'dir/include/c++/11/experimental/socket' 2024-05-16T21:33:11.698 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/source_location' -> 'dir/include/c++/11/experimental/source_location' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/string' -> 'dir/include/c++/11/experimental/string' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/string_view' -> 'dir/include/c++/11/experimental/string_view' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/system_error' -> 'dir/include/c++/11/experimental/system_error' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/timer' -> 'dir/include/c++/11/experimental/timer' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/tuple' -> 'dir/include/c++/11/experimental/tuple' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/type_traits' -> 'dir/include/c++/11/experimental/type_traits' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/unordered_map' -> 'dir/include/c++/11/experimental/unordered_map' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/unordered_set' -> 'dir/include/c++/11/experimental/unordered_set' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/utility' -> 'dir/include/c++/11/experimental/utility' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/experimental/vector' -> 'dir/include/c++/11/experimental/vector' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext' -> 'dir/include/c++/11/ext' 2024-05-16T21:33:11.699 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/algorithm' -> 'dir/include/c++/11/ext/algorithm' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/aligned_buffer.h' -> 'dir/include/c++/11/ext/aligned_buffer.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/alloc_traits.h' -> 'dir/include/c++/11/ext/alloc_traits.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/atomicity.h' -> 'dir/include/c++/11/ext/atomicity.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/bitmap_allocator.h' -> 'dir/include/c++/11/ext/bitmap_allocator.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/cast.h' -> 'dir/include/c++/11/ext/cast.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/cmath' -> 'dir/include/c++/11/ext/cmath' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/codecvt_specializations.h' -> 'dir/include/c++/11/ext/codecvt_specializations.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/concurrence.h' -> 'dir/include/c++/11/ext/concurrence.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/debug_allocator.h' -> 'dir/include/c++/11/ext/debug_allocator.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/enc_filebuf.h' -> 'dir/include/c++/11/ext/enc_filebuf.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/extptr_allocator.h' -> 'dir/include/c++/11/ext/extptr_allocator.h' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/functional' -> 'dir/include/c++/11/ext/functional' 2024-05-16T21:33:11.700 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/hash_map' -> 'dir/include/c++/11/ext/hash_map' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/hash_set' -> 'dir/include/c++/11/ext/hash_set' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/iterator' -> 'dir/include/c++/11/ext/iterator' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/malloc_allocator.h' -> 'dir/include/c++/11/ext/malloc_allocator.h' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/memory' -> 'dir/include/c++/11/ext/memory' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/mt_allocator.h' -> 'dir/include/c++/11/ext/mt_allocator.h' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/new_allocator.h' -> 'dir/include/c++/11/ext/new_allocator.h' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/numeric' -> 'dir/include/c++/11/ext/numeric' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/numeric_traits.h' -> 'dir/include/c++/11/ext/numeric_traits.h' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds' -> 'dir/include/c++/11/ext/pb_ds' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/assoc_container.hpp' -> 'dir/include/c++/11/ext/pb_ds/assoc_container.hpp' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail' -> 'dir/include/c++/11/ext/pb_ds/detail' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_' 2024-05-16T21:33:11.701 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/bin_search_tree_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/bin_search_tree_.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/debug_fn_imps.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/erase_fn_imps.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/find_fn_imps.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/info_fn_imps.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/insert_fn_imps.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/iterators_fn_imps.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/node_iterators.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/node_iterators.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/point_iterators.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/point_iterators.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/policy_access_fn_imps.hpp' 2024-05-16T21:33:11.767 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/r_erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/r_erase_fn_imps.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/rotate_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/rotate_fn_imps.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/split_join_fn_imps.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/traits.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/binary_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/binary_heap_.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/const_iterator.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/debug_fn_imps.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/entry_cmp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/entry_cmp.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/entry_pred.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/entry_pred.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/erase_fn_imps.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/find_fn_imps.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/info_fn_imps.hpp' 2024-05-16T21:33:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/insert_fn_imps.hpp' 2024-05-16T21:33:11.769 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/iterators_fn_imps.hpp' 2024-05-16T21:33:11.769 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/point_const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/point_const_iterator.hpp' 2024-05-16T21:33:11.841 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/policy_access_fn_imps.hpp' 2024-05-16T21:33:11.841 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/resize_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/resize_policy.hpp' 2024-05-16T21:33:11.841 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/split_join_fn_imps.hpp' 2024-05-16T21:33:11.841 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/trace_fn_imps.hpp' 2024-05-16T21:33:11.841 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_' 2024-05-16T21:33:11.842 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_/binomial_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_/binomial_heap_.hpp' 2024-05-16T21:33:11.842 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:11.842 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_/debug_fn_imps.hpp' 2024-05-16T21:33:11.842 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_' 2024-05-16T21:33:11.842 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/binomial_heap_base_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/binomial_heap_base_.hpp' 2024-05-16T21:33:11.842 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:11.842 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/debug_fn_imps.hpp' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/erase_fn_imps.hpp' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/find_fn_imps.hpp' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/insert_fn_imps.hpp' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/split_join_fn_imps.hpp' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/branch_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/branch_policy' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/branch_policy/branch_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/branch_policy/branch_policy.hpp' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/branch_policy/null_node_metadata.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/branch_policy/null_node_metadata.hpp' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/branch_policy/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/branch_policy/traits.hpp' 2024-05-16T21:33:11.843 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_' 2024-05-16T21:33:11.844 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cc_ht_map_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cc_ht_map_.hpp' 2024-05-16T21:33:11.844 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cmp_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cmp_fn_imps.hpp' 2024-05-16T21:33:11.844 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cond_key_dtor_entry_dealtor.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cond_key_dtor_entry_dealtor.hpp' 2024-05-16T21:33:11.844 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_fn_imps.hpp' 2024-05-16T21:33:11.844 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.844 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/entry_list_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/entry_list_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/find_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/find_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/find_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/info_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/iterators_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/policy_access_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/size_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/size_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/trace_fn_imps.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cond_dealtor.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cond_dealtor.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/container_base_dispatch.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/container_base_dispatch.hpp' 2024-05-16T21:33:11.906 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/debug_map_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/debug_map_base.hpp' 2024-05-16T21:33:11.907 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/eq_fn' -> 'dir/include/c++/11/ext/pb_ds/detail/eq_fn' 2024-05-16T21:33:11.907 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/eq_fn/eq_by_less.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/eq_fn/eq_by_less.hpp' 2024-05-16T21:33:11.907 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/eq_fn/hash_eq_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/eq_fn/hash_eq_fn.hpp' 2024-05-16T21:33:11.961 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_' 2024-05-16T21:33:11.961 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.962 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/gp_ht_map_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/gp_ht_map_.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/info_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/iterator_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/iterator_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/policy_access_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_no_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_store_hash_fn_imps.hpp' 2024-05-16T21:33:11.963 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/trace_fn_imps.hpp' 2024-05-16T21:33:12.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/direct_mask_range_hashing_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/direct_mask_range_hashing_imp.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/direct_mod_range_hashing_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/direct_mod_range_hashing_imp.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/linear_probe_fn_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/linear_probe_fn_imp.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/mask_based_range_hashing.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/mask_based_range_hashing.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/mod_based_range_hashing.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/mod_based_range_hashing.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/probe_fn_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/probe_fn_base.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/quadratic_probe_fn_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/quadratic_probe_fn_imp.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/ranged_hash_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/ranged_hash_fn.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/ranged_probe_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/ranged_probe_fn.hpp' 2024-05-16T21:33:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/sample_probe_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/sample_probe_fn.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/sample_range_hashing.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/sample_range_hashing.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/sample_ranged_hash_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/sample_ranged_hash_fn.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/sample_ranged_probe_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/sample_ranged_probe_fn.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/const_iterator.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/debug_fn_imps.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/erase_fn_imps.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/info_fn_imps.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/insert_fn_imps.hpp' 2024-05-16T21:33:12.037 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/iterators_fn_imps.hpp' 2024-05-16T21:33:12.038 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/left_child_next_sibling_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/left_child_next_sibling_heap_.hpp' 2024-05-16T21:33:12.038 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/node.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/node.hpp' 2024-05-16T21:33:12.038 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/point_const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/point_const_iterator.hpp' 2024-05-16T21:33:12.038 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/policy_access_fn_imps.hpp' 2024-05-16T21:33:12.152 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/trace_fn_imps.hpp' 2024-05-16T21:33:12.152 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/constructor_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/constructor_destructor_fn_imps.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/debug_fn_imps.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/entry_metadata_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/entry_metadata_base.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/erase_fn_imps.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/find_fn_imps.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/info_fn_imps.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/insert_fn_imps.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/iterators_fn_imps.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/lu_map_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/lu_map_.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/trace_fn_imps.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_policy' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_policy/lu_counter_metadata.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_policy/lu_counter_metadata.hpp' 2024-05-16T21:33:12.153 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_policy/sample_update_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_policy/sample_update_policy.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/debug_fn_imps.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/erase_fn_imps.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/info_fn_imps.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/insert_fn_imps.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/iterators_fn_imps.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/node_iterators.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/node_iterators.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/ov_tree_map_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/ov_tree_map_.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/policy_access_fn_imps.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/split_join_fn_imps.hpp' 2024-05-16T21:33:12.154 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/traits.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/debug_fn_imps.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/erase_fn_imps.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/find_fn_imps.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/insert_fn_imps.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/pairing_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/pairing_heap_.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/split_join_fn_imps.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:12.240 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/debug_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/erase_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/find_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/info_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/insert_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/insert_join_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/iterators_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/pat_trie_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/pat_trie_.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/pat_trie_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/pat_trie_base.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/policy_access_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/r_erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/r_erase_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/rotate_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/rotate_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/split_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/split_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/synth_access_traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/synth_access_traits.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/trace_fn_imps.hpp' 2024-05-16T21:33:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/traits.hpp' 2024-05-16T21:33:12.242 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/update_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/update_fn_imps.hpp' 2024-05-16T21:33:12.242 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/priority_queue_base_dispatch.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/priority_queue_base_dispatch.hpp' 2024-05-16T21:33:12.242 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_' 2024-05-16T21:33:12.242 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/debug_fn_imps.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/erase_fn_imps.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/find_fn_imps.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/info_fn_imps.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/insert_fn_imps.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/node.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/node.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/rb_tree_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/rb_tree_.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/split_join_fn_imps.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/traits.hpp' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_' 2024-05-16T21:33:12.315 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/debug_fn_imps.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/erase_fn_imps.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/insert_fn_imps.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/rc.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/rc.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/rc_binomial_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/rc_binomial_heap_.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/split_join_fn_imps.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/trace_fn_imps.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/cc_hash_max_collision_check_resize_trigger_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/cc_hash_max_collision_check_resize_trigger_imp.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_exponential_size_policy_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_exponential_size_policy_imp.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_load_check_resize_trigger_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_load_check_resize_trigger_imp.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_load_check_resize_trigger_size_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_load_check_resize_trigger_size_base.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_prime_size_policy_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_prime_size_policy_imp.hpp' 2024-05-16T21:33:12.316 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_standard_resize_policy_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_standard_resize_policy_imp.hpp' 2024-05-16T21:33:12.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/sample_resize_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/sample_resize_policy.hpp' 2024-05-16T21:33:12.317 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/sample_resize_trigger.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/sample_resize_trigger.hpp' 2024-05-16T21:33:12.397 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/sample_size_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/sample_size_policy.hpp' 2024-05-16T21:33:12.397 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/debug_fn_imps.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/erase_fn_imps.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/find_fn_imps.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/info_fn_imps.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/insert_fn_imps.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/node.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/node.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/splay_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/splay_fn_imps.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/splay_tree_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/splay_tree_.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/split_join_fn_imps.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/traits.hpp' 2024-05-16T21:33:12.398 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/standard_policies.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/standard_policies.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/debug_fn_imps.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/erase_fn_imps.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/find_fn_imps.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/insert_fn_imps.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/split_join_fn_imps.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/thin_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/thin_heap_.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/trace_fn_imps.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_policy' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_policy/node_metadata_selector.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_policy/node_metadata_selector.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_policy/order_statistics_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_policy/order_statistics_imp.hpp' 2024-05-16T21:33:12.399 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_policy/sample_tree_node_update.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_policy/sample_tree_node_update.hpp' 2024-05-16T21:33:12.400 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_trace_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_trace_base.hpp' 2024-05-16T21:33:12.400 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy' 2024-05-16T21:33:12.400 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/node_metadata_selector.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/node_metadata_selector.hpp' 2024-05-16T21:33:12.522 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/order_statistics_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/order_statistics_imp.hpp' 2024-05-16T21:33:12.522 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/prefix_search_node_update_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/prefix_search_node_update_imp.hpp' 2024-05-16T21:33:12.522 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/sample_trie_access_traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/sample_trie_access_traits.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/sample_trie_node_update.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/sample_trie_node_update.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/trie_policy_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/trie_policy_base.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/trie_string_access_traits_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/trie_string_access_traits_imp.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/type_utils.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/type_utils.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/types_traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/types_traits.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator/const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator/const_iterator.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator/iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator/iterator.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator/point_const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator/point_const_iterator.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator/point_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator/point_iterator.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/exception.hpp' -> 'dir/include/c++/11/ext/pb_ds/exception.hpp' 2024-05-16T21:33:12.523 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/hash_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/hash_policy.hpp' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/list_update_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/list_update_policy.hpp' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/priority_queue.hpp' -> 'dir/include/c++/11/ext/pb_ds/priority_queue.hpp' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/tag_and_trait.hpp' -> 'dir/include/c++/11/ext/pb_ds/tag_and_trait.hpp' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/tree_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/tree_policy.hpp' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pb_ds/trie_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/trie_policy.hpp' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pod_char_traits.h' -> 'dir/include/c++/11/ext/pod_char_traits.h' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pointer.h' -> 'dir/include/c++/11/ext/pointer.h' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/pool_allocator.h' -> 'dir/include/c++/11/ext/pool_allocator.h' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/random' -> 'dir/include/c++/11/ext/random' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/random.tcc' -> 'dir/include/c++/11/ext/random.tcc' 2024-05-16T21:33:12.524 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/rb_tree' -> 'dir/include/c++/11/ext/rb_tree' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/rc_string_base.h' -> 'dir/include/c++/11/ext/rc_string_base.h' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/rope' -> 'dir/include/c++/11/ext/rope' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/ropeimpl.h' -> 'dir/include/c++/11/ext/ropeimpl.h' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/slist' -> 'dir/include/c++/11/ext/slist' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/sso_string_base.h' -> 'dir/include/c++/11/ext/sso_string_base.h' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/stdio_filebuf.h' -> 'dir/include/c++/11/ext/stdio_filebuf.h' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/stdio_sync_filebuf.h' -> 'dir/include/c++/11/ext/stdio_sync_filebuf.h' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/string_conversions.h' -> 'dir/include/c++/11/ext/string_conversions.h' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/throw_allocator.h' -> 'dir/include/c++/11/ext/throw_allocator.h' 2024-05-16T21:33:12.525 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/type_traits.h' -> 'dir/include/c++/11/ext/type_traits.h' 2024-05-16T21:33:12.526 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/typelist.h' -> 'dir/include/c++/11/ext/typelist.h' 2024-05-16T21:33:12.526 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/vstring.h' -> 'dir/include/c++/11/ext/vstring.h' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/vstring.tcc' -> 'dir/include/c++/11/ext/vstring.tcc' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/vstring_fwd.h' -> 'dir/include/c++/11/ext/vstring_fwd.h' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ext/vstring_util.h' -> 'dir/include/c++/11/ext/vstring_util.h' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/fenv.h' -> 'dir/include/c++/11/fenv.h' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/filesystem' -> 'dir/include/c++/11/filesystem' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/forward_list' -> 'dir/include/c++/11/forward_list' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/fstream' -> 'dir/include/c++/11/fstream' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/functional' -> 'dir/include/c++/11/functional' 2024-05-16T21:33:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/future' -> 'dir/include/c++/11/future' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/initializer_list' -> 'dir/include/c++/11/initializer_list' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/iomanip' -> 'dir/include/c++/11/iomanip' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ios' -> 'dir/include/c++/11/ios' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/iosfwd' -> 'dir/include/c++/11/iosfwd' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/iostream' -> 'dir/include/c++/11/iostream' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/istream' -> 'dir/include/c++/11/istream' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/iterator' -> 'dir/include/c++/11/iterator' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/latch' -> 'dir/include/c++/11/latch' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/limits' -> 'dir/include/c++/11/limits' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/list' -> 'dir/include/c++/11/list' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/locale' -> 'dir/include/c++/11/locale' 2024-05-16T21:33:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/map' -> 'dir/include/c++/11/map' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/math.h' -> 'dir/include/c++/11/math.h' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/memory' -> 'dir/include/c++/11/memory' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/memory_resource' -> 'dir/include/c++/11/memory_resource' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/mutex' -> 'dir/include/c++/11/mutex' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/new' -> 'dir/include/c++/11/new' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/numbers' -> 'dir/include/c++/11/numbers' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/numeric' -> 'dir/include/c++/11/numeric' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/optional' -> 'dir/include/c++/11/optional' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ostream' -> 'dir/include/c++/11/ostream' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel' -> 'dir/include/c++/11/parallel' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/algo.h' -> 'dir/include/c++/11/parallel/algo.h' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/algobase.h' -> 'dir/include/c++/11/parallel/algobase.h' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/algorithm' -> 'dir/include/c++/11/parallel/algorithm' 2024-05-16T21:33:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/algorithmfwd.h' -> 'dir/include/c++/11/parallel/algorithmfwd.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/balanced_quicksort.h' -> 'dir/include/c++/11/parallel/balanced_quicksort.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/base.h' -> 'dir/include/c++/11/parallel/base.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/basic_iterator.h' -> 'dir/include/c++/11/parallel/basic_iterator.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/checkers.h' -> 'dir/include/c++/11/parallel/checkers.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/compatibility.h' -> 'dir/include/c++/11/parallel/compatibility.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/compiletime_settings.h' -> 'dir/include/c++/11/parallel/compiletime_settings.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/equally_split.h' -> 'dir/include/c++/11/parallel/equally_split.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/features.h' -> 'dir/include/c++/11/parallel/features.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/find.h' -> 'dir/include/c++/11/parallel/find.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/find_selectors.h' -> 'dir/include/c++/11/parallel/find_selectors.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/for_each.h' -> 'dir/include/c++/11/parallel/for_each.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/for_each_selectors.h' -> 'dir/include/c++/11/parallel/for_each_selectors.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/iterator.h' -> 'dir/include/c++/11/parallel/iterator.h' 2024-05-16T21:33:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/list_partition.h' -> 'dir/include/c++/11/parallel/list_partition.h' 2024-05-16T21:33:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/losertree.h' -> 'dir/include/c++/11/parallel/losertree.h' 2024-05-16T21:33:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/merge.h' -> 'dir/include/c++/11/parallel/merge.h' 2024-05-16T21:33:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/multiseq_selection.h' -> 'dir/include/c++/11/parallel/multiseq_selection.h' 2024-05-16T21:33:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/multiway_merge.h' -> 'dir/include/c++/11/parallel/multiway_merge.h' 2024-05-16T21:33:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/multiway_mergesort.h' -> 'dir/include/c++/11/parallel/multiway_mergesort.h' 2024-05-16T21:33:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/numeric' -> 'dir/include/c++/11/parallel/numeric' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/numericfwd.h' -> 'dir/include/c++/11/parallel/numericfwd.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/omp_loop.h' -> 'dir/include/c++/11/parallel/omp_loop.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/omp_loop_static.h' -> 'dir/include/c++/11/parallel/omp_loop_static.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/par_loop.h' -> 'dir/include/c++/11/parallel/par_loop.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/parallel.h' -> 'dir/include/c++/11/parallel/parallel.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/partial_sum.h' -> 'dir/include/c++/11/parallel/partial_sum.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/partition.h' -> 'dir/include/c++/11/parallel/partition.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/queue.h' -> 'dir/include/c++/11/parallel/queue.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/quicksort.h' -> 'dir/include/c++/11/parallel/quicksort.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/random_number.h' -> 'dir/include/c++/11/parallel/random_number.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/random_shuffle.h' -> 'dir/include/c++/11/parallel/random_shuffle.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/search.h' -> 'dir/include/c++/11/parallel/search.h' 2024-05-16T21:33:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/set_operations.h' -> 'dir/include/c++/11/parallel/set_operations.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/settings.h' -> 'dir/include/c++/11/parallel/settings.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/sort.h' -> 'dir/include/c++/11/parallel/sort.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/tags.h' -> 'dir/include/c++/11/parallel/tags.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/types.h' -> 'dir/include/c++/11/parallel/types.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/unique_copy.h' -> 'dir/include/c++/11/parallel/unique_copy.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/parallel/workstealing.h' -> 'dir/include/c++/11/parallel/workstealing.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl' -> 'dir/include/c++/11/pstl' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/algorithm_fwd.h' -> 'dir/include/c++/11/pstl/algorithm_fwd.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/algorithm_impl.h' -> 'dir/include/c++/11/pstl/algorithm_impl.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/execution_defs.h' -> 'dir/include/c++/11/pstl/execution_defs.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/execution_impl.h' -> 'dir/include/c++/11/pstl/execution_impl.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/glue_algorithm_defs.h' -> 'dir/include/c++/11/pstl/glue_algorithm_defs.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/glue_algorithm_impl.h' -> 'dir/include/c++/11/pstl/glue_algorithm_impl.h' 2024-05-16T21:33:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/glue_execution_defs.h' -> 'dir/include/c++/11/pstl/glue_execution_defs.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/glue_memory_defs.h' -> 'dir/include/c++/11/pstl/glue_memory_defs.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/glue_memory_impl.h' -> 'dir/include/c++/11/pstl/glue_memory_impl.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/glue_numeric_defs.h' -> 'dir/include/c++/11/pstl/glue_numeric_defs.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/glue_numeric_impl.h' -> 'dir/include/c++/11/pstl/glue_numeric_impl.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/memory_impl.h' -> 'dir/include/c++/11/pstl/memory_impl.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/numeric_fwd.h' -> 'dir/include/c++/11/pstl/numeric_fwd.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/numeric_impl.h' -> 'dir/include/c++/11/pstl/numeric_impl.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/parallel_backend.h' -> 'dir/include/c++/11/pstl/parallel_backend.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/parallel_backend_serial.h' -> 'dir/include/c++/11/pstl/parallel_backend_serial.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/parallel_backend_tbb.h' -> 'dir/include/c++/11/pstl/parallel_backend_tbb.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/parallel_backend_utils.h' -> 'dir/include/c++/11/pstl/parallel_backend_utils.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/parallel_impl.h' -> 'dir/include/c++/11/pstl/parallel_impl.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/pstl_config.h' -> 'dir/include/c++/11/pstl/pstl_config.h' 2024-05-16T21:33:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/unseq_backend_simd.h' -> 'dir/include/c++/11/pstl/unseq_backend_simd.h' 2024-05-16T21:33:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/pstl/utils.h' -> 'dir/include/c++/11/pstl/utils.h' 2024-05-16T21:33:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/queue' -> 'dir/include/c++/11/queue' 2024-05-16T21:33:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/random' -> 'dir/include/c++/11/random' 2024-05-16T21:33:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ranges' -> 'dir/include/c++/11/ranges' 2024-05-16T21:33:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/ratio' -> 'dir/include/c++/11/ratio' 2024-05-16T21:33:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/regex' -> 'dir/include/c++/11/regex' 2024-05-16T21:33:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/scoped_allocator' -> 'dir/include/c++/11/scoped_allocator' 2024-05-16T21:33:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/semaphore' -> 'dir/include/c++/11/semaphore' 2024-05-16T21:33:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/set' -> 'dir/include/c++/11/set' 2024-05-16T21:33:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/shared_mutex' -> 'dir/include/c++/11/shared_mutex' 2024-05-16T21:33:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/source_location' -> 'dir/include/c++/11/source_location' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/span' -> 'dir/include/c++/11/span' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/sstream' -> 'dir/include/c++/11/sstream' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/stack' -> 'dir/include/c++/11/stack' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/stdexcept' -> 'dir/include/c++/11/stdexcept' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/stdlib.h' -> 'dir/include/c++/11/stdlib.h' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/stop_token' -> 'dir/include/c++/11/stop_token' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/streambuf' -> 'dir/include/c++/11/streambuf' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/string' -> 'dir/include/c++/11/string' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/string_view' -> 'dir/include/c++/11/string_view' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/syncstream' -> 'dir/include/c++/11/syncstream' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/system_error' -> 'dir/include/c++/11/system_error' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tgmath.h' -> 'dir/include/c++/11/tgmath.h' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/thread' -> 'dir/include/c++/11/thread' 2024-05-16T21:33:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1' -> 'dir/include/c++/11/tr1' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/array' -> 'dir/include/c++/11/tr1/array' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/bessel_function.tcc' -> 'dir/include/c++/11/tr1/bessel_function.tcc' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/beta_function.tcc' -> 'dir/include/c++/11/tr1/beta_function.tcc' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/ccomplex' -> 'dir/include/c++/11/tr1/ccomplex' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cctype' -> 'dir/include/c++/11/tr1/cctype' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cfenv' -> 'dir/include/c++/11/tr1/cfenv' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cfloat' -> 'dir/include/c++/11/tr1/cfloat' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cinttypes' -> 'dir/include/c++/11/tr1/cinttypes' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/climits' -> 'dir/include/c++/11/tr1/climits' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cmath' -> 'dir/include/c++/11/tr1/cmath' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/complex' -> 'dir/include/c++/11/tr1/complex' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/complex.h' -> 'dir/include/c++/11/tr1/complex.h' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cstdarg' -> 'dir/include/c++/11/tr1/cstdarg' 2024-05-16T21:33:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cstdbool' -> 'dir/include/c++/11/tr1/cstdbool' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cstdint' -> 'dir/include/c++/11/tr1/cstdint' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cstdio' -> 'dir/include/c++/11/tr1/cstdio' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cstdlib' -> 'dir/include/c++/11/tr1/cstdlib' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/ctgmath' -> 'dir/include/c++/11/tr1/ctgmath' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/ctime' -> 'dir/include/c++/11/tr1/ctime' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/ctype.h' -> 'dir/include/c++/11/tr1/ctype.h' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cwchar' -> 'dir/include/c++/11/tr1/cwchar' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/cwctype' -> 'dir/include/c++/11/tr1/cwctype' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/ell_integral.tcc' -> 'dir/include/c++/11/tr1/ell_integral.tcc' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/exp_integral.tcc' -> 'dir/include/c++/11/tr1/exp_integral.tcc' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/fenv.h' -> 'dir/include/c++/11/tr1/fenv.h' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/float.h' -> 'dir/include/c++/11/tr1/float.h' 2024-05-16T21:33:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/functional' -> 'dir/include/c++/11/tr1/functional' 2024-05-16T21:33:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/functional_hash.h' -> 'dir/include/c++/11/tr1/functional_hash.h' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/gamma.tcc' -> 'dir/include/c++/11/tr1/gamma.tcc' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/hashtable.h' -> 'dir/include/c++/11/tr1/hashtable.h' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/hashtable_policy.h' -> 'dir/include/c++/11/tr1/hashtable_policy.h' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/hypergeometric.tcc' -> 'dir/include/c++/11/tr1/hypergeometric.tcc' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/inttypes.h' -> 'dir/include/c++/11/tr1/inttypes.h' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/legendre_function.tcc' -> 'dir/include/c++/11/tr1/legendre_function.tcc' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/limits.h' -> 'dir/include/c++/11/tr1/limits.h' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/math.h' -> 'dir/include/c++/11/tr1/math.h' 2024-05-16T21:33:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/memory' -> 'dir/include/c++/11/tr1/memory' 2024-05-16T21:33:13.046 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/modified_bessel_func.tcc' -> 'dir/include/c++/11/tr1/modified_bessel_func.tcc' 2024-05-16T21:33:13.046 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/poly_hermite.tcc' -> 'dir/include/c++/11/tr1/poly_hermite.tcc' 2024-05-16T21:33:13.046 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/poly_laguerre.tcc' -> 'dir/include/c++/11/tr1/poly_laguerre.tcc' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/random' -> 'dir/include/c++/11/tr1/random' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/random.h' -> 'dir/include/c++/11/tr1/random.h' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/random.tcc' -> 'dir/include/c++/11/tr1/random.tcc' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/regex' -> 'dir/include/c++/11/tr1/regex' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/riemann_zeta.tcc' -> 'dir/include/c++/11/tr1/riemann_zeta.tcc' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/shared_ptr.h' -> 'dir/include/c++/11/tr1/shared_ptr.h' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/special_function_util.h' -> 'dir/include/c++/11/tr1/special_function_util.h' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/stdarg.h' -> 'dir/include/c++/11/tr1/stdarg.h' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/stdbool.h' -> 'dir/include/c++/11/tr1/stdbool.h' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/stdint.h' -> 'dir/include/c++/11/tr1/stdint.h' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/stdio.h' -> 'dir/include/c++/11/tr1/stdio.h' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/stdlib.h' -> 'dir/include/c++/11/tr1/stdlib.h' 2024-05-16T21:33:13.047 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/tgmath.h' -> 'dir/include/c++/11/tr1/tgmath.h' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/tuple' -> 'dir/include/c++/11/tr1/tuple' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/type_traits' -> 'dir/include/c++/11/tr1/type_traits' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/unordered_map' -> 'dir/include/c++/11/tr1/unordered_map' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/unordered_map.h' -> 'dir/include/c++/11/tr1/unordered_map.h' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/unordered_set' -> 'dir/include/c++/11/tr1/unordered_set' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/unordered_set.h' -> 'dir/include/c++/11/tr1/unordered_set.h' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/utility' -> 'dir/include/c++/11/tr1/utility' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/wchar.h' -> 'dir/include/c++/11/tr1/wchar.h' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr1/wctype.h' -> 'dir/include/c++/11/tr1/wctype.h' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr2' -> 'dir/include/c++/11/tr2' 2024-05-16T21:33:13.048 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr2/bool_set' -> 'dir/include/c++/11/tr2/bool_set' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr2/bool_set.tcc' -> 'dir/include/c++/11/tr2/bool_set.tcc' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr2/dynamic_bitset' -> 'dir/include/c++/11/tr2/dynamic_bitset' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr2/dynamic_bitset.tcc' -> 'dir/include/c++/11/tr2/dynamic_bitset.tcc' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr2/ratio' -> 'dir/include/c++/11/tr2/ratio' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tr2/type_traits' -> 'dir/include/c++/11/tr2/type_traits' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/tuple' -> 'dir/include/c++/11/tuple' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/type_traits' -> 'dir/include/c++/11/type_traits' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/typeindex' -> 'dir/include/c++/11/typeindex' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/typeinfo' -> 'dir/include/c++/11/typeinfo' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/unordered_map' -> 'dir/include/c++/11/unordered_map' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/unordered_set' -> 'dir/include/c++/11/unordered_set' 2024-05-16T21:33:13.049 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/utility' -> 'dir/include/c++/11/utility' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/valarray' -> 'dir/include/c++/11/valarray' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/variant' -> 'dir/include/c++/11/variant' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/vector' -> 'dir/include/c++/11/vector' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/version' -> 'dir/include/c++/11/version' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux' -> 'dir/include/c++/11/x86_64-redhat-linux' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32' -> 'dir/include/c++/11/x86_64-redhat-linux/32' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/atomic_word.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/atomic_word.h' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/basic_file.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/basic_file.h' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/c++allocator.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/c++allocator.h' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/c++config.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/c++config.h' 2024-05-16T21:33:13.050 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/c++io.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/c++io.h' 2024-05-16T21:33:13.142 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/c++locale.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/c++locale.h' 2024-05-16T21:33:13.142 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/cpu_defines.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/cpu_defines.h' 2024-05-16T21:33:13.142 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/ctype_base.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/ctype_base.h' 2024-05-16T21:33:13.142 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/ctype_inline.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/ctype_inline.h' 2024-05-16T21:33:13.142 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/cxxabi_tweaks.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/cxxabi_tweaks.h' 2024-05-16T21:33:13.142 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/error_constants.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/error_constants.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/extc++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/extc++.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/gthr-default.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/gthr-default.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/gthr-posix.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/gthr-posix.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/gthr-single.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/gthr-single.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/gthr.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/gthr.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/messages_members.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/messages_members.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/opt_random.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/opt_random.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/os_defines.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/os_defines.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/stdc++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/stdc++.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/stdtr1c++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/stdtr1c++.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/time_members.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/time_members.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/ext' -> 'dir/include/c++/11/x86_64-redhat-linux/32/ext' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/ext/opt_random.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/ext/opt_random.h' 2024-05-16T21:33:13.143 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits' -> 'dir/include/c++/11/x86_64-redhat-linux/bits' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/atomic_word.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/atomic_word.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/basic_file.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/basic_file.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/c++allocator.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/c++allocator.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/c++config.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/c++config.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/c++io.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/c++io.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/c++locale.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/c++locale.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/cpu_defines.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/cpu_defines.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/ctype_base.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/ctype_base.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/ctype_inline.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/ctype_inline.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/cxxabi_tweaks.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/cxxabi_tweaks.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/error_constants.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/error_constants.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/extc++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/extc++.h' 2024-05-16T21:33:13.144 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/gthr-default.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/gthr-default.h' 2024-05-16T21:33:13.293 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/gthr-posix.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/gthr-posix.h' 2024-05-16T21:33:13.293 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/gthr-single.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/gthr-single.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/gthr.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/gthr.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/messages_members.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/messages_members.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/opt_random.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/opt_random.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/os_defines.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/os_defines.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/stdc++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/stdc++.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/stdtr1c++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/stdtr1c++.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/time_members.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/time_members.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/ext' -> 'dir/include/c++/11/x86_64-redhat-linux/ext' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/c++/11/x86_64-redhat-linux/ext/opt_random.h' -> 'dir/include/c++/11/x86_64-redhat-linux/ext/opt_random.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/lualib.h' -> 'dir/include/lualib.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/arpa' -> 'dir/include/arpa' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/arpa/ftp.h' -> 'dir/include/arpa/ftp.h' 2024-05-16T21:33:13.294 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/arpa/inet.h' -> 'dir/include/arpa/inet.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/arpa/nameser.h' -> 'dir/include/arpa/nameser.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/arpa/nameser_compat.h' -> 'dir/include/arpa/nameser_compat.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/arpa/telnet.h' -> 'dir/include/arpa/telnet.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/arpa/tftp.h' -> 'dir/include/arpa/tftp.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits' -> 'dir/include/bits' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/a.out.h' -> 'dir/include/bits/a.out.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/argp-ldbl.h' -> 'dir/include/bits/argp-ldbl.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/byteswap.h' -> 'dir/include/bits/byteswap.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/cmathcalls.h' -> 'dir/include/bits/cmathcalls.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/confname.h' -> 'dir/include/bits/confname.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/cpu-set.h' -> 'dir/include/bits/cpu-set.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/dirent.h' -> 'dir/include/bits/dirent.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/dirent_ext.h' -> 'dir/include/bits/dirent_ext.h' 2024-05-16T21:33:13.295 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/dlfcn.h' -> 'dir/include/bits/dlfcn.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/elfclass.h' -> 'dir/include/bits/elfclass.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/endian.h' -> 'dir/include/bits/endian.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/endianness.h' -> 'dir/include/bits/endianness.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/environments.h' -> 'dir/include/bits/environments.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/epoll.h' -> 'dir/include/bits/epoll.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/err-ldbl.h' -> 'dir/include/bits/err-ldbl.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/errno.h' -> 'dir/include/bits/errno.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/error-ldbl.h' -> 'dir/include/bits/error-ldbl.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/error.h' -> 'dir/include/bits/error.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/eventfd.h' -> 'dir/include/bits/eventfd.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/fcntl-linux.h' -> 'dir/include/bits/fcntl-linux.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/fcntl.h' -> 'dir/include/bits/fcntl.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/fcntl2.h' -> 'dir/include/bits/fcntl2.h' 2024-05-16T21:33:13.296 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/fenv.h' -> 'dir/include/bits/fenv.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/floatn-common.h' -> 'dir/include/bits/floatn-common.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/floatn.h' -> 'dir/include/bits/floatn.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/flt-eval-method.h' -> 'dir/include/bits/flt-eval-method.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/fp-fast.h' -> 'dir/include/bits/fp-fast.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/fp-logb.h' -> 'dir/include/bits/fp-logb.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/getopt_core.h' -> 'dir/include/bits/getopt_core.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/getopt_ext.h' -> 'dir/include/bits/getopt_ext.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/getopt_posix.h' -> 'dir/include/bits/getopt_posix.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/hwcap.h' -> 'dir/include/bits/hwcap.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/in.h' -> 'dir/include/bits/in.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/indirect-return.h' -> 'dir/include/bits/indirect-return.h' 2024-05-16T21:33:13.297 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/initspin.h' -> 'dir/include/bits/initspin.h' 2024-05-16T21:33:13.298 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/inotify.h' -> 'dir/include/bits/inotify.h' 2024-05-16T21:33:13.418 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/ioctl-types.h' -> 'dir/include/bits/ioctl-types.h' 2024-05-16T21:33:13.418 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/ioctls.h' -> 'dir/include/bits/ioctls.h' 2024-05-16T21:33:13.418 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/ipc-perm.h' -> 'dir/include/bits/ipc-perm.h' 2024-05-16T21:33:13.418 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/ipc.h' -> 'dir/include/bits/ipc.h' 2024-05-16T21:33:13.418 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/ipctypes.h' -> 'dir/include/bits/ipctypes.h' 2024-05-16T21:33:13.418 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/iscanonical.h' -> 'dir/include/bits/iscanonical.h' 2024-05-16T21:33:13.418 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/libc-header-start.h' -> 'dir/include/bits/libc-header-start.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/libm-simd-decl-stubs.h' -> 'dir/include/bits/libm-simd-decl-stubs.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/link.h' -> 'dir/include/bits/link.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/link_lavcurrent.h' -> 'dir/include/bits/link_lavcurrent.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/local_lim.h' -> 'dir/include/bits/local_lim.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/locale.h' -> 'dir/include/bits/locale.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/long-double.h' -> 'dir/include/bits/long-double.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/math-vector.h' -> 'dir/include/bits/math-vector.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mathcalls-helper-functions.h' -> 'dir/include/bits/mathcalls-helper-functions.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mathcalls-narrow.h' -> 'dir/include/bits/mathcalls-narrow.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mathcalls.h' -> 'dir/include/bits/mathcalls.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mathdef.h' -> 'dir/include/bits/mathdef.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mman-linux.h' -> 'dir/include/bits/mman-linux.h' 2024-05-16T21:33:13.419 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mman-map-flags-generic.h' -> 'dir/include/bits/mman-map-flags-generic.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mman-shared.h' -> 'dir/include/bits/mman-shared.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mman.h' -> 'dir/include/bits/mman.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/monetary-ldbl.h' -> 'dir/include/bits/monetary-ldbl.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mqueue.h' -> 'dir/include/bits/mqueue.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/mqueue2.h' -> 'dir/include/bits/mqueue2.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/msq.h' -> 'dir/include/bits/msq.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/netdb.h' -> 'dir/include/bits/netdb.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/param.h' -> 'dir/include/bits/param.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/platform' -> 'dir/include/bits/platform' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/platform/x86.h' -> 'dir/include/bits/platform/x86.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/poll.h' -> 'dir/include/bits/poll.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/poll2.h' -> 'dir/include/bits/poll2.h' 2024-05-16T21:33:13.420 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/posix1_lim.h' -> 'dir/include/bits/posix1_lim.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/posix2_lim.h' -> 'dir/include/bits/posix2_lim.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/posix_opt.h' -> 'dir/include/bits/posix_opt.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/printf-ldbl.h' -> 'dir/include/bits/printf-ldbl.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/procfs-extra.h' -> 'dir/include/bits/procfs-extra.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/procfs-id.h' -> 'dir/include/bits/procfs-id.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/procfs-prregset.h' -> 'dir/include/bits/procfs-prregset.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/procfs.h' -> 'dir/include/bits/procfs.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/pthread_stack_min-dynamic.h' -> 'dir/include/bits/pthread_stack_min-dynamic.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/pthread_stack_min.h' -> 'dir/include/bits/pthread_stack_min.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/pthreadtypes-arch.h' -> 'dir/include/bits/pthreadtypes-arch.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/pthreadtypes.h' -> 'dir/include/bits/pthreadtypes.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/ptrace-shared.h' -> 'dir/include/bits/ptrace-shared.h' 2024-05-16T21:33:13.421 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/resource.h' -> 'dir/include/bits/resource.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/rseq.h' -> 'dir/include/bits/rseq.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sched.h' -> 'dir/include/bits/sched.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/select.h' -> 'dir/include/bits/select.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/select2.h' -> 'dir/include/bits/select2.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sem.h' -> 'dir/include/bits/sem.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/semaphore.h' -> 'dir/include/bits/semaphore.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/setjmp.h' -> 'dir/include/bits/setjmp.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/setjmp2.h' -> 'dir/include/bits/setjmp2.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/shm.h' -> 'dir/include/bits/shm.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/shmlba.h' -> 'dir/include/bits/shmlba.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sigaction.h' -> 'dir/include/bits/sigaction.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sigcontext.h' -> 'dir/include/bits/sigcontext.h' 2024-05-16T21:33:13.422 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sigevent-consts.h' -> 'dir/include/bits/sigevent-consts.h' 2024-05-16T21:33:13.423 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/siginfo-arch.h' -> 'dir/include/bits/siginfo-arch.h' 2024-05-16T21:33:13.540 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/siginfo-consts-arch.h' -> 'dir/include/bits/siginfo-consts-arch.h' 2024-05-16T21:33:13.540 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/siginfo-consts.h' -> 'dir/include/bits/siginfo-consts.h' 2024-05-16T21:33:13.540 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/signal_ext.h' -> 'dir/include/bits/signal_ext.h' 2024-05-16T21:33:13.540 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/signalfd.h' -> 'dir/include/bits/signalfd.h' 2024-05-16T21:33:13.540 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/signum-arch.h' -> 'dir/include/bits/signum-arch.h' 2024-05-16T21:33:13.540 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/signum-generic.h' -> 'dir/include/bits/signum-generic.h' 2024-05-16T21:33:13.540 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sigstack.h' -> 'dir/include/bits/sigstack.h' 2024-05-16T21:33:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sigstksz.h' -> 'dir/include/bits/sigstksz.h' 2024-05-16T21:33:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sigthread.h' -> 'dir/include/bits/sigthread.h' 2024-05-16T21:33:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sockaddr.h' -> 'dir/include/bits/sockaddr.h' 2024-05-16T21:33:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/socket-constants.h' -> 'dir/include/bits/socket-constants.h' 2024-05-16T21:33:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/socket.h' -> 'dir/include/bits/socket.h' 2024-05-16T21:33:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/socket2.h' -> 'dir/include/bits/socket2.h' 2024-05-16T21:33:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/socket_type.h' -> 'dir/include/bits/socket_type.h' 2024-05-16T21:33:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/ss_flags.h' -> 'dir/include/bits/ss_flags.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stab.def' -> 'dir/include/bits/stab.def' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stat.h' -> 'dir/include/bits/stat.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/statfs.h' -> 'dir/include/bits/statfs.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/statvfs.h' -> 'dir/include/bits/statvfs.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/statx-generic.h' -> 'dir/include/bits/statx-generic.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/statx.h' -> 'dir/include/bits/statx.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdint-intn.h' -> 'dir/include/bits/stdint-intn.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdint-uintn.h' -> 'dir/include/bits/stdint-uintn.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdio-ldbl.h' -> 'dir/include/bits/stdio-ldbl.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdio.h' -> 'dir/include/bits/stdio.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdio2-decl.h' -> 'dir/include/bits/stdio2-decl.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdio2.h' -> 'dir/include/bits/stdio2.h' 2024-05-16T21:33:13.542 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdio_lim.h' -> 'dir/include/bits/stdio_lim.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdlib-bsearch.h' -> 'dir/include/bits/stdlib-bsearch.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdlib-float.h' -> 'dir/include/bits/stdlib-float.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdlib-ldbl.h' -> 'dir/include/bits/stdlib-ldbl.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/stdlib.h' -> 'dir/include/bits/stdlib.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/string_fortified.h' -> 'dir/include/bits/string_fortified.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/strings_fortified.h' -> 'dir/include/bits/strings_fortified.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/struct_mutex.h' -> 'dir/include/bits/struct_mutex.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/struct_rwlock.h' -> 'dir/include/bits/struct_rwlock.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/struct_stat.h' -> 'dir/include/bits/struct_stat.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/struct_stat_time64_helper.h' -> 'dir/include/bits/struct_stat_time64_helper.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/syscall.h' -> 'dir/include/bits/syscall.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/syslog-ldbl.h' -> 'dir/include/bits/syslog-ldbl.h' 2024-05-16T21:33:13.543 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/syslog-path.h' -> 'dir/include/bits/syslog-path.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/syslog.h' -> 'dir/include/bits/syslog.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/sysmacros.h' -> 'dir/include/bits/sysmacros.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-baud.h' -> 'dir/include/bits/termios-baud.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-c_cc.h' -> 'dir/include/bits/termios-c_cc.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-c_cflag.h' -> 'dir/include/bits/termios-c_cflag.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-c_iflag.h' -> 'dir/include/bits/termios-c_iflag.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-c_lflag.h' -> 'dir/include/bits/termios-c_lflag.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-c_oflag.h' -> 'dir/include/bits/termios-c_oflag.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-misc.h' -> 'dir/include/bits/termios-misc.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-struct.h' -> 'dir/include/bits/termios-struct.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios-tcflow.h' -> 'dir/include/bits/termios-tcflow.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/termios.h' -> 'dir/include/bits/termios.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/thread-shared-types.h' -> 'dir/include/bits/thread-shared-types.h' 2024-05-16T21:33:13.544 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/time.h' -> 'dir/include/bits/time.h' 2024-05-16T21:33:13.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/time64.h' -> 'dir/include/bits/time64.h' 2024-05-16T21:33:13.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/timerfd.h' -> 'dir/include/bits/timerfd.h' 2024-05-16T21:33:13.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/timesize.h' -> 'dir/include/bits/timesize.h' 2024-05-16T21:33:13.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/timex.h' -> 'dir/include/bits/timex.h' 2024-05-16T21:33:13.545 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types.h' -> 'dir/include/bits/types.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types' -> 'dir/include/bits/types' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/FILE.h' -> 'dir/include/bits/types/FILE.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/__FILE.h' -> 'dir/include/bits/types/__FILE.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/__fpos64_t.h' -> 'dir/include/bits/types/__fpos64_t.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/__fpos_t.h' -> 'dir/include/bits/types/__fpos_t.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/__locale_t.h' -> 'dir/include/bits/types/__locale_t.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/__mbstate_t.h' -> 'dir/include/bits/types/__mbstate_t.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/__sigset_t.h' -> 'dir/include/bits/types/__sigset_t.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/__sigval_t.h' -> 'dir/include/bits/types/__sigval_t.h' 2024-05-16T21:33:13.637 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/clock_t.h' -> 'dir/include/bits/types/clock_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/clockid_t.h' -> 'dir/include/bits/types/clockid_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/cookie_io_functions_t.h' -> 'dir/include/bits/types/cookie_io_functions_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/error_t.h' -> 'dir/include/bits/types/error_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/locale_t.h' -> 'dir/include/bits/types/locale_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/mbstate_t.h' -> 'dir/include/bits/types/mbstate_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/res_state.h' -> 'dir/include/bits/types/res_state.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/sig_atomic_t.h' -> 'dir/include/bits/types/sig_atomic_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/sigevent_t.h' -> 'dir/include/bits/types/sigevent_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/siginfo_t.h' -> 'dir/include/bits/types/siginfo_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/sigset_t.h' -> 'dir/include/bits/types/sigset_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/sigval_t.h' -> 'dir/include/bits/types/sigval_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/stack_t.h' -> 'dir/include/bits/types/stack_t.h' 2024-05-16T21:33:13.638 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_FILE.h' -> 'dir/include/bits/types/struct_FILE.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct___jmp_buf_tag.h' -> 'dir/include/bits/types/struct___jmp_buf_tag.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_iovec.h' -> 'dir/include/bits/types/struct_iovec.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_itimerspec.h' -> 'dir/include/bits/types/struct_itimerspec.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_msqid64_ds.h' -> 'dir/include/bits/types/struct_msqid64_ds.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_msqid64_ds_helper.h' -> 'dir/include/bits/types/struct_msqid64_ds_helper.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_msqid_ds.h' -> 'dir/include/bits/types/struct_msqid_ds.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_osockaddr.h' -> 'dir/include/bits/types/struct_osockaddr.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_rusage.h' -> 'dir/include/bits/types/struct_rusage.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_sched_param.h' -> 'dir/include/bits/types/struct_sched_param.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_semid64_ds.h' -> 'dir/include/bits/types/struct_semid64_ds.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_semid64_ds_helper.h' -> 'dir/include/bits/types/struct_semid64_ds_helper.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_semid_ds.h' -> 'dir/include/bits/types/struct_semid_ds.h' 2024-05-16T21:33:13.639 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_shmid64_ds.h' -> 'dir/include/bits/types/struct_shmid64_ds.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_shmid64_ds_helper.h' -> 'dir/include/bits/types/struct_shmid64_ds_helper.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_shmid_ds.h' -> 'dir/include/bits/types/struct_shmid_ds.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_sigstack.h' -> 'dir/include/bits/types/struct_sigstack.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_statx.h' -> 'dir/include/bits/types/struct_statx.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_statx_timestamp.h' -> 'dir/include/bits/types/struct_statx_timestamp.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_timeb.h' -> 'dir/include/bits/types/struct_timeb.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_timespec.h' -> 'dir/include/bits/types/struct_timespec.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_timeval.h' -> 'dir/include/bits/types/struct_timeval.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/struct_tm.h' -> 'dir/include/bits/types/struct_tm.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/time_t.h' -> 'dir/include/bits/types/time_t.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/timer_t.h' -> 'dir/include/bits/types/timer_t.h' 2024-05-16T21:33:13.640 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/types/wint_t.h' -> 'dir/include/bits/types/wint_t.h' 2024-05-16T21:33:13.882 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/typesizes.h' -> 'dir/include/bits/typesizes.h' 2024-05-16T21:33:13.882 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/uintn-identity.h' -> 'dir/include/bits/uintn-identity.h' 2024-05-16T21:33:13.882 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/uio-ext.h' -> 'dir/include/bits/uio-ext.h' 2024-05-16T21:33:13.882 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/uio_lim.h' -> 'dir/include/bits/uio_lim.h' 2024-05-16T21:33:13.882 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/unistd.h' -> 'dir/include/bits/unistd.h' 2024-05-16T21:33:13.882 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/unistd_ext.h' -> 'dir/include/bits/unistd_ext.h' 2024-05-16T21:33:13.882 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/utmp.h' -> 'dir/include/bits/utmp.h' 2024-05-16T21:33:13.882 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/utmpx.h' -> 'dir/include/bits/utmpx.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/utsname.h' -> 'dir/include/bits/utsname.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/waitflags.h' -> 'dir/include/bits/waitflags.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/waitstatus.h' -> 'dir/include/bits/waitstatus.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/wchar-ldbl.h' -> 'dir/include/bits/wchar-ldbl.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/wchar.h' -> 'dir/include/bits/wchar.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/wchar2-decl.h' -> 'dir/include/bits/wchar2-decl.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/wchar2.h' -> 'dir/include/bits/wchar2.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/wctype-wchar.h' -> 'dir/include/bits/wctype-wchar.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/wordsize.h' -> 'dir/include/bits/wordsize.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/bits/xopen_lim.h' -> 'dir/include/bits/xopen_lim.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/finclude' -> 'dir/include/finclude' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/finclude/math-vector-fortran.h' -> 'dir/include/finclude/math-vector-fortran.h' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gnu' -> 'dir/include/gnu' 2024-05-16T21:33:13.883 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gnu/lib-names.h' -> 'dir/include/gnu/lib-names.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gnu/libc-version.h' -> 'dir/include/gnu/libc-version.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gnu/stubs.h' -> 'dir/include/gnu/stubs.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gnu/lib-names-64.h' -> 'dir/include/gnu/lib-names-64.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gnu/stubs-64.h' -> 'dir/include/gnu/stubs-64.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net' -> 'dir/include/net' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/ethernet.h' -> 'dir/include/net/ethernet.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/if.h' -> 'dir/include/net/if.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/if_arp.h' -> 'dir/include/net/if_arp.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/if_packet.h' -> 'dir/include/net/if_packet.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/if_ppp.h' -> 'dir/include/net/if_ppp.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/if_shaper.h' -> 'dir/include/net/if_shaper.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/if_slip.h' -> 'dir/include/net/if_slip.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/ppp-comp.h' -> 'dir/include/net/ppp-comp.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/ppp_defs.h' -> 'dir/include/net/ppp_defs.h' 2024-05-16T21:33:13.884 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/net/route.h' -> 'dir/include/net/route.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netash' -> 'dir/include/netash' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netash/ash.h' -> 'dir/include/netash/ash.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netatalk' -> 'dir/include/netatalk' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netatalk/at.h' -> 'dir/include/netatalk/at.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netax25' -> 'dir/include/netax25' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netax25/ax25.h' -> 'dir/include/netax25/ax25.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/neteconet' -> 'dir/include/neteconet' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/neteconet/ec.h' -> 'dir/include/neteconet/ec.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet' -> 'dir/include/netinet' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/ether.h' -> 'dir/include/netinet/ether.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/icmp6.h' -> 'dir/include/netinet/icmp6.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/if_ether.h' -> 'dir/include/netinet/if_ether.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/if_fddi.h' -> 'dir/include/netinet/if_fddi.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/if_tr.h' -> 'dir/include/netinet/if_tr.h' 2024-05-16T21:33:13.885 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/igmp.h' -> 'dir/include/netinet/igmp.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/in.h' -> 'dir/include/netinet/in.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/in_systm.h' -> 'dir/include/netinet/in_systm.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/ip.h' -> 'dir/include/netinet/ip.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/ip6.h' -> 'dir/include/netinet/ip6.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/ip_icmp.h' -> 'dir/include/netinet/ip_icmp.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/tcp.h' -> 'dir/include/netinet/tcp.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netinet/udp.h' -> 'dir/include/netinet/udp.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netipx' -> 'dir/include/netipx' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netipx/ipx.h' -> 'dir/include/netipx/ipx.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netiucv' -> 'dir/include/netiucv' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netiucv/iucv.h' -> 'dir/include/netiucv/iucv.h' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netpacket' -> 'dir/include/netpacket' 2024-05-16T21:33:13.886 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netpacket/packet.h' -> 'dir/include/netpacket/packet.h' 2024-05-16T21:33:13.887 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netrom' -> 'dir/include/netrom' 2024-05-16T21:33:13.887 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netrom/netrom.h' -> 'dir/include/netrom/netrom.h' 2024-05-16T21:33:13.887 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netrose' -> 'dir/include/netrose' 2024-05-16T21:33:14.031 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/netrose/rose.h' -> 'dir/include/netrose/rose.h' 2024-05-16T21:33:14.031 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/nfs' -> 'dir/include/nfs' 2024-05-16T21:33:14.031 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/nfs/nfs.h' -> 'dir/include/nfs/nfs.h' 2024-05-16T21:33:14.031 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/protocols' -> 'dir/include/protocols' 2024-05-16T21:33:14.031 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/protocols/routed.h' -> 'dir/include/protocols/routed.h' 2024-05-16T21:33:14.031 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/protocols/rwhod.h' -> 'dir/include/protocols/rwhod.h' 2024-05-16T21:33:14.031 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/protocols/talkd.h' -> 'dir/include/protocols/talkd.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/protocols/timed.h' -> 'dir/include/protocols/timed.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rpc' -> 'dir/include/rpc' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rpc/netdb.h' -> 'dir/include/rpc/netdb.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/numpy' -> 'dir/include/numpy' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/zdict.h' -> 'dir/include/zdict.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/zstd.h' -> 'dir/include/zstd.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/zstd_errors.h' -> 'dir/include/zstd_errors.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/gelf.h' -> 'dir/include/gelf.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/libelf.h' -> 'dir/include/libelf.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/nlist.h' -> 'dir/include/nlist.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/libaio.h' -> 'dir/include/libaio.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/FlexLexer.h' -> 'dir/include/FlexLexer.h' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rados' -> 'dir/include/rados' 2024-05-16T21:33:14.032 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rados/librados.h' -> 'dir/include/rados/librados.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/rados/rados_types.h' -> 'dir/include/rados/rados_types.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/uuid' -> 'dir/include/uuid' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/uuid/uuid.h' -> 'dir/include/uuid/uuid.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs' -> 'dir/include/xfs' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/handle.h' -> 'dir/include/xfs/handle.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/jdm.h' -> 'dir/include/xfs/jdm.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/linux.h' -> 'dir/include/xfs/linux.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xfs.h' -> 'dir/include/xfs/xfs.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xfs_arch.h' -> 'dir/include/xfs/xfs_arch.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xfs_da_format.h' -> 'dir/include/xfs/xfs_da_format.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xfs_format.h' -> 'dir/include/xfs/xfs_format.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xfs_fs.h' -> 'dir/include/xfs/xfs_fs.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xfs_fs_compat.h' -> 'dir/include/xfs/xfs_fs_compat.h' 2024-05-16T21:33:14.033 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xfs_log_format.h' -> 'dir/include/xfs/xfs_log_format.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xfs_types.h' -> 'dir/include/xfs/xfs_types.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/xfs/xqm.h' -> 'dir/include/xfs/xqm.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cephfs' -> 'dir/include/cephfs' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cephfs/ceph_ll_client.h' -> 'dir/include/cephfs/ceph_ll_client.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cephfs/libcephfs.h' -> 'dir/include/cephfs/libcephfs.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cephfs/metrics' -> 'dir/include/cephfs/metrics' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cephfs/metrics/Types.h' -> 'dir/include/cephfs/metrics/Types.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/cephfs/types.h' -> 'dir/include/cephfs/types.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl' -> 'dir/include/openssl' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/aes.h' -> 'dir/include/openssl/aes.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/asn1.h' -> 'dir/include/openssl/asn1.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/asn1_mac.h' -> 'dir/include/openssl/asn1_mac.h' 2024-05-16T21:33:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/asn1err.h' -> 'dir/include/openssl/asn1err.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/asn1t.h' -> 'dir/include/openssl/asn1t.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/async.h' -> 'dir/include/openssl/async.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/asyncerr.h' -> 'dir/include/openssl/asyncerr.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/bio.h' -> 'dir/include/openssl/bio.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/bioerr.h' -> 'dir/include/openssl/bioerr.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/blowfish.h' -> 'dir/include/openssl/blowfish.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/bn.h' -> 'dir/include/openssl/bn.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/bnerr.h' -> 'dir/include/openssl/bnerr.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/buffer.h' -> 'dir/include/openssl/buffer.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/buffererr.h' -> 'dir/include/openssl/buffererr.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/camellia.h' -> 'dir/include/openssl/camellia.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cast.h' -> 'dir/include/openssl/cast.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cmac.h' -> 'dir/include/openssl/cmac.h' 2024-05-16T21:33:14.035 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cmp.h' -> 'dir/include/openssl/cmp.h' 2024-05-16T21:33:14.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cmp_util.h' -> 'dir/include/openssl/cmp_util.h' 2024-05-16T21:33:14.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cmperr.h' -> 'dir/include/openssl/cmperr.h' 2024-05-16T21:33:14.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cms.h' -> 'dir/include/openssl/cms.h' 2024-05-16T21:33:14.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cmserr.h' -> 'dir/include/openssl/cmserr.h' 2024-05-16T21:33:14.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/comp.h' -> 'dir/include/openssl/comp.h' 2024-05-16T21:33:14.036 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/comperr.h' -> 'dir/include/openssl/comperr.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/conf.h' -> 'dir/include/openssl/conf.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/conf_api.h' -> 'dir/include/openssl/conf_api.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/conferr.h' -> 'dir/include/openssl/conferr.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/configuration-x86_64.h' -> 'dir/include/openssl/configuration-x86_64.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/configuration.h' -> 'dir/include/openssl/configuration.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/conftypes.h' -> 'dir/include/openssl/conftypes.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/core.h' -> 'dir/include/openssl/core.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/core_dispatch.h' -> 'dir/include/openssl/core_dispatch.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/core_names.h' -> 'dir/include/openssl/core_names.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/core_object.h' -> 'dir/include/openssl/core_object.h' 2024-05-16T21:33:14.136 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/crmf.h' -> 'dir/include/openssl/crmf.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/crmferr.h' -> 'dir/include/openssl/crmferr.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/crypto.h' -> 'dir/include/openssl/crypto.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cryptoerr.h' -> 'dir/include/openssl/cryptoerr.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cryptoerr_legacy.h' -> 'dir/include/openssl/cryptoerr_legacy.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ct.h' -> 'dir/include/openssl/ct.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/cterr.h' -> 'dir/include/openssl/cterr.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/decoder.h' -> 'dir/include/openssl/decoder.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/decodererr.h' -> 'dir/include/openssl/decodererr.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/des.h' -> 'dir/include/openssl/des.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/dh.h' -> 'dir/include/openssl/dh.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/dherr.h' -> 'dir/include/openssl/dherr.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/dsa.h' -> 'dir/include/openssl/dsa.h' 2024-05-16T21:33:14.137 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/dsaerr.h' -> 'dir/include/openssl/dsaerr.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/dtls1.h' -> 'dir/include/openssl/dtls1.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/e_os2.h' -> 'dir/include/openssl/e_os2.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/e_ostime.h' -> 'dir/include/openssl/e_ostime.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ebcdic.h' -> 'dir/include/openssl/ebcdic.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ec.h' -> 'dir/include/openssl/ec.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ecdh.h' -> 'dir/include/openssl/ecdh.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ecdsa.h' -> 'dir/include/openssl/ecdsa.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ecerr.h' -> 'dir/include/openssl/ecerr.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/encoder.h' -> 'dir/include/openssl/encoder.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/encodererr.h' -> 'dir/include/openssl/encodererr.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/engine.h' -> 'dir/include/openssl/engine.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/engineerr.h' -> 'dir/include/openssl/engineerr.h' 2024-05-16T21:33:14.138 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/err.h' -> 'dir/include/openssl/err.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ess.h' -> 'dir/include/openssl/ess.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/esserr.h' -> 'dir/include/openssl/esserr.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/evp.h' -> 'dir/include/openssl/evp.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/evperr.h' -> 'dir/include/openssl/evperr.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/fips.h' -> 'dir/include/openssl/fips.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/fips_names.h' -> 'dir/include/openssl/fips_names.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/fipskey.h' -> 'dir/include/openssl/fipskey.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/hmac.h' -> 'dir/include/openssl/hmac.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/hpke.h' -> 'dir/include/openssl/hpke.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/http.h' -> 'dir/include/openssl/http.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/httperr.h' -> 'dir/include/openssl/httperr.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/idea.h' -> 'dir/include/openssl/idea.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/kdf.h' -> 'dir/include/openssl/kdf.h' 2024-05-16T21:33:14.139 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/kdferr.h' -> 'dir/include/openssl/kdferr.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/lhash.h' -> 'dir/include/openssl/lhash.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/macros.h' -> 'dir/include/openssl/macros.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/md2.h' -> 'dir/include/openssl/md2.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/md4.h' -> 'dir/include/openssl/md4.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/md5.h' -> 'dir/include/openssl/md5.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/mdc2.h' -> 'dir/include/openssl/mdc2.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/modes.h' -> 'dir/include/openssl/modes.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/obj_mac.h' -> 'dir/include/openssl/obj_mac.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/objects.h' -> 'dir/include/openssl/objects.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/objectserr.h' -> 'dir/include/openssl/objectserr.h' 2024-05-16T21:33:14.140 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ocsp.h' -> 'dir/include/openssl/ocsp.h' 2024-05-16T21:33:14.258 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ocsperr.h' -> 'dir/include/openssl/ocsperr.h' 2024-05-16T21:33:14.258 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/opensslconf.h' -> 'dir/include/openssl/opensslconf.h' 2024-05-16T21:33:14.258 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/opensslv.h' -> 'dir/include/openssl/opensslv.h' 2024-05-16T21:33:14.258 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ossl_typ.h' -> 'dir/include/openssl/ossl_typ.h' 2024-05-16T21:33:14.258 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/param_build.h' -> 'dir/include/openssl/param_build.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/params.h' -> 'dir/include/openssl/params.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/pem.h' -> 'dir/include/openssl/pem.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/pem2.h' -> 'dir/include/openssl/pem2.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/pemerr.h' -> 'dir/include/openssl/pemerr.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/pkcs12.h' -> 'dir/include/openssl/pkcs12.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/pkcs12err.h' -> 'dir/include/openssl/pkcs12err.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/pkcs7.h' -> 'dir/include/openssl/pkcs7.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/pkcs7err.h' -> 'dir/include/openssl/pkcs7err.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/prov_ssl.h' -> 'dir/include/openssl/prov_ssl.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/proverr.h' -> 'dir/include/openssl/proverr.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/provider.h' -> 'dir/include/openssl/provider.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/quic.h' -> 'dir/include/openssl/quic.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/rand.h' -> 'dir/include/openssl/rand.h' 2024-05-16T21:33:14.259 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/randerr.h' -> 'dir/include/openssl/randerr.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/rc2.h' -> 'dir/include/openssl/rc2.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/rc4.h' -> 'dir/include/openssl/rc4.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/rc5.h' -> 'dir/include/openssl/rc5.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ripemd.h' -> 'dir/include/openssl/ripemd.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/rsa.h' -> 'dir/include/openssl/rsa.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/rsaerr.h' -> 'dir/include/openssl/rsaerr.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/safestack.h' -> 'dir/include/openssl/safestack.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/seed.h' -> 'dir/include/openssl/seed.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/self_test.h' -> 'dir/include/openssl/self_test.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/sha.h' -> 'dir/include/openssl/sha.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/srp.h' -> 'dir/include/openssl/srp.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/srtp.h' -> 'dir/include/openssl/srtp.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ssl.h' -> 'dir/include/openssl/ssl.h' 2024-05-16T21:33:14.260 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ssl2.h' -> 'dir/include/openssl/ssl2.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ssl3.h' -> 'dir/include/openssl/ssl3.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/sslerr.h' -> 'dir/include/openssl/sslerr.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/sslerr_legacy.h' -> 'dir/include/openssl/sslerr_legacy.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/stack.h' -> 'dir/include/openssl/stack.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/store.h' -> 'dir/include/openssl/store.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/storeerr.h' -> 'dir/include/openssl/storeerr.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/symhacks.h' -> 'dir/include/openssl/symhacks.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/thread.h' -> 'dir/include/openssl/thread.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/tls1.h' -> 'dir/include/openssl/tls1.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/trace.h' -> 'dir/include/openssl/trace.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ts.h' -> 'dir/include/openssl/ts.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/tserr.h' -> 'dir/include/openssl/tserr.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/txt_db.h' -> 'dir/include/openssl/txt_db.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/types.h' -> 'dir/include/openssl/types.h' 2024-05-16T21:33:14.261 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/ui.h' -> 'dir/include/openssl/ui.h' 2024-05-16T21:33:14.262 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/uierr.h' -> 'dir/include/openssl/uierr.h' 2024-05-16T21:33:14.262 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/whrlpool.h' -> 'dir/include/openssl/whrlpool.h' 2024-05-16T21:33:14.262 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/x509.h' -> 'dir/include/openssl/x509.h' 2024-05-16T21:33:14.262 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/x509_vfy.h' -> 'dir/include/openssl/x509_vfy.h' 2024-05-16T21:33:14.262 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/x509err.h' -> 'dir/include/openssl/x509err.h' 2024-05-16T21:33:14.262 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/x509v3.h' -> 'dir/include/openssl/x509v3.h' 2024-05-16T21:33:14.262 INFO:teuthology.orchestra.run.smithi181.stdout:'/usr/include/openssl/x509v3err.h' -> 'dir/include/openssl/x509v3err.h' 2024-05-16T21:33:14.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:14.271 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt purge --force --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-16T21:33:14.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:17.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:17.469 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-16T21:33:17.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:17.495 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:17.526 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:17.639 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-16T21:33:17.639 INFO:tasks.cephfs.mount:Terminating background process 2024-05-16T21:33:17.639 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:33:17.639 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:33:17.692 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:33:17.692 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:33:17.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-16T21:33:17.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.855+0000 7f939e22a640 1 Processor -- start 2024-05-16T21:33:17.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.855+0000 7f939e22a640 1 -- start start 2024-05-16T21:33:17.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.856+0000 7f939e22a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93980be3f0 0x7f939814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:17.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.856+0000 7f939e22a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93980bb890 con 0x7f9398074b00 2024-05-16T21:33:17.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.856+0000 7f939e22a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93980bbb30 con 0x7f939814fad0 2024-05-16T21:33:17.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.856+0000 7f939e22a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f93980bb470 con 0x7f93980be3f0 2024-05-16T21:33:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.856+0000 7f9396ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93980be3f0 0x7f939814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.856+0000 7f93977fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9398074b00 0x7f939806c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36622/0 (socket says 172.21.15.5:36622) 2024-05-16T21:33:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.856+0000 7f9396ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93980be3f0 0x7f939814cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50742/0 (socket says 172.21.15.5:50742) 2024-05-16T21:33:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.856+0000 7f93977fe640 1 -- 172.21.15.5:0/1890776781 learned_addr learned my addr 172.21.15.5:0/1890776781 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.857+0000 7f9396ffd640 1 -- 172.21.15.5:0/1890776781 >> v1:172.21.15.157:6789/0 conn(0x7f939814fad0 legacy=0x7f939814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.857+0000 7f9396ffd640 1 -- 172.21.15.5:0/1890776781 >> v1:172.21.15.5:6789/0 conn(0x7f9398074b00 legacy=0x7f939806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:17.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.857+0000 7f9396ffd640 1 -- 172.21.15.5:0/1890776781 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93980bbe10 con 0x7f93980be3f0 2024-05-16T21:33:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.857+0000 7f9396ffd640 1 --2- 172.21.15.5:0/1890776781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93980be3f0 0x7f939814cb20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f938c0097a0 tx=0x7f938c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8266fa5163de1fb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f93967fc640 1 -- 172.21.15.5:0/1890776781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c037070 con 0x7f93980be3f0 2024-05-16T21:33:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f93967fc640 1 -- 172.21.15.5:0/1890776781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c032440 con 0x7f93980be3f0 2024-05-16T21:33:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f93967fc640 1 -- 172.21.15.5:0/1890776781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c032810 con 0x7f93980be3f0 2024-05-16T21:33:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f939e22a640 1 -- 172.21.15.5:0/1890776781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93980be3f0 msgr2=0x7f939814cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:17.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f939e22a640 1 --2- 172.21.15.5:0/1890776781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93980be3f0 0x7f939814cb20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f938c0097a0 tx=0x7f938c02a1a0 comp rx=0 tx=0).stop 2024-05-16T21:33:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f939e22a640 1 -- 172.21.15.5:0/1890776781 shutdown_connections 2024-05-16T21:33:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f939e22a640 1 --2- 172.21.15.5:0/1890776781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93980be3f0 0x7f939814cb20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f939e22a640 1 -- 172.21.15.5:0/1890776781 >> 172.21.15.5:0/1890776781 conn(0x7f93980bd0f0 msgr2=0x7f93980bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f939e22a640 1 -- 172.21.15.5:0/1890776781 shutdown_connections 2024-05-16T21:33:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.858+0000 7f939e22a640 1 -- 172.21.15.5:0/1890776781 wait complete. 2024-05-16T21:33:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.860+0000 7f939e22a640 1 Processor -- start 2024-05-16T21:33:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.860+0000 7f939e22a640 1 -- start start 2024-05-16T21:33:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f939e22a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9398074b00 0x7f9398142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f939e22a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93980be3f0 0x7f93980a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f939e22a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f939814fad0 0x7f9398143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f939e22a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f939814d060 con 0x7f939814fad0 2024-05-16T21:33:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f939e22a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f93980bc3d0 con 0x7f93980be3f0 2024-05-16T21:33:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f939e22a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f939814d1e0 con 0x7f9398074b00 2024-05-16T21:33:17.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f9397fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f939814fad0 0x7f9398143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f9397fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f939814fad0 0x7f9398143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50756/0 (socket says 172.21.15.5:50756) 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f9397fff640 1 -- 172.21.15.5:0/1541254965 learned_addr learned my addr 172.21.15.5:0/1541254965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f9396ffd640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93980be3f0 0x7f93980a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.861+0000 7f93977fe640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9398074b00 0x7f9398142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f9397fff640 1 -- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9398074b00 msgr2=0x7f9398142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f9397fff640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9398074b00 0x7f9398142ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f9397fff640 1 -- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93980be3f0 msgr2=0x7f93980a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f9397fff640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93980be3f0 0x7f93980a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f9397fff640 1 -- 172.21.15.5:0/1541254965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93980a1a80 con 0x7f939814fad0 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f93977fe640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9398074b00 0x7f9398142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f9397fff640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f939814fad0 0x7f9398143b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f939000c700 tx=0x7f939000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:17.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f937ffff640 1 -- 172.21.15.5:0/1541254965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390003b70 con 0x7f939814fad0 2024-05-16T21:33:17.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f937ffff640 1 -- 172.21.15.5:0/1541254965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9390003d10 con 0x7f939814fad0 2024-05-16T21:33:17.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9398157980 con 0x7f939814fad0 2024-05-16T21:33:17.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f937ffff640 1 -- 172.21.15.5:0/1541254965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939000aa50 con 0x7f939814fad0 2024-05-16T21:33:17.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.862+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93981442a0 con 0x7f939814fad0 2024-05-16T21:33:17.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.863+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93981438b0 con 0x7f939814fad0 2024-05-16T21:33:17.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.864+0000 7f937ffff640 1 -- 172.21.15.5:0/1541254965 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f939000abf0 con 0x7f939814fad0 2024-05-16T21:33:17.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.864+0000 7f937ffff640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93840762d0 0x7f93840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:17.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.864+0000 7f937ffff640 1 -- 172.21.15.5:0/1541254965 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f93900974c0 con 0x7f939814fad0 2024-05-16T21:33:17.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.864+0000 7f93977fe640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93840762d0 0x7f93840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:17.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.865+0000 7f93977fe640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93840762d0 0x7f93840787e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9388000f60 tx=0x7f9388009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:17.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:17.869+0000 7f937ffff640 1 -- 172.21.15.5:0/1541254965 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9390060e10 con 0x7f939814fad0 2024-05-16T21:33:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.077+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9398050940 con 0x7f939814fad0 2024-05-16T21:33:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.077+0000 7f937ffff640 1 -- 172.21.15.5:0/1541254965 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) ==== 80+0+0 (secure 0 0 0) 0x7f9390060710 con 0x7f939814fad0 2024-05-16T21:33:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-05-16T21:33:18.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93840762d0 msgr2=0x7f93840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93840762d0 0x7f93840787e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9388000f60 tx=0x7f9388009040 comp rx=0 tx=0).stop 2024-05-16T21:33:18.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f939814fad0 msgr2=0x7f9398143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f939814fad0 0x7f9398143b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f939000c700 tx=0x7f939000cbc0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 shutdown_connections 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93840762d0 0x7f93840787e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f939814fad0 0x7f9398143b50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93980be3f0 0x7f93980a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 --2- 172.21.15.5:0/1541254965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9398074b00 0x7f9398142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 >> 172.21.15.5:0/1541254965 conn(0x7f93980bd0f0 msgr2=0x7f9398068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 shutdown_connections 2024-05-16T21:33:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.079+0000 7f939e22a640 1 -- 172.21.15.5:0/1541254965 wait complete. 2024-05-16T21:33:18.093 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-16T21:33:18.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:18.093 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:18.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-05-16T21:33:18.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:18.267 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-16T21:33:18.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:18.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.431+0000 7f900a225640 1 Processor -- start 2024-05-16T21:33:18.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.431+0000 7f900a225640 1 -- start start 2024-05-16T21:33:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f900a225640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f900414e360 0x7f90041522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f900a225640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9004148770 0x7f90040c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f900a225640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90040c0620 con 0x7f90040bf9b0 2024-05-16T21:33:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f900a225640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9004151e40 con 0x7f9004148770 2024-05-16T21:33:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f900a225640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9004151ad0 con 0x7f900414e360 2024-05-16T21:33:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f9002ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9004148770 0x7f90040c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f9002ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9004148770 0x7f90040c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50764/0 (socket says 172.21.15.5:50764) 2024-05-16T21:33:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f9002ffd640 1 -- 172.21.15.5:0/348826340 learned_addr learned my addr 172.21.15.5:0/348826340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f90037fe640 1 --2- 172.21.15.5:0/348826340 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f900414e360 0x7f90041522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f9002ffd640 1 -- 172.21.15.5:0/348826340 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f900414e360 msgr2=0x7f90041522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.432+0000 7f9002ffd640 1 --2- 172.21.15.5:0/348826340 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f900414e360 0x7f90041522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.433+0000 7f9002ffd640 1 -- 172.21.15.5:0/348826340 >> v1:172.21.15.157:6789/0 conn(0x7f90040bf9b0 legacy=0x7f90040bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.433+0000 7f9002ffd640 1 -- 172.21.15.5:0/348826340 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9004152810 con 0x7f9004148770 2024-05-16T21:33:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.433+0000 7f9002ffd640 1 --2- 172.21.15.5:0/348826340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9004148770 0x7f90040c0c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80098a0 tx=0x7f8ff802a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d637efd00be62e59 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.433+0000 7f90027fc640 1 -- 172.21.15.5:0/348826340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8037070 con 0x7f9004148770 2024-05-16T21:33:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.433+0000 7f90027fc640 1 -- 172.21.15.5:0/348826340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff8032640 con 0x7f9004148770 2024-05-16T21:33:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.433+0000 7f90027fc640 1 -- 172.21.15.5:0/348826340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8032a10 con 0x7f9004148770 2024-05-16T21:33:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.434+0000 7f900a225640 1 -- 172.21.15.5:0/348826340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9004148770 msgr2=0x7f90040c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.434+0000 7f900a225640 1 --2- 172.21.15.5:0/348826340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9004148770 0x7f90040c0c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80098a0 tx=0x7f8ff802a320 comp rx=0 tx=0).stop 2024-05-16T21:33:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.434+0000 7f900a225640 1 -- 172.21.15.5:0/348826340 shutdown_connections 2024-05-16T21:33:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.434+0000 7f900a225640 1 --2- 172.21.15.5:0/348826340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9004148770 0x7f90040c0c80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.434+0000 7f900a225640 1 --2- 172.21.15.5:0/348826340 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f900414e360 0x7f90041522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.434+0000 7f900a225640 1 -- 172.21.15.5:0/348826340 >> 172.21.15.5:0/348826340 conn(0x7f90040c17c0 msgr2=0x7f90040c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.434+0000 7f900a225640 1 -- 172.21.15.5:0/348826340 shutdown_connections 2024-05-16T21:33:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.434+0000 7f900a225640 1 -- 172.21.15.5:0/348826340 wait complete. 2024-05-16T21:33:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.436+0000 7f900a225640 1 Processor -- start 2024-05-16T21:33:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.436+0000 7f900a225640 1 -- start start 2024-05-16T21:33:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f900a225640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90040bf9b0 0x7f900406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f900a225640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004148770 0x7f90041419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f900a225640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f900414e360 0x7f900413db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f900a225640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9004158cc0 con 0x7f900414e360 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f900a225640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f90040c13d0 con 0x7f9004148770 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f900a225640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9004158e40 con 0x7f90040bf9b0 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f900414e360 0x7f900413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f900414e360 0x7f900413db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50774/0 (socket says 172.21.15.5:50774) 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 -- 172.21.15.5:0/960654689 learned_addr learned my addr 172.21.15.5:0/960654689 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f90037fe640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90040bf9b0 0x7f900406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9002ffd640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004148770 0x7f90041419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 -- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90040bf9b0 msgr2=0x7f900406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90040bf9b0 0x7f900406ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 -- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004148770 msgr2=0x7f90041419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004148770 0x7f90041419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 -- 172.21.15.5:0/960654689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900406efd0 con 0x7f900414e360 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.437+0000 7f9003fff640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f900414e360 0x7f900413db60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc002230 tx=0x7f8ffc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.438+0000 7f8febfff640 1 -- 172.21.15.5:0/960654689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc003b70 con 0x7f900414e360 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.438+0000 7f8febfff640 1 -- 172.21.15.5:0/960654689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ffc003d10 con 0x7f900414e360 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.438+0000 7f8febfff640 1 -- 172.21.15.5:0/960654689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0052d0 con 0x7f900414e360 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.438+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9004141f20 con 0x7f900414e360 2024-05-16T21:33:18.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.438+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041e7cc0 con 0x7f900414e360 2024-05-16T21:33:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.439+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9004050940 con 0x7f900414e360 2024-05-16T21:33:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.440+0000 7f8febfff640 1 -- 172.21.15.5:0/960654689 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ffc005680 con 0x7f900414e360 2024-05-16T21:33:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.440+0000 7f8febfff640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8ff00762d0 0x7f8ff00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.440+0000 7f8febfff640 1 -- 172.21.15.5:0/960654689 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f8ffc097660 con 0x7f900414e360 2024-05-16T21:33:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.440+0000 7f90037fe640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8ff00762d0 0x7f8ff00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.441+0000 7f90037fe640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8ff00762d0 0x7f8ff00787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40079a0 tx=0x7f8ff4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.445+0000 7f8febfff640 1 -- 172.21.15.5:0/960654689 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ffc060850 con 0x7f900414e360 2024-05-16T21:33:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.672+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90040bf790 con 0x7f900414e360 2024-05-16T21:33:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.673+0000 7f8febfff640 1 -- 172.21.15.5:0/960654689 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4353 (secure 0 0 0) 0x7f8ffc064b50 con 0x7f900414e360 2024-05-16T21:33:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:18.676 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2890333934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2890333934},{"type":"v1","addr":"172.21.15.5:6834","nonce":2890333934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3111678801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3111678801},{"type":"v1","addr":"172.21.15.157:6835","nonce":3111678801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:53.518776+0000","modified":"2024-05-16T21:32:56.567421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4692},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4692":{"gid":4692,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2543237506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543237506},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543237506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4692,"qdb_cluster":[4692]},"id":2}]} 2024-05-16T21:33:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-05-16T21:33:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8ff00762d0 msgr2=0x7f8ff00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8ff00762d0 0x7f8ff00787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40079a0 tx=0x7f8ff4008040 comp rx=0 tx=0).stop 2024-05-16T21:33:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f900414e360 msgr2=0x7f900413db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f900414e360 0x7f900413db60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc002230 tx=0x7f8ffc00cb90 comp rx=0 tx=0).stop 2024-05-16T21:33:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 shutdown_connections 2024-05-16T21:33:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8ff00762d0 0x7f8ff00787e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f900414e360 0x7f900413db60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004148770 0x7f90041419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 --2- 172.21.15.5:0/960654689 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90040bf9b0 0x7f900406ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 >> 172.21.15.5:0/960654689 conn(0x7f90040c17c0 msgr2=0x7f9004140580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 shutdown_connections 2024-05-16T21:33:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.675+0000 7f900a225640 1 -- 172.21.15.5:0/960654689 wait complete. 2024-05-16T21:33:18.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:18.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.797+0000 7f5c4d172640 1 Processor -- start 2024-05-16T21:33:18.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.797+0000 7f5c4d172640 1 -- start start 2024-05-16T21:33:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.798+0000 7f5c4d172640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c48151fc0 0x7f5c480bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.798+0000 7f5c4d172640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806da30 0x7f5c480be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.798+0000 7f5c4d172640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c480c36f0 con 0x7f5c4806de40 2024-05-16T21:33:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.798+0000 7f5c4d172640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5c480bdc10 con 0x7f5c48151fc0 2024-05-16T21:33:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.798+0000 7f5c4d172640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5c48152530 con 0x7f5c4806da30 2024-05-16T21:33:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c46d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c48151fc0 0x7f5c480bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c46d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c48151fc0 0x7f5c480bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50776/0 (socket says 172.21.15.5:50776) 2024-05-16T21:33:18.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c46d9d640 1 -- 172.21.15.5:0/813124152 learned_addr learned my addr 172.21.15.5:0/813124152 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c4659c640 1 --2- 172.21.15.5:0/813124152 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806da30 0x7f5c480be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c46d9d640 1 -- 172.21.15.5:0/813124152 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806da30 msgr2=0x7f5c480be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c46d9d640 1 --2- 172.21.15.5:0/813124152 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806da30 0x7f5c480be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c46d9d640 1 -- 172.21.15.5:0/813124152 >> v1:172.21.15.157:6789/0 conn(0x7f5c4806de40 legacy=0x7f5c4814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c46d9d640 1 -- 172.21.15.5:0/813124152 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c48152810 con 0x7f5c48151fc0 2024-05-16T21:33:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.799+0000 7f5c4659c640 1 --2- 172.21.15.5:0/813124152 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806da30 0x7f5c480be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c46d9d640 1 --2- 172.21.15.5:0/813124152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480bd6d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009870 tx=0x7f5c4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e68bbcda2627d75 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c45d9b640 1 -- 172.21.15.5:0/813124152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40037070 con 0x7f5c48151fc0 2024-05-16T21:33:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c45d9b640 1 -- 172.21.15.5:0/813124152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c40032440 con 0x7f5c48151fc0 2024-05-16T21:33:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c45d9b640 1 -- 172.21.15.5:0/813124152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40032810 con 0x7f5c48151fc0 2024-05-16T21:33:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c4d172640 1 -- 172.21.15.5:0/813124152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 msgr2=0x7f5c480bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c4d172640 1 --2- 172.21.15.5:0/813124152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480bd6d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009870 tx=0x7f5c4002a270 comp rx=0 tx=0).stop 2024-05-16T21:33:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c4d172640 1 -- 172.21.15.5:0/813124152 shutdown_connections 2024-05-16T21:33:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c4d172640 1 --2- 172.21.15.5:0/813124152 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806da30 0x7f5c480be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c4d172640 1 --2- 172.21.15.5:0/813124152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480bd6d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.800+0000 7f5c4d172640 1 -- 172.21.15.5:0/813124152 >> 172.21.15.5:0/813124152 conn(0x7f5c480c3d20 msgr2=0x7f5c480c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:18.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.801+0000 7f5c4d172640 1 -- 172.21.15.5:0/813124152 shutdown_connections 2024-05-16T21:33:18.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.801+0000 7f5c4d172640 1 -- 172.21.15.5:0/813124152 wait complete. 2024-05-16T21:33:18.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.802+0000 7f5c4d172640 1 Processor -- start 2024-05-16T21:33:18.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.802+0000 7f5c4d172640 1 -- start start 2024-05-16T21:33:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.803+0000 7f5c4d172640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c4806da30 0x7f5c480b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.803+0000 7f5c4d172640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806de40 0x7f5c481e7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.803+0000 7f5c4d172640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.803+0000 7f5c4d172640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c480a3050 con 0x7f5c48151fc0 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.803+0000 7f5c4d172640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5c480a2ed0 con 0x7f5c4806da30 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.803+0000 7f5c4d172640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5c480bee80 con 0x7f5c4806de40 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480b7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50784/0 (socket says 172.21.15.5:50784) 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 -- 172.21.15.5:0/3365720879 learned_addr learned my addr 172.21.15.5:0/3365720879 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c46d9d640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c4806da30 0x7f5c480b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4659c640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806de40 0x7f5c481e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 -- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806de40 msgr2=0x7f5c481e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806de40 0x7f5c481e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 -- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c4806da30 msgr2=0x7f5c480b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c4806da30 0x7f5c480b9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 -- 172.21.15.5:0/3365720879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c480ba4e0 con 0x7f5c48151fc0 2024-05-16T21:33:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4759e640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480b7be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c38002230 tx=0x7f5c3800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c3f7fe640 1 -- 172.21.15.5:0/3365720879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38003b70 con 0x7f5c48151fc0 2024-05-16T21:33:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c3f7fe640 1 -- 172.21.15.5:0/3365720879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c38003d10 con 0x7f5c48151fc0 2024-05-16T21:33:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c481e7cc0 con 0x7f5c48151fc0 2024-05-16T21:33:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c3f7fe640 1 -- 172.21.15.5:0/3365720879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c380052d0 con 0x7f5c48151fc0 2024-05-16T21:33:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.804+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4814ea70 con 0x7f5c48151fc0 2024-05-16T21:33:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.805+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c48050940 con 0x7f5c48151fc0 2024-05-16T21:33:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.806+0000 7f5c3f7fe640 1 -- 172.21.15.5:0/3365720879 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c38005470 con 0x7f5c48151fc0 2024-05-16T21:33:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.806+0000 7f5c3f7fe640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c280762d0 0x7f5c280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.807+0000 7f5c3f7fe640 1 -- 172.21.15.5:0/3365720879 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5c380974a0 con 0x7f5c48151fc0 2024-05-16T21:33:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.807+0000 7f5c46d9d640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c280762d0 0x7f5c280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.807+0000 7f5c46d9d640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c280762d0 0x7f5c280787e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c40034000 tx=0x7f5c4002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:18.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:18.811+0000 7f5c3f7fe640 1 -- 172.21.15.5:0/3365720879 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c38060600 con 0x7f5c48151fc0 2024-05-16T21:33:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.045+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c480b98a0 con 0x7f5c48151fc0 2024-05-16T21:33:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.045+0000 7f5c3f7fe640 1 -- 172.21.15.5:0/3365720879 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4353 (secure 0 0 0) 0x7f5c38064900 con 0x7f5c48151fc0 2024-05-16T21:33:19.048 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:19.048 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2890333934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2890333934},{"type":"v1","addr":"172.21.15.5:6834","nonce":2890333934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3111678801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3111678801},{"type":"v1","addr":"172.21.15.157:6835","nonce":3111678801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:53.518776+0000","modified":"2024-05-16T21:32:56.567421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4692},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4692":{"gid":4692,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2543237506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543237506},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543237506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4692,"qdb_cluster":[4692]},"id":2}]} 2024-05-16T21:33:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-05-16T21:33:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c280762d0 msgr2=0x7f5c280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c280762d0 0x7f5c280787e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c40034000 tx=0x7f5c4002e000 comp rx=0 tx=0).stop 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 msgr2=0x7f5c480b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480b7be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c38002230 tx=0x7f5c3800cb90 comp rx=0 tx=0).stop 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 shutdown_connections 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5c280762d0 0x7f5c280787e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c48151fc0 0x7f5c480b7be0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c4806de40 0x7f5c481e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 --2- 172.21.15.5:0/3365720879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c4806da30 0x7f5c480b9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.047+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 >> 172.21.15.5:0/3365720879 conn(0x7f5c480c3d20 msgr2=0x7f5c480a4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.048+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 shutdown_connections 2024-05-16T21:33:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.048+0000 7f5c4d172640 1 -- 172.21.15.5:0/3365720879 wait complete. 2024-05-16T21:33:19.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:33:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.169+0000 7f4c0bf94640 1 Processor -- start 2024-05-16T21:33:19.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.170+0000 7f4c0bf94640 1 -- start start 2024-05-16T21:33:19.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0bf94640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4c0406c6e0 0x7f4c04074a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0bf94640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c041519c0 0x7f4c0414ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0bf94640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c040bf010 0x7f4c040730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0bf94640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0414f480 con 0x7f4c040bf010 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0bf94640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0406cfe0 con 0x7f4c0406c6e0 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0bf94640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0406cd00 con 0x7f4c041519c0 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0a531640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c040bf010 0x7f4c040730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0a531640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c040bf010 0x7f4c040730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50798/0 (socket says 172.21.15.5:50798) 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0a531640 1 -- 172.21.15.5:0/2201205119 learned_addr learned my addr 172.21.15.5:0/2201205119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0952f640 1 --2- 172.21.15.5:0/2201205119 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c041519c0 0x7f4c0414ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c09d30640 1 --2- 172.21.15.5:0/2201205119 >> v2:172.21.15.157:3300/0 conn(0x7f4c0406c6e0 0x7f4c04074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0a531640 1 -- 172.21.15.5:0/2201205119 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c041519c0 msgr2=0x7f4c0414ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0a531640 1 --2- 172.21.15.5:0/2201205119 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c041519c0 0x7f4c0414ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0a531640 1 -- 172.21.15.5:0/2201205119 >> v2:172.21.15.157:3300/0 conn(0x7f4c0406c6e0 msgr2=0x7f4c04074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0a531640 1 --2- 172.21.15.5:0/2201205119 >> v2:172.21.15.157:3300/0 conn(0x7f4c0406c6e0 0x7f4c04074a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0a531640 1 -- 172.21.15.5:0/2201205119 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c04074210 con 0x7f4c040bf010 2024-05-16T21:33:19.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.171+0000 7f4c0952f640 1 --2- 172.21.15.5:0/2201205119 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c041519c0 0x7f4c0414ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.172+0000 7f4c0a531640 1 --2- 172.21.15.5:0/2201205119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c040bf010 0x7f4c040730b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4c04072880 tx=0x7f4bf402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a913c681fe4ea233 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.172+0000 7f4c08d2e640 1 -- 172.21.15.5:0/2201205119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4036070 con 0x7f4c040bf010 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.172+0000 7f4c08d2e640 1 -- 172.21.15.5:0/2201205119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf4031600 con 0x7f4c040bf010 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.172+0000 7f4c08d2e640 1 -- 172.21.15.5:0/2201205119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40319d0 con 0x7f4c040bf010 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2201205119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c040bf010 msgr2=0x7f4c040730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2201205119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c040bf010 0x7f4c040730b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4c04072880 tx=0x7f4bf402a730 comp rx=0 tx=0).stop 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2201205119 shutdown_connections 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2201205119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c040bf010 0x7f4c040730b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2201205119 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c041519c0 0x7f4c0414ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2201205119 >> v2:172.21.15.157:3300/0 conn(0x7f4c0406c6e0 0x7f4c04074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2201205119 >> 172.21.15.5:0/2201205119 conn(0x7f4c040bd0f0 msgr2=0x7f4c040bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2201205119 shutdown_connections 2024-05-16T21:33:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.173+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2201205119 wait complete. 2024-05-16T21:33:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.174+0000 7f4c0bf94640 1 Processor -- start 2024-05-16T21:33:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.175+0000 7f4c0bf94640 1 -- start start 2024-05-16T21:33:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0bf94640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c0406c6e0 0x7f4c04149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0bf94640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c040bf010 0x7f4c041d94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0bf94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c041519c0 0x7f4c04146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0bf94640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4c040be460 con 0x7f4c041519c0 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0bf94640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04151dd0 con 0x7f4c040bf010 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0bf94640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4c040be5e0 con 0x7f4c0406c6e0 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c041519c0 0x7f4c04146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c041519c0 0x7f4c04146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50806/0 (socket says 172.21.15.5:50806) 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 -- 172.21.15.5:0/2934999389 learned_addr learned my addr 172.21.15.5:0/2934999389 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0952f640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c040bf010 0x7f4c041d94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c09d30640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c0406c6e0 0x7f4c04149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 -- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c0406c6e0 msgr2=0x7f4c04149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c0406c6e0 0x7f4c04149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 -- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c040bf010 msgr2=0x7f4c041d94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c040bf010 0x7f4c041d94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 -- 172.21.15.5:0/2934999389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c041d9a00 con 0x7f4c041519c0 2024-05-16T21:33:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0a531640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c041519c0 0x7f4c04146790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4bf402ad20 tx=0x7f4bf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c027fc640 1 -- 172.21.15.5:0/2934999389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf403f020 con 0x7f4c041519c0 2024-05-16T21:33:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c027fc640 1 -- 172.21.15.5:0/2934999389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf4037040 con 0x7f4c041519c0 2024-05-16T21:33:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c04147170 con 0x7f4c041519c0 2024-05-16T21:33:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c027fc640 1 -- 172.21.15.5:0/2934999389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4036070 con 0x7f4c041519c0 2024-05-16T21:33:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.176+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c041485a0 con 0x7f4c041519c0 2024-05-16T21:33:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.177+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c04069b50 con 0x7f4c041519c0 2024-05-16T21:33:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.178+0000 7f4c027fc640 1 -- 172.21.15.5:0/2934999389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4bf4042020 con 0x7f4c041519c0 2024-05-16T21:33:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.179+0000 7f4c027fc640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4bf00762d0 0x7f4bf00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.179+0000 7f4c027fc640 1 -- 172.21.15.5:0/2934999389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f4bf40b7bf0 con 0x7f4c041519c0 2024-05-16T21:33:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.179+0000 7f4c09d30640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4bf00762d0 0x7f4bf00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.179+0000 7f4c09d30640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4bf00762d0 0x7f4bf00787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009a20 tx=0x7f4bfc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.183+0000 7f4c027fc640 1 -- 172.21.15.5:0/2934999389 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4bf4049020 con 0x7f4c041519c0 2024-05-16T21:33:19.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.374+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c04152090 con 0x7f4c041519c0 2024-05-16T21:33:19.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.375+0000 7f4c027fc640 1 -- 172.21.15.5:0/2934999389 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16621 (secure 0 0 0) 0x7f4bf4080f00 con 0x7f4c041519c0 2024-05-16T21:33:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:19.378 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:55.121195+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:51.602373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:52.472465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:33:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4bf00762d0 msgr2=0x7f4bf00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4bf00762d0 0x7f4bf00787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009a20 tx=0x7f4bfc009190 comp rx=0 tx=0).stop 2024-05-16T21:33:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c041519c0 msgr2=0x7f4c04146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c041519c0 0x7f4c04146790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4bf402ad20 tx=0x7f4bf4004a40 comp rx=0 tx=0).stop 2024-05-16T21:33:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 shutdown_connections 2024-05-16T21:33:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4bf00762d0 0x7f4bf00787e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c041519c0 0x7f4c04146790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c040bf010 0x7f4c041d94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 --2- 172.21.15.5:0/2934999389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c0406c6e0 0x7f4c04149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 >> 172.21.15.5:0/2934999389 conn(0x7f4c040bd0f0 msgr2=0x7f4c040bb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:19.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 shutdown_connections 2024-05-16T21:33:19.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.377+0000 7f4c0bf94640 1 -- 172.21.15.5:0/2934999389 wait complete. 2024-05-16T21:33:19.391 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-16T21:33:19.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.499+0000 7f7a5797e640 1 Processor -- start 2024-05-16T21:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.499+0000 7f7a5797e640 1 -- start start 2024-05-16T21:33:19.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a5797e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a500b8d70 0x7f7a500b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a5797e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5014ece0 con 0x7f7a5014e530 2024-05-16T21:33:19.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a5797e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5014efc0 con 0x7f7a500bd440 2024-05-16T21:33:19.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a5797e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7a500b88e0 con 0x7f7a500b8d70 2024-05-16T21:33:19.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a55f1b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a500b8d70 0x7f7a500b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a5571a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7a5014e530 0x7f7a500ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36636/0 (socket says 172.21.15.5:36636) 2024-05-16T21:33:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a55f1b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a500b8d70 0x7f7a500b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50812/0 (socket says 172.21.15.5:50812) 2024-05-16T21:33:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a5571a640 1 -- 172.21.15.5:0/1198324625 learned_addr learned my addr 172.21.15.5:0/1198324625 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a55f1b640 1 -- 172.21.15.5:0/1198324625 >> v1:172.21.15.157:6789/0 conn(0x7f7a500bd440 legacy=0x7f7a500bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a55f1b640 1 -- 172.21.15.5:0/1198324625 >> v1:172.21.15.5:6789/0 conn(0x7f7a5014e530 legacy=0x7f7a500ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a4ffff640 1 -- 172.21.15.5:0/1198324625 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417125946 0 0) 0x7f7a5014ece0 con 0x7f7a5014e530 2024-05-16T21:33:19.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.501+0000 7f7a55f1b640 1 -- 172.21.15.5:0/1198324625 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5014f2a0 con 0x7f7a500b8d70 2024-05-16T21:33:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.502+0000 7f7a55f1b640 1 --2- 172.21.15.5:0/1198324625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a500b9180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009d90 tx=0x7f7a4002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc16a50af5042ae5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.502+0000 7f7a4ffff640 1 -- 172.21.15.5:0/1198324625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40007740 con 0x7f7a500b8d70 2024-05-16T21:33:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.502+0000 7f7a4ffff640 1 -- 172.21.15.5:0/1198324625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a400078e0 con 0x7f7a500b8d70 2024-05-16T21:33:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.502+0000 7f7a4ffff640 1 -- 172.21.15.5:0/1198324625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40007cb0 con 0x7f7a500b8d70 2024-05-16T21:33:19.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.503+0000 7f7a5797e640 1 -- 172.21.15.5:0/1198324625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 msgr2=0x7f7a500b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.503+0000 7f7a5797e640 1 --2- 172.21.15.5:0/1198324625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a500b9180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009d90 tx=0x7f7a4002a660 comp rx=0 tx=0).stop 2024-05-16T21:33:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.503+0000 7f7a5797e640 1 -- 172.21.15.5:0/1198324625 shutdown_connections 2024-05-16T21:33:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.503+0000 7f7a5797e640 1 --2- 172.21.15.5:0/1198324625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a500b9180 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.503+0000 7f7a5797e640 1 -- 172.21.15.5:0/1198324625 >> 172.21.15.5:0/1198324625 conn(0x7f7a500c0570 msgr2=0x7f7a500c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.503+0000 7f7a5797e640 1 -- 172.21.15.5:0/1198324625 shutdown_connections 2024-05-16T21:33:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.503+0000 7f7a5797e640 1 -- 172.21.15.5:0/1198324625 wait complete. 2024-05-16T21:33:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.504+0000 7f7a5797e640 1 Processor -- start 2024-05-16T21:33:19.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.504+0000 7f7a5797e640 1 -- start start 2024-05-16T21:33:19.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.505+0000 7f7a5797e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a50146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.505+0000 7f7a5797e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a500bd440 0x7f7a501e4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.505+0000 7f7a5797e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a5014e530 0x7f7a5013de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.505+0000 7f7a5797e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5014e940 con 0x7f7a500b8d70 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.505+0000 7f7a5797e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7a500b96c0 con 0x7f7a5014e530 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.505+0000 7f7a5797e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5014eac0 con 0x7f7a500bd440 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.505+0000 7f7a5571a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a50146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5571a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a50146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50816/0 (socket says 172.21.15.5:50816) 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5571a640 1 -- 172.21.15.5:0/1838582572 learned_addr learned my addr 172.21.15.5:0/1838582572 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a54f19640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a500bd440 0x7f7a501e4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a55f1b640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a5014e530 0x7f7a5013de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5571a640 1 -- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a500bd440 msgr2=0x7f7a501e4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5571a640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a500bd440 0x7f7a501e4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5571a640 1 -- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a5014e530 msgr2=0x7f7a5013de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5571a640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a5014e530 0x7f7a5013de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5571a640 1 -- 172.21.15.5:0/1838582572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a501473e0 con 0x7f7a500b8d70 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5571a640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a50146ea0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c400 tx=0x7f7a4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a4dffb640 1 -- 172.21.15.5:0/1838582572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48017070 con 0x7f7a500b8d70 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a4dffb640 1 -- 172.21.15.5:0/1838582572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a480074e0 con 0x7f7a500b8d70 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a501e4dc0 con 0x7f7a500b8d70 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a4dffb640 1 -- 172.21.15.5:0/1838582572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480059e0 con 0x7f7a500b8d70 2024-05-16T21:33:19.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.506+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a501e8110 con 0x7f7a500b8d70 2024-05-16T21:33:19.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.507+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a50050940 con 0x7f7a500b8d70 2024-05-16T21:33:19.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.508+0000 7f7a4dffb640 1 -- 172.21.15.5:0/1838582572 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a4801a070 con 0x7f7a500b8d70 2024-05-16T21:33:19.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.509+0000 7f7a4dffb640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a3c0762d0 0x7f7a3c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.509+0000 7f7a4dffb640 1 -- 172.21.15.5:0/1838582572 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f7a48096a10 con 0x7f7a500b8d70 2024-05-16T21:33:19.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.509+0000 7f7a54f19640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a3c0762d0 0x7f7a3c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.510+0000 7f7a54f19640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a3c0762d0 0x7f7a3c0787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7a500bde40 tx=0x7f7a44009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.514+0000 7f7a4dffb640 1 -- 172.21.15.5:0/1838582572 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a4805fcb0 con 0x7f7a500b8d70 2024-05-16T21:33:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.741+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a500c24c0 con 0x7f7a500b8d70 2024-05-16T21:33:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.742+0000 7f7a4dffb640 1 -- 172.21.15.5:0/1838582572 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4353 (secure 0 0 0) 0x7f7a48063fb0 con 0x7f7a500b8d70 2024-05-16T21:33:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:19.745 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2890333934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2890333934},{"type":"v1","addr":"172.21.15.5:6834","nonce":2890333934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3111678801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3111678801},{"type":"v1","addr":"172.21.15.157:6835","nonce":3111678801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:53.518776+0000","modified":"2024-05-16T21:32:56.567421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4692},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4692":{"gid":4692,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2543237506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543237506},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543237506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4692,"qdb_cluster":[4692]},"id":2}]} 2024-05-16T21:33:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-05-16T21:33:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a3c0762d0 msgr2=0x7f7a3c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a3c0762d0 0x7f7a3c0787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7a500bde40 tx=0x7f7a44009060 comp rx=0 tx=0).stop 2024-05-16T21:33:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 msgr2=0x7f7a50146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a50146ea0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c400 tx=0x7f7a4800c8c0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 shutdown_connections 2024-05-16T21:33:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a3c0762d0 0x7f7a3c0787e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a5014e530 0x7f7a5013de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a500bd440 0x7f7a501e4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 --2- 172.21.15.5:0/1838582572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a500b8d70 0x7f7a50146ea0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 >> 172.21.15.5:0/1838582572 conn(0x7f7a500c0570 msgr2=0x7f7a500beba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 shutdown_connections 2024-05-16T21:33:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.744+0000 7f7a5797e640 1 -- 172.21.15.5:0/1838582572 wait complete. 2024-05-16T21:33:19.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.866+0000 7f21bc851640 1 Processor -- start 2024-05-16T21:33:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.866+0000 7f21bc851640 1 -- start start 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21bc851640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21b8151fc0 0x7f21b80bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21bc851640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21b80bf050 0x7f21b8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21bc851640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21b80c36f0 con 0x7f21b806da30 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21bc851640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f21b80bdc10 con 0x7f21b80bf050 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21bc851640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f21b8152530 con 0x7f21b8151fc0 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21b80bf050 0x7f21b8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21b80bf050 0x7f21b8158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50824/0 (socket says 172.21.15.5:50824) 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b6d9d640 1 -- 172.21.15.5:0/4129535497 learned_addr learned my addr 172.21.15.5:0/4129535497 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b659c640 1 --2- 172.21.15.5:0/4129535497 >> v2:172.21.15.157:3300/0 conn(0x7f21b8151fc0 0x7f21b80bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b6d9d640 1 -- 172.21.15.5:0/4129535497 >> v2:172.21.15.157:3300/0 conn(0x7f21b8151fc0 msgr2=0x7f21b80bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b6d9d640 1 --2- 172.21.15.5:0/4129535497 >> v2:172.21.15.157:3300/0 conn(0x7f21b8151fc0 0x7f21b80bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b6d9d640 1 -- 172.21.15.5:0/4129535497 >> v1:172.21.15.157:6789/0 conn(0x7f21b806da30 legacy=0x7f21b80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b6d9d640 1 -- 172.21.15.5:0/4129535497 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b8152810 con 0x7f21b80bf050 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.867+0000 7f21b659c640 1 --2- 172.21.15.5:0/4129535497 >> v2:172.21.15.157:3300/0 conn(0x7f21b8151fc0 0x7f21b80bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.868+0000 7f21b6d9d640 1 --2- 172.21.15.5:0/4129535497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b8158e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f21b80bf8f0 tx=0x7f21b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256960fcbd17e829 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.868+0000 7f21b5d9b640 1 -- 172.21.15.5:0/4129535497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0036070 con 0x7f21b80bf050 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.868+0000 7f21b5d9b640 1 -- 172.21.15.5:0/4129535497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b0031600 con 0x7f21b80bf050 2024-05-16T21:33:19.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.868+0000 7f21b5d9b640 1 -- 172.21.15.5:0/4129535497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00319d0 con 0x7f21b80bf050 2024-05-16T21:33:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.869+0000 7f21bc851640 1 -- 172.21.15.5:0/4129535497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 msgr2=0x7f21b8158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.869+0000 7f21bc851640 1 --2- 172.21.15.5:0/4129535497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b8158e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f21b80bf8f0 tx=0x7f21b002a680 comp rx=0 tx=0).stop 2024-05-16T21:33:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.869+0000 7f21bc851640 1 -- 172.21.15.5:0/4129535497 shutdown_connections 2024-05-16T21:33:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.869+0000 7f21bc851640 1 --2- 172.21.15.5:0/4129535497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b8158e90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.869+0000 7f21bc851640 1 --2- 172.21.15.5:0/4129535497 >> v2:172.21.15.157:3300/0 conn(0x7f21b8151fc0 0x7f21b80bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.869+0000 7f21bc851640 1 -- 172.21.15.5:0/4129535497 >> 172.21.15.5:0/4129535497 conn(0x7f21b80c3d20 msgr2=0x7f21b80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.869+0000 7f21bc851640 1 -- 172.21.15.5:0/4129535497 shutdown_connections 2024-05-16T21:33:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.869+0000 7f21bc851640 1 -- 172.21.15.5:0/4129535497 wait complete. 2024-05-16T21:33:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.871+0000 7f21bc851640 1 Processor -- start 2024-05-16T21:33:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.871+0000 7f21bc851640 1 -- start start 2024-05-16T21:33:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21bc851640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21b806da30 0x7f21b81e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21bc851640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21bc851640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b8151fc0 0x7f21b8148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21bc851640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f21b80a3050 con 0x7f21b80bf050 2024-05-16T21:33:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21bc851640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f21b80a2ed0 con 0x7f21b8151fc0 2024-05-16T21:33:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21bc851640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f21b806de40 con 0x7f21b806da30 2024-05-16T21:33:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21add9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21add9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50832/0 (socket says 172.21.15.5:50832) 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21add9b640 1 -- 172.21.15.5:0/3563207536 learned_addr learned my addr 172.21.15.5:0/3563207536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21b6d9d640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b8151fc0 0x7f21b8148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21b659c640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21b806da30 0x7f21b81e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21add9b640 1 -- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21b806da30 msgr2=0x7f21b81e4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21add9b640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21b806da30 0x7f21b81e4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21add9b640 1 -- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b8151fc0 msgr2=0x7f21b8148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21add9b640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b8151fc0 0x7f21b8148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.872+0000 7f21add9b640 1 -- 172.21.15.5:0/3563207536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b814e510 con 0x7f21b80bf050 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.873+0000 7f21b6d9d640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b8151fc0 0x7f21b8148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.873+0000 7f21add9b640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b814dfd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21a000b3e0 tx=0x7f21a000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.873+0000 7f21af7fe640 1 -- 172.21.15.5:0/3563207536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0015020 con 0x7f21b80bf050 2024-05-16T21:33:19.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.873+0000 7f21af7fe640 1 -- 172.21.15.5:0/3563207536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a0011830 con 0x7f21b80bf050 2024-05-16T21:33:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.873+0000 7f21af7fe640 1 -- 172.21.15.5:0/3563207536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0011c20 con 0x7f21b80bf050 2024-05-16T21:33:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.873+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b81e7cd0 con 0x7f21b80bf050 2024-05-16T21:33:19.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.873+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b81e8290 con 0x7f21b80bf050 2024-05-16T21:33:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.874+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b8050940 con 0x7f21b80bf050 2024-05-16T21:33:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.875+0000 7f21af7fe640 1 -- 172.21.15.5:0/3563207536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f21a0018020 con 0x7f21b80bf050 2024-05-16T21:33:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.875+0000 7f21af7fe640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f21980762d0 0x7f21980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.875+0000 7f21af7fe640 1 -- 172.21.15.5:0/3563207536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f21a0097400 con 0x7f21b80bf050 2024-05-16T21:33:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.876+0000 7f21b659c640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f21980762d0 0x7f21980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.876+0000 7f21b659c640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f21980762d0 0x7f21980787e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f21a800a950 tx=0x7f21a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:19.880+0000 7f21af7fe640 1 -- 172.21.15.5:0/3563207536 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f21a001f020 con 0x7f21b80bf050 2024-05-16T21:33:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.108+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21b806eb40 con 0x7f21b80bf050 2024-05-16T21:33:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.108+0000 7f21af7fe640 1 -- 172.21.15.5:0/3563207536 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4353 (secure 0 0 0) 0x7f21a00607a0 con 0x7f21b80bf050 2024-05-16T21:33:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:20.111 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2890333934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2890333934},{"type":"v1","addr":"172.21.15.5:6834","nonce":2890333934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3111678801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3111678801},{"type":"v1","addr":"172.21.15.157:6835","nonce":3111678801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:32:53.518776+0000","modified":"2024-05-16T21:32:56.567421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4692},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4692":{"gid":4692,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2543237506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543237506},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543237506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4692,"qdb_cluster":[4692]},"id":2}]} 2024-05-16T21:33:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f21980762d0 msgr2=0x7f21980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f21980762d0 0x7f21980787e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f21a800a950 tx=0x7f21a8008040 comp rx=0 tx=0).stop 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 msgr2=0x7f21b814dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b814dfd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21a000b3e0 tx=0x7f21a000b8a0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 shutdown_connections 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f21980762d0 0x7f21980787e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b8151fc0 0x7f21b8148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b80bf050 0x7f21b814dfd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 --2- 172.21.15.5:0/3563207536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21b806da30 0x7f21b81e4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 >> 172.21.15.5:0/3563207536 conn(0x7f21b80c3d20 msgr2=0x7f21b80c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:20.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 shutdown_connections 2024-05-16T21:33:20.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.110+0000 7f21bc851640 1 -- 172.21.15.5:0/3563207536 wait complete. 2024-05-16T21:33:20.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:33:20.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.231+0000 7fbb9235e640 1 Processor -- start 2024-05-16T21:33:20.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.231+0000 7fbb9235e640 1 -- start start 2024-05-16T21:33:20.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.232+0000 7fbb9235e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb8c0bd6d0 0x7fbb8c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.232+0000 7fbb9235e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c06e140 con 0x7fbb8c0bee80 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.232+0000 7fbb9235e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c0c36f0 con 0x7fbb8c151fc0 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.232+0000 7fbb9235e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8c152530 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.233+0000 7fbb8b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb8c0bd6d0 0x7fbb8c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.233+0000 7fbb8b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb8c0bd6d0 0x7fbb8c0be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50842/0 (socket says 172.21.15.5:50842) 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.233+0000 7fbb908fb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbb8c0bee80 0x7fbb8c158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36648/0 (socket says 172.21.15.5:36648) 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.233+0000 7fbb8b7fe640 1 -- 172.21.15.5:0/2767571731 learned_addr learned my addr 172.21.15.5:0/2767571731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.233+0000 7fbb8b7fe640 1 -- 172.21.15.5:0/2767571731 >> v1:172.21.15.157:6789/0 conn(0x7fbb8c151fc0 legacy=0x7fbb8c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.233+0000 7fbb8b7fe640 1 -- 172.21.15.5:0/2767571731 >> v1:172.21.15.5:6789/0 conn(0x7fbb8c0bee80 legacy=0x7fbb8c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.233+0000 7fbb8affd640 1 -- 172.21.15.5:0/2767571731 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540806236 0 0) 0x7fbb84001490 con 0x7fbb8c0bee80 2024-05-16T21:33:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.233+0000 7fbb8b7fe640 1 -- 172.21.15.5:0/2767571731 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c152810 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb8b7fe640 1 --2- 172.21.15.5:0/2767571731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c0be940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009870 tx=0x7fbb7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab37a9e4fa4609c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb8affd640 1 -- 172.21.15.5:0/2767571731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c037070 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb8affd640 1 -- 172.21.15.5:0/2767571731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c032440 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb8affd640 1 -- 172.21.15.5:0/2767571731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c032810 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb9235e640 1 -- 172.21.15.5:0/2767571731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 msgr2=0x7fbb8c0be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb9235e640 1 --2- 172.21.15.5:0/2767571731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c0be940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009870 tx=0x7fbb7c02a270 comp rx=0 tx=0).stop 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb9235e640 1 -- 172.21.15.5:0/2767571731 shutdown_connections 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb9235e640 1 --2- 172.21.15.5:0/2767571731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c0be940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb9235e640 1 -- 172.21.15.5:0/2767571731 >> 172.21.15.5:0/2767571731 conn(0x7fbb8c0c3d20 msgr2=0x7fbb8c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.234+0000 7fbb9235e640 1 -- 172.21.15.5:0/2767571731 shutdown_connections 2024-05-16T21:33:20.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.235+0000 7fbb9235e640 1 -- 172.21.15.5:0/2767571731 wait complete. 2024-05-16T21:33:20.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.236+0000 7fbb9235e640 1 Processor -- start 2024-05-16T21:33:20.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.236+0000 7fbb9235e640 1 -- start start 2024-05-16T21:33:20.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb9235e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c09d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb9235e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb8c0bee80 0x7fbb8c09ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb9235e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb8c151fc0 0x7fbb8c0a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb9235e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c0bdae0 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb9235e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c0c0070 con 0x7fbb8c0bee80 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb9235e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c0a2ed0 con 0x7fbb8c151fc0 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c09d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c09d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50850/0 (socket says 172.21.15.5:50850) 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb8bfff640 1 -- 172.21.15.5:0/501018388 learned_addr learned my addr 172.21.15.5:0/501018388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb8b7fe640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb8c0bee80 0x7fbb8c09ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.237+0000 7fbb908fb640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb8c151fc0 0x7fbb8c0a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb8bfff640 1 -- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb8c151fc0 msgr2=0x7fbb8c0a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb8bfff640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb8c151fc0 0x7fbb8c0a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb8bfff640 1 -- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb8c0bee80 msgr2=0x7fbb8c09ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb8bfff640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb8c0bee80 0x7fbb8c09ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb8bfff640 1 -- 172.21.15.5:0/501018388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c14dfd0 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb8bfff640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c09d990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000c400 tx=0x7fbb8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb88ff9640 1 -- 172.21.15.5:0/501018388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80017070 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb88ff9640 1 -- 172.21.15.5:0/501018388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb800052d0 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c09ded0 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb88ff9640 1 -- 172.21.15.5:0/501018388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80003830 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.238+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8c09f8d0 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.239+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c0c1050 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.240+0000 7fbb88ff9640 1 -- 172.21.15.5:0/501018388 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb8001a070 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.240+0000 7fbb88ff9640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbb780762d0 0x7fbb780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.240+0000 7fbb88ff9640 1 -- 172.21.15.5:0/501018388 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbb80096950 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.241+0000 7fbb8b7fe640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbb780762d0 0x7fbb780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.241+0000 7fbb8b7fe640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbb780762d0 0x7fbb780787e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c034000 tx=0x7fbb7c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.245+0000 7fbb88ff9640 1 -- 172.21.15.5:0/501018388 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbb8c0c1050 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.437+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb8c050940 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.438+0000 7fbb88ff9640 1 -- 172.21.15.5:0/501018388 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16621 (secure 0 0 0) 0x7fbb800682a0 con 0x7fbb8c0bd6d0 2024-05-16T21:33:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:20.441 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:32:55.121195+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:32:51.602373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T21:32:52.472465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:33:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbb780762d0 msgr2=0x7fbb780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbb780762d0 0x7fbb780787e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c034000 tx=0x7fbb7c02e000 comp rx=0 tx=0).stop 2024-05-16T21:33:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 msgr2=0x7fbb8c09d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c09d990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000c400 tx=0x7fbb8000c8c0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 shutdown_connections 2024-05-16T21:33:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbb780762d0 0x7fbb780787e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb8c151fc0 0x7fbb8c0a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb8c0bee80 0x7fbb8c09ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 --2- 172.21.15.5:0/501018388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8c0bd6d0 0x7fbb8c09d990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 >> 172.21.15.5:0/501018388 conn(0x7fbb8c0c3d20 msgr2=0x7fbb8c0c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 shutdown_connections 2024-05-16T21:33:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.440+0000 7fbb9235e640 1 -- 172.21.15.5:0/501018388 wait complete. 2024-05-16T21:33:20.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-16T21:33:20.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.564+0000 7f7a388af640 1 Processor -- start 2024-05-16T21:33:20.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.564+0000 7f7a388af640 1 -- start start 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a388af640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a340bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a388af640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a340b8d70 0x7f7a340b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a388af640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340bdd90 con 0x7f7a3414e530 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a388af640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7a340b88e0 con 0x7f7a340b8d70 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a388af640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3414ece0 con 0x7f7a340bd440 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a32d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a340b8d70 0x7f7a340b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a32d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a340b8d70 0x7f7a340b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50852/0 (socket says 172.21.15.5:50852) 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a32d9d640 1 -- 172.21.15.5:0/3705364479 learned_addr learned my addr 172.21.15.5:0/3705364479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a2bfff640 1 --2- 172.21.15.5:0/3705364479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a340bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a32d9d640 1 -- 172.21.15.5:0/3705364479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 msgr2=0x7f7a340bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a32d9d640 1 --2- 172.21.15.5:0/3705364479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a340bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a32d9d640 1 -- 172.21.15.5:0/3705364479 >> v1:172.21.15.5:6789/0 conn(0x7f7a3414e530 legacy=0x7f7a340ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a32d9d640 1 -- 172.21.15.5:0/3705364479 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3414efc0 con 0x7f7a340b8d70 2024-05-16T21:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a31d9b640 1 -- 172.21.15.5:0/3705364479 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4025456498 0 0) 0x7f7a340bdd90 con 0x7f7a3414e530 2024-05-16T21:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.565+0000 7f7a2bfff640 1 --2- 172.21.15.5:0/3705364479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a340bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.566+0000 7f7a32d9d640 1 --2- 172.21.15.5:0/3705364479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a340b9180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009e50 tx=0x7f7a2c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c692e1a88ff1d062 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.566+0000 7f7a31d9b640 1 -- 172.21.15.5:0/3705364479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c036070 con 0x7f7a340b8d70 2024-05-16T21:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.566+0000 7f7a31d9b640 1 -- 172.21.15.5:0/3705364479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2c031600 con 0x7f7a340b8d70 2024-05-16T21:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.566+0000 7f7a31d9b640 1 -- 172.21.15.5:0/3705364479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0319d0 con 0x7f7a340b8d70 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.567+0000 7f7a388af640 1 -- 172.21.15.5:0/3705364479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 msgr2=0x7f7a340b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.567+0000 7f7a388af640 1 --2- 172.21.15.5:0/3705364479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a340b9180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009e50 tx=0x7f7a2c02a710 comp rx=0 tx=0).stop 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.567+0000 7f7a388af640 1 -- 172.21.15.5:0/3705364479 shutdown_connections 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.567+0000 7f7a388af640 1 --2- 172.21.15.5:0/3705364479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a340b9180 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.567+0000 7f7a388af640 1 --2- 172.21.15.5:0/3705364479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a340bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.567+0000 7f7a388af640 1 -- 172.21.15.5:0/3705364479 >> 172.21.15.5:0/3705364479 conn(0x7f7a340c0570 msgr2=0x7f7a340c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.567+0000 7f7a388af640 1 -- 172.21.15.5:0/3705364479 shutdown_connections 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.567+0000 7f7a388af640 1 -- 172.21.15.5:0/3705364479 wait complete. 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.569+0000 7f7a388af640 1 Processor -- start 2024-05-16T21:33:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.569+0000 7f7a388af640 1 -- start start 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a388af640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a34140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a388af640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a3413eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a388af640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a3414e530 0x7f7a34151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a388af640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340b96c0 con 0x7f7a340b8d70 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a388af640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340bbb70 con 0x7f7a3414e530 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a388af640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3414e940 con 0x7f7a340bd440 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a34140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a34140390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50866/0 (socket says 172.21.15.5:50866) 2024-05-16T21:33:20.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 -- 172.21.15.5:0/1536716052 learned_addr learned my addr 172.21.15.5:0/1536716052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a32d9d640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a3414e530 0x7f7a34151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a2bfff640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a3413eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 -- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 msgr2=0x7f7a3413eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a3413eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 -- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a3414e530 msgr2=0x7f7a34151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a3414e530 0x7f7a34151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 -- 172.21.15.5:0/1536716052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a341408d0 con 0x7f7a340b8d70 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.570+0000 7f7a3259c640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a34140390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7a24001eb0 tx=0x7f7a2400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.571+0000 7f7a2affd640 1 -- 172.21.15.5:0/1536716052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24017070 con 0x7f7a340b8d70 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.571+0000 7f7a2affd640 1 -- 172.21.15.5:0/1536716052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a240035f0 con 0x7f7a340b8d70 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.571+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3413f3f0 con 0x7f7a340b8d70 2024-05-16T21:33:20.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.571+0000 7f7a2affd640 1 -- 172.21.15.5:0/1536716052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240039e0 con 0x7f7a340b8d70 2024-05-16T21:33:20.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.571+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a341e4120 con 0x7f7a340b8d70 2024-05-16T21:33:20.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.572+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a34050940 con 0x7f7a340b8d70 2024-05-16T21:33:20.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.572+0000 7f7a2affd640 1 -- 172.21.15.5:0/1536716052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a2401a070 con 0x7f7a340b8d70 2024-05-16T21:33:20.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.573+0000 7f7a2affd640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a14076300 0x7f7a14078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.573+0000 7f7a2affd640 1 -- 172.21.15.5:0/1536716052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f7a240969c0 con 0x7f7a340b8d70 2024-05-16T21:33:20.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.573+0000 7f7a2bfff640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a14076300 0x7f7a14078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.574+0000 7f7a2bfff640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a14076300 0x7f7a14078810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7a341de2a0 tx=0x7f7a1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.578+0000 7f7a2affd640 1 -- 172.21.15.5:0/1536716052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a24060280 con 0x7f7a340b8d70 2024-05-16T21:33:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.806+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7a3413e7e0 con 0x7f7a340b8d70 2024-05-16T21:33:20.809 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-05-16T21:33:20.806+0000 7fcd599bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-16T21:33:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.808+0000 7f7a2affd640 1 -- 172.21.15.5:0/1536716052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f7a2405fb80 con 0x7f7a340b8d70 2024-05-16T21:33:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-16T21:33:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a14076300 msgr2=0x7f7a14078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a14076300 0x7f7a14078810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7a341de2a0 tx=0x7f7a1c008040 comp rx=0 tx=0).stop 2024-05-16T21:33:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 msgr2=0x7f7a34140390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a34140390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7a24001eb0 tx=0x7f7a2400c820 comp rx=0 tx=0).stop 2024-05-16T21:33:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 shutdown_connections 2024-05-16T21:33:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a14076300 0x7f7a14078810 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a3414e530 0x7f7a34151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a340bd440 0x7f7a3413eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 --2- 172.21.15.5:0/1536716052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a340b8d70 0x7f7a34140390 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 >> 172.21.15.5:0/1536716052 conn(0x7f7a340c0570 msgr2=0x7f7a340ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 shutdown_connections 2024-05-16T21:33:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.811+0000 7f7a388af640 1 -- 172.21.15.5:0/1536716052 wait complete. 2024-05-16T21:33:20.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-16T21:33:20.880 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-05-16T21:33:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.941+0000 7efccb00c640 1 Processor -- start 2024-05-16T21:33:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.941+0000 7efccb00c640 1 -- start start 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.942+0000 7efccb00c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40b4500 0x7efcc40b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.942+0000 7efccb00c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efcc40b9ee0 0x7efcc40a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.942+0000 7efccb00c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc40bba80 con 0x7efcc40bb490 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.942+0000 7efccb00c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7efcc40bbd60 con 0x7efcc40b9ee0 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.942+0000 7efccb00c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efcc40b4ff0 con 0x7efcc40b4500 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.942+0000 7efcc8da8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efcc40bb490 0x7efcc406faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36670/0 (socket says 172.21.15.5:36670) 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.942+0000 7efcc8da8640 1 -- 172.21.15.5:0/2907894148 learned_addr learned my addr 172.21.15.5:0/2907894148 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc95a9640 1 --2- 172.21.15.5:0/2907894148 >> v2:172.21.15.157:3300/0 conn(0x7efcc40b9ee0 0x7efcc40a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc3fff640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40b4500 0x7efcc40b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256159854 0 0) 0x7efcc40bba80 con 0x7efcc40bb490 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcac003520 con 0x7efcc40bb490 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1477635282 0 0) 0x7efcac003520 con 0x7efcc40bb490 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40b4500 msgr2=0x7efcc40b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40b4500 0x7efcc40b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 >> v2:172.21.15.157:3300/0 conn(0x7efcc40b9ee0 msgr2=0x7efcc40a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 --2- 172.21.15.5:0/2907894148 >> v2:172.21.15.157:3300/0 conn(0x7efcc40b9ee0 0x7efcc40a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40b52d0 con 0x7efcc40bb490 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7efcb40016f0 con 0x7efcc40bb490 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 >> v1:172.21.15.5:6789/0 conn(0x7efcc40bb490 legacy=0x7efcc406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcac004800 0x7efcac004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40b4500 0x7efcac005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40bbd60 con 0x7efcac003a00 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40b4ff0 con 0x7efcac004800 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efcac00baf0 con 0x7efcc40b4500 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc8da8640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc3fff640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcac004800 0x7efcac004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.943+0000 7efcc95a9640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40b4500 0x7efcac005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc8da8640 1 -- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40b4500 msgr2=0x7efcac005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc8da8640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40b4500 0x7efcac005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc8da8640 1 -- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcac004800 msgr2=0x7efcac004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc8da8640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcac004800 0x7efcac004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc8da8640 1 -- 172.21.15.5:0/2907894148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac003520 con 0x7efcac003a00 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc8da8640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcac003e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efcb400c210 tx=0x7efcac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8baead78c37fa10 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4007d50 con 0x7efcac003a00 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb4005ad0 con 0x7efcac003a00 2024-05-16T21:33:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.944+0000 7efcc37fe640 1 -- 172.21.15.5:0/2907894148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4007070 con 0x7efcac003a00 2024-05-16T21:33:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.945+0000 7efccb00c640 1 -- 172.21.15.5:0/2907894148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 msgr2=0x7efcac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.945+0000 7efccb00c640 1 --2- 172.21.15.5:0/2907894148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcac003e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efcb400c210 tx=0x7efcac005830 comp rx=0 tx=0).stop 2024-05-16T21:33:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.945+0000 7efcc95a9640 1 -- 172.21.15.5:0/2907894148 reap_dead start 2024-05-16T21:33:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.945+0000 7efccb00c640 1 -- 172.21.15.5:0/2907894148 shutdown_connections 2024-05-16T21:33:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.945+0000 7efccb00c640 1 -- 172.21.15.5:0/2907894148 >> 172.21.15.5:0/2907894148 conn(0x7efcc40a1ac0 msgr2=0x7efcc40bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.945+0000 7efccb00c640 1 -- 172.21.15.5:0/2907894148 shutdown_connections 2024-05-16T21:33:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.945+0000 7efccb00c640 1 -- 172.21.15.5:0/2907894148 wait complete. 2024-05-16T21:33:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.947+0000 7efccb00c640 1 Processor -- start 2024-05-16T21:33:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.947+0000 7efccb00c640 1 -- start start 2024-05-16T21:33:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efccb00c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcc41e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efccb00c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40a0400 0x7efcc409f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efccb00c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc409fdc0 0x7efcc40b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efccb00c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40a45c0 con 0x7efcac003a00 2024-05-16T21:33:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efccb00c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40ba2f0 con 0x7efcc409fdc0 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efccb00c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efcc40a4740 con 0x7efcc40a0400 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc8da8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcc41e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc8da8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcc41e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50882/0 (socket says 172.21.15.5:50882) 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc8da8640 1 -- 172.21.15.5:0/1210641894 learned_addr learned my addr 172.21.15.5:0/1210641894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc95a9640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc409fdc0 0x7efcc40b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc3fff640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40a0400 0x7efcc409f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc8da8640 1 -- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40a0400 msgr2=0x7efcc409f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc8da8640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40a0400 0x7efcc409f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc8da8640 1 -- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc409fdc0 msgr2=0x7efcc40b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc8da8640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc409fdc0 0x7efcc40b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.948+0000 7efcc8da8640 1 -- 172.21.15.5:0/1210641894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc41e5e40 con 0x7efcac003a00 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.949+0000 7efcc95a9640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc409fdc0 0x7efcc40b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.949+0000 7efcc3fff640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40a0400 0x7efcc409f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.949+0000 7efcc8da8640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcc41e5900 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efcb402adb0 tx=0x7efcb4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.949+0000 7efcc17fa640 1 -- 172.21.15.5:0/1210641894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb40016b0 con 0x7efcac003a00 2024-05-16T21:33:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.949+0000 7efcc17fa640 1 -- 172.21.15.5:0/1210641894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb4042070 con 0x7efcac003a00 2024-05-16T21:33:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.949+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc4146950 con 0x7efcac003a00 2024-05-16T21:33:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.949+0000 7efcc17fa640 1 -- 172.21.15.5:0/1210641894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb40072d0 con 0x7efcac003a00 2024-05-16T21:33:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.949+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc409bf10 con 0x7efcac003a00 2024-05-16T21:33:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.950+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc409ba60 con 0x7efcac003a00 2024-05-16T21:33:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.951+0000 7efcc17fa640 1 -- 172.21.15.5:0/1210641894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efcb4007470 con 0x7efcac003a00 2024-05-16T21:33:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.951+0000 7efcc17fa640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efcb00762d0 0x7efcb00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.951+0000 7efcc17fa640 1 -- 172.21.15.5:0/1210641894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7efcb40b7940 con 0x7efcac003a00 2024-05-16T21:33:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.951+0000 7efcc3fff640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efcb00762d0 0x7efcb00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.952+0000 7efcc3fff640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efcb00762d0 0x7efcb00787e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efcc41dca70 tx=0x7efcb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:20.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:20.956+0000 7efcc17fa640 1 -- 172.21.15.5:0/1210641894 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efcb4005aa0 con 0x7efcac003a00 2024-05-16T21:33:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.187+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efcc40a2690 con 0x7efcac003a00 2024-05-16T21:33:21.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.809+0000 7efcc17fa640 1 -- 172.21.15.5:0/1210641894 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7efcb40811b0 con 0x7efcac003a00 2024-05-16T21:33:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.812+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efcb00762d0 msgr2=0x7efcb00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.812+0000 7efccb00c640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efcb00762d0 0x7efcb00787e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efcc41dca70 tx=0x7efcb8008040 comp rx=0 tx=0).stop 2024-05-16T21:33:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.812+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 msgr2=0x7efcc41e5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.812+0000 7efccb00c640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcc41e5900 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efcb402adb0 tx=0x7efcb4001a30 comp rx=0 tx=0).stop 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.812+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 shutdown_connections 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.813+0000 7efccb00c640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efcb00762d0 0x7efcb00787e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.813+0000 7efccb00c640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc409fdc0 0x7efcc40b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.813+0000 7efccb00c640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcc40a0400 0x7efcc409f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.813+0000 7efccb00c640 1 --2- 172.21.15.5:0/1210641894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcac003a00 0x7efcc41e5900 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.813+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 >> 172.21.15.5:0/1210641894 conn(0x7efcc40a1ac0 msgr2=0x7efcc4148cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.813+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 shutdown_connections 2024-05-16T21:33:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.813+0000 7efccb00c640 1 -- 172.21.15.5:0/1210641894 wait complete. 2024-05-16T21:33:21.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-16T21:33:21.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.949+0000 7fc0eef9f640 1 Processor -- start 2024-05-16T21:33:21.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.949+0000 7fc0eef9f640 1 -- start start 2024-05-16T21:33:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.950+0000 7fc0eef9f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0e814f010 0x7fc0e80bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.950+0000 7fc0eef9f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e80c0eb0 con 0x7fc0e808d130 2024-05-16T21:33:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.950+0000 7fc0eef9f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e80beed0 con 0x7fc0e80be330 2024-05-16T21:33:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.950+0000 7fc0eef9f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e814e470 con 0x7fc0e814f010 2024-05-16T21:33:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.951+0000 7fc0ee79e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0e814f010 0x7fc0e80bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.951+0000 7fc0ed79c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0e808d130 0x7fc0e814e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36682/0 (socket says 172.21.15.5:36682) 2024-05-16T21:33:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.951+0000 7fc0ed79c640 1 -- 172.21.15.5:0/4255175250 learned_addr learned my addr 172.21.15.5:0/4255175250 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.951+0000 7fc0ee79e640 1 -- 172.21.15.5:0/4255175250 >> v1:172.21.15.157:6789/0 conn(0x7fc0e80be330 legacy=0x7fc0e80c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.951+0000 7fc0ee79e640 1 -- 172.21.15.5:0/4255175250 >> v1:172.21.15.5:6789/0 conn(0x7fc0e808d130 legacy=0x7fc0e814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.951+0000 7fc0ecf9b640 1 -- 172.21.15.5:0/4255175250 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2276121674 0 0) 0x7fc0dc001110 con 0x7fc0e808d130 2024-05-16T21:33:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.951+0000 7fc0ee79e640 1 -- 172.21.15.5:0/4255175250 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e80be910 con 0x7fc0e814f010 2024-05-16T21:33:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.952+0000 7fc0ee79e640 1 --2- 172.21.15.5:0/4255175250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e814f010 0x7fc0e80bd4d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0e814e5f0 tx=0x7fc0d802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcda7332601bb80 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.952+0000 7fc0ecf9b640 1 -- 172.21.15.5:0/4255175250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8037070 con 0x7fc0e814f010 2024-05-16T21:33:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.952+0000 7fc0ecf9b640 1 -- 172.21.15.5:0/4255175250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d8007740 con 0x7fc0e814f010 2024-05-16T21:33:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.952+0000 7fc0ecf9b640 1 -- 172.21.15.5:0/4255175250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8007b10 con 0x7fc0e814f010 2024-05-16T21:33:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.953+0000 7fc0eef9f640 1 -- 172.21.15.5:0/4255175250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e814f010 msgr2=0x7fc0e80bd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.953+0000 7fc0eef9f640 1 --2- 172.21.15.5:0/4255175250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e814f010 0x7fc0e80bd4d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0e814e5f0 tx=0x7fc0d802a780 comp rx=0 tx=0).stop 2024-05-16T21:33:21.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.953+0000 7fc0eef9f640 1 -- 172.21.15.5:0/4255175250 shutdown_connections 2024-05-16T21:33:21.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.953+0000 7fc0eef9f640 1 --2- 172.21.15.5:0/4255175250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e814f010 0x7fc0e80bd4d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:21.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.953+0000 7fc0eef9f640 1 -- 172.21.15.5:0/4255175250 >> 172.21.15.5:0/4255175250 conn(0x7fc0e80c3c40 msgr2=0x7fc0e80c0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:21.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.953+0000 7fc0eef9f640 1 -- 172.21.15.5:0/4255175250 shutdown_connections 2024-05-16T21:33:21.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.953+0000 7fc0eef9f640 1 -- 172.21.15.5:0/4255175250 wait complete. 2024-05-16T21:33:21.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.954+0000 7fc0eef9f640 1 Processor -- start 2024-05-16T21:33:21.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.954+0000 7fc0eef9f640 1 -- start start 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0eef9f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e808d130 0x7fc0e8145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0eef9f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e80be330 0x7fc0e80b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0eef9f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0e80b7b10 0x7fc0e80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0eef9f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e8159d00 con 0x7fc0e808d130 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0eef9f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e8159b80 con 0x7fc0e80b7b10 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0eef9f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e8159e80 con 0x7fc0e80be330 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0edf9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e808d130 0x7fc0e8145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0edf9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e808d130 0x7fc0e8145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50906/0 (socket says 172.21.15.5:50906) 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.955+0000 7fc0edf9d640 1 -- 172.21.15.5:0/941674223 learned_addr learned my addr 172.21.15.5:0/941674223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0ed79c640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e80be330 0x7fc0e80b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0ee79e640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0e80b7b10 0x7fc0e80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0edf9d640 1 -- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e80be330 msgr2=0x7fc0e80b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0edf9d640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e80be330 0x7fc0e80b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0edf9d640 1 -- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0e80b7b10 msgr2=0x7fc0e80b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0edf9d640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0e80b7b10 0x7fc0e80b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0edf9d640 1 -- 172.21.15.5:0/941674223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e8145dd0 con 0x7fc0e808d130 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0ed79c640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e80be330 0x7fc0e80b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0edf9d640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e808d130 0x7fc0e8145890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c400 tx=0x7fc0e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0e67fc640 1 -- 172.21.15.5:0/941674223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0017070 con 0x7fc0e808d130 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0e67fc640 1 -- 172.21.15.5:0/941674223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e00052d0 con 0x7fc0e808d130 2024-05-16T21:33:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e80b6fe0 con 0x7fc0e808d130 2024-05-16T21:33:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0e67fc640 1 -- 172.21.15.5:0/941674223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0003830 con 0x7fc0e808d130 2024-05-16T21:33:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.956+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e80b8510 con 0x7fc0e808d130 2024-05-16T21:33:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.957+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e8050860 con 0x7fc0e808d130 2024-05-16T21:33:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.958+0000 7fc0e67fc640 1 -- 172.21.15.5:0/941674223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0e001a070 con 0x7fc0e808d130 2024-05-16T21:33:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.958+0000 7fc0e67fc640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc0d40762d0 0x7fc0d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.959+0000 7fc0e67fc640 1 -- 172.21.15.5:0/941674223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fc0e00969d0 con 0x7fc0e808d130 2024-05-16T21:33:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.959+0000 7fc0ed79c640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc0d40762d0 0x7fc0d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.959+0000 7fc0ed79c640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc0d40762d0 0x7fc0d40787e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80a4df0 tx=0x7fc0dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:21.963+0000 7fc0e67fc640 1 -- 172.21.15.5:0/941674223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc0e00602d0 con 0x7fc0e808d130 2024-05-16T21:33:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.155+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc0e8147010 con 0x7fc0e808d130 2024-05-16T21:33:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.815+0000 7fc0e67fc640 1 -- 172.21.15.5:0/941674223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) ==== 181+0+0 (secure 0 0 0) 0x7fc0e00682c0 con 0x7fc0e808d130 2024-05-16T21:33:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-05-16T21:33:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc0d40762d0 msgr2=0x7fc0d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc0d40762d0 0x7fc0d40787e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80a4df0 tx=0x7fc0dc009040 comp rx=0 tx=0).stop 2024-05-16T21:33:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e808d130 msgr2=0x7fc0e8145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e808d130 0x7fc0e8145890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c400 tx=0x7fc0e000c8c0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 shutdown_connections 2024-05-16T21:33:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc0d40762d0 0x7fc0d40787e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0e80b7b10 0x7fc0e80b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e80be330 0x7fc0e80b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 --2- 172.21.15.5:0/941674223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e808d130 0x7fc0e8145890 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.820+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 >> 172.21.15.5:0/941674223 conn(0x7fc0e80c3c40 msgr2=0x7fc0e80c0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.821+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 shutdown_connections 2024-05-16T21:33:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.821+0000 7fc0eef9f640 1 -- 172.21.15.5:0/941674223 wait complete. 2024-05-16T21:33:22.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-16T21:33:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.963+0000 7f999cf3f640 1 Processor -- start 2024-05-16T21:33:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.963+0000 7f999cf3f640 1 -- start start 2024-05-16T21:33:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f999cf3f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f999814e760 0x7f999806dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f999cf3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99980beb90 0x7f99980bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f999cf3f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999814ec80 con 0x7f99980bd510 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f999cf3f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f999814f5b0 con 0x7f99980beb90 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f999cf3f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f999814ef60 con 0x7f999814e760 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f9996d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99980beb90 0x7f99980bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f9996d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99980beb90 0x7f99980bd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50910/0 (socket says 172.21.15.5:50910) 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f9996d9d640 1 -- 172.21.15.5:0/59200338 learned_addr learned my addr 172.21.15.5:0/59200338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f999659c640 1 --2- 172.21.15.5:0/59200338 >> v2:172.21.15.157:3300/0 conn(0x7f999814e760 0x7f999806dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f9996d9d640 1 -- 172.21.15.5:0/59200338 >> v2:172.21.15.157:3300/0 conn(0x7f999814e760 msgr2=0x7f999806dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f9996d9d640 1 --2- 172.21.15.5:0/59200338 >> v2:172.21.15.157:3300/0 conn(0x7f999814e760 0x7f999806dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f9996d9d640 1 -- 172.21.15.5:0/59200338 >> v1:172.21.15.157:6789/0 conn(0x7f99980bd510 legacy=0x7f99980be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.964+0000 7f9996d9d640 1 -- 172.21.15.5:0/59200338 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999814f240 con 0x7f99980beb90 2024-05-16T21:33:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.965+0000 7f9996d9d640 1 --2- 172.21.15.5:0/59200338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99980bd920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f999808dff0 tx=0x7f998802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2a55e9e2370804 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.965+0000 7f999559a640 1 -- 172.21.15.5:0/59200338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988036070 con 0x7f99980beb90 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.965+0000 7f999559a640 1 -- 172.21.15.5:0/59200338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9988031600 con 0x7f99980beb90 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.965+0000 7f999559a640 1 -- 172.21.15.5:0/59200338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99880319f0 con 0x7f99980beb90 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.966+0000 7f999cf3f640 1 -- 172.21.15.5:0/59200338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 msgr2=0x7f99980bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.966+0000 7f999cf3f640 1 --2- 172.21.15.5:0/59200338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99980bd920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f999808dff0 tx=0x7f998802a7c0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.966+0000 7f999cf3f640 1 -- 172.21.15.5:0/59200338 shutdown_connections 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.966+0000 7f999cf3f640 1 --2- 172.21.15.5:0/59200338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99980bd920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.966+0000 7f999cf3f640 1 --2- 172.21.15.5:0/59200338 >> v2:172.21.15.157:3300/0 conn(0x7f999814e760 0x7f999806dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.966+0000 7f999cf3f640 1 -- 172.21.15.5:0/59200338 >> 172.21.15.5:0/59200338 conn(0x7f99980c3ce0 msgr2=0x7f99980c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.966+0000 7f999cf3f640 1 -- 172.21.15.5:0/59200338 shutdown_connections 2024-05-16T21:33:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.966+0000 7f999cf3f640 1 -- 172.21.15.5:0/59200338 wait complete. 2024-05-16T21:33:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.968+0000 7f999cf3f640 1 Processor -- start 2024-05-16T21:33:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.968+0000 7f999cf3f640 1 -- start start 2024-05-16T21:33:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f999cf3f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99980bd510 0x7f99981e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f999cf3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99981462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f999cf3f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f999814e760 0x7f99981e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f999cf3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f999808db20 con 0x7f99980beb90 2024-05-16T21:33:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f999cf3f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f999806eb10 con 0x7f99980bd510 2024-05-16T21:33:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f999cf3f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f999808dca0 con 0x7f999814e760 2024-05-16T21:33:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9995d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99981462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9995d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99981462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50926/0 (socket says 172.21.15.5:50926) 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9995d9b640 1 -- 172.21.15.5:0/1434727326 learned_addr learned my addr 172.21.15.5:0/1434727326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f999659c640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99980bd510 0x7f99981e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9996d9d640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f999814e760 0x7f99981e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9995d9b640 1 -- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f999814e760 msgr2=0x7f99981e45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9995d9b640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f999814e760 0x7f99981e45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9995d9b640 1 -- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99980bd510 msgr2=0x7f99981e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9995d9b640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99980bd510 0x7f99981e7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9995d9b640 1 -- 172.21.15.5:0/1434727326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99981e8210 con 0x7f99980beb90 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.969+0000 7f9996d9d640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f999814e760 0x7f99981e45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.970+0000 7f9995d9b640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99981462d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f998000c3d0 tx=0x7f998000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.970+0000 7f998effd640 1 -- 172.21.15.5:0/1434727326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980017070 con 0x7f99980beb90 2024-05-16T21:33:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.970+0000 7f998effd640 1 -- 172.21.15.5:0/1434727326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99800052d0 con 0x7f99980beb90 2024-05-16T21:33:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.970+0000 7f998effd640 1 -- 172.21.15.5:0/1434727326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980003830 con 0x7f99980beb90 2024-05-16T21:33:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.970+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9998146810 con 0x7f99980beb90 2024-05-16T21:33:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.970+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9998145ad0 con 0x7f99980beb90 2024-05-16T21:33:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.971+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9998050940 con 0x7f99980beb90 2024-05-16T21:33:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.971+0000 7f998effd640 1 -- 172.21.15.5:0/1434727326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f998001a070 con 0x7f99980beb90 2024-05-16T21:33:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.972+0000 7f998effd640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99780762d0 0x7f99780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.972+0000 7f998effd640 1 -- 172.21.15.5:0/1434727326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5357+0+0 (secure 0 0 0) 0x7f99800967d0 con 0x7f99980beb90 2024-05-16T21:33:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.972+0000 7f999659c640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99780762d0 0x7f99780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.973+0000 7f999659c640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99780762d0 0x7f99780787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9990006fd0 tx=0x7f9990008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:22.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:22.977+0000 7f998effd640 1 -- 172.21.15.5:0/1434727326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9980060290 con 0x7f99980beb90 2024-05-16T21:33:23.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.175+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9998146ce0 con 0x7f99980beb90 2024-05-16T21:33:23.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.821+0000 7f998effd640 1 -- 172.21.15.5:0/1434727326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) ==== 169+0+0 (secure 0 0 0) 0x7f9980068280 con 0x7f99980beb90 2024-05-16T21:33:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-05-16T21:33:23.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99780762d0 msgr2=0x7f99780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99780762d0 0x7f99780787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9990006fd0 tx=0x7f9990008040 comp rx=0 tx=0).stop 2024-05-16T21:33:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 msgr2=0x7f99981462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99981462d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f998000c3d0 tx=0x7f998000c890 comp rx=0 tx=0).stop 2024-05-16T21:33:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 shutdown_connections 2024-05-16T21:33:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f99780762d0 0x7f99780787e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f999814e760 0x7f99981e45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99980beb90 0x7f99981462d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 --2- 172.21.15.5:0/1434727326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99980bd510 0x7f99981e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.826+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 >> 172.21.15.5:0/1434727326 conn(0x7f99980c3ce0 msgr2=0x7f99980a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.827+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 shutdown_connections 2024-05-16T21:33:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.828+0000 7f999cf3f640 1 -- 172.21.15.5:0/1434727326 wait complete. 2024-05-16T21:33:23.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-16T21:33:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.975+0000 7fc385fb2640 1 Processor -- start 2024-05-16T21:33:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.975+0000 7fc385fb2640 1 -- start start 2024-05-16T21:33:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc385fb2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc380148910 0x7fc38014e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc385fb2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc38014eba0 0x7fc380158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc385fb2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3800ba800 con 0x7fc3800a9060 2024-05-16T21:33:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc385fb2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc3800b8a30 con 0x7fc38014eba0 2024-05-16T21:33:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc385fb2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc3800b8d10 con 0x7fc380148910 2024-05-16T21:33:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3800a9060 0x7fc3800ba0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36696/0 (socket says 172.21.15.5:36696) 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37f7fe640 1 -- 172.21.15.5:0/4045036067 learned_addr learned my addr 172.21.15.5:0/4045036067 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37ffff640 1 --2- 172.21.15.5:0/4045036067 >> v2:172.21.15.5:3300/0 conn(0x7fc38014eba0 0x7fc380158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37e7fc640 1 -- 172.21.15.5:0/4045036067 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995129933 0 0) 0x7fc370001110 con 0x7fc3800a9060 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37e7fc640 1 -- 172.21.15.5:0/4045036067 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc368003520 con 0x7fc3800a9060 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37effd640 1 --2- 172.21.15.5:0/4045036067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc380148910 0x7fc38014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37ffff640 1 -- 172.21.15.5:0/4045036067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc380148910 msgr2=0x7fc38014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37ffff640 1 --2- 172.21.15.5:0/4045036067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc380148910 0x7fc38014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37ffff640 1 -- 172.21.15.5:0/4045036067 >> v1:172.21.15.5:6789/0 conn(0x7fc3800a9060 legacy=0x7fc3800ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.976+0000 7fc37ffff640 1 -- 172.21.15.5:0/4045036067 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3800b8ff0 con 0x7fc38014eba0 2024-05-16T21:33:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.977+0000 7fc37ffff640 1 --2- 172.21.15.5:0/4045036067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380158db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc378009d90 tx=0x7fc37802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234507ea8501f0c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.977+0000 7fc37e7fc640 1 -- 172.21.15.5:0/4045036067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378007740 con 0x7fc38014eba0 2024-05-16T21:33:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.977+0000 7fc37e7fc640 1 -- 172.21.15.5:0/4045036067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3780078e0 con 0x7fc38014eba0 2024-05-16T21:33:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.977+0000 7fc37e7fc640 1 -- 172.21.15.5:0/4045036067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378007cb0 con 0x7fc38014eba0 2024-05-16T21:33:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.978+0000 7fc385fb2640 1 -- 172.21.15.5:0/4045036067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 msgr2=0x7fc380158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.978+0000 7fc385fb2640 1 --2- 172.21.15.5:0/4045036067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380158db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc378009d90 tx=0x7fc37802a6f0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.978+0000 7fc385fb2640 1 -- 172.21.15.5:0/4045036067 shutdown_connections 2024-05-16T21:33:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.978+0000 7fc385fb2640 1 --2- 172.21.15.5:0/4045036067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380158db0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.978+0000 7fc385fb2640 1 --2- 172.21.15.5:0/4045036067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc380148910 0x7fc38014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.978+0000 7fc385fb2640 1 -- 172.21.15.5:0/4045036067 >> 172.21.15.5:0/4045036067 conn(0x7fc3800c07c0 msgr2=0x7fc3800c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.978+0000 7fc385fb2640 1 -- 172.21.15.5:0/4045036067 shutdown_connections 2024-05-16T21:33:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.978+0000 7fc385fb2640 1 -- 172.21.15.5:0/4045036067 wait complete. 2024-05-16T21:33:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.979+0000 7fc385fb2640 1 Processor -- start 2024-05-16T21:33:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.980+0000 7fc385fb2640 1 -- start start 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc385fb2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3800a9060 0x7fc3801e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc385fb2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc380148910 0x7fc3800c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc385fb2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc385fb2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc38008d400 con 0x7fc38014eba0 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc385fb2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc38014efb0 con 0x7fc380148910 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc385fb2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc38008d580 con 0x7fc3800a9060 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50950/0 (socket says 172.21.15.5:50950) 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 -- 172.21.15.5:0/1398489543 learned_addr learned my addr 172.21.15.5:0/1398489543 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37f7fe640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3800a9060 0x7fc3801e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37effd640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc380148910 0x7fc3800c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 -- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3800a9060 msgr2=0x7fc3801e7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3800a9060 0x7fc3801e7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 -- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc380148910 msgr2=0x7fc3800c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc380148910 0x7fc3800c2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 -- 172.21.15.5:0/1398489543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3800c2e70 con 0x7fc38014eba0 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc37ffff640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380140b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc378009eb0 tx=0x7fc378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc367fff640 1 -- 172.21.15.5:0/1398489543 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37803f070 con 0x7fc38014eba0 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc367fff640 1 -- 172.21.15.5:0/1398489543 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc378031bc0 con 0x7fc38014eba0 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.981+0000 7fc367fff640 1 -- 172.21.15.5:0/1398489543 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378009450 con 0x7fc38014eba0 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.982+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3801444e0 con 0x7fc38014eba0 2024-05-16T21:33:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.982+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3801465e0 con 0x7fc38014eba0 2024-05-16T21:33:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.983+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3800c0160 con 0x7fc38014eba0 2024-05-16T21:33:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.983+0000 7fc367fff640 1 -- 172.21.15.5:0/1398489543 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc37803b410 con 0x7fc38014eba0 2024-05-16T21:33:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.984+0000 7fc367fff640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc36c076300 0x7fc36c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.984+0000 7fc367fff640 1 -- 172.21.15.5:0/1398489543 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fc3780b87f0 con 0x7fc38014eba0 2024-05-16T21:33:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.984+0000 7fc37f7fe640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc36c076300 0x7fc36c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.985+0000 7fc37f7fe640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc36c076300 0x7fc36c078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc370005880 tx=0x7fc370009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:23.989+0000 7fc367fff640 1 -- 172.21.15.5:0/1398489543 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3800c0160 con 0x7fc38014eba0 2024-05-16T21:33:24.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.181+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc3800ba9e0 con 0x7fc38014eba0 2024-05-16T21:33:24.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.185+0000 7fc367fff640 1 -- 172.21.15.5:0/1398489543 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fc378081e90 con 0x7fc38014eba0 2024-05-16T21:33:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc36c076300 msgr2=0x7fc36c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc36c076300 0x7fc36c078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc370005880 tx=0x7fc370009040 comp rx=0 tx=0).stop 2024-05-16T21:33:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 msgr2=0x7fc380140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380140b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc378009eb0 tx=0x7fc378004a40 comp rx=0 tx=0).stop 2024-05-16T21:33:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 shutdown_connections 2024-05-16T21:33:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc36c076300 0x7fc36c078810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc38014eba0 0x7fc380140b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc380148910 0x7fc3800c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 --2- 172.21.15.5:0/1398489543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3800a9060 0x7fc3801e7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 >> 172.21.15.5:0/1398489543 conn(0x7fc3800c07c0 msgr2=0x7fc380146dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:24.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 shutdown_connections 2024-05-16T21:33:24.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.187+0000 7fc385fb2640 1 -- 172.21.15.5:0/1398489543 wait complete. 2024-05-16T21:33:24.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount' 2024-05-16T21:33:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.310+0000 7fcf4c6a8640 1 Processor -- start 2024-05-16T21:33:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.310+0000 7fcf4c6a8640 1 -- start start 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf4c6a8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcf440bc1c0 0x7fcf440a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf4c6a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf44146380 0x7fcf44070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf4c6a8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf4414c120 con 0x7fcf4414c8e0 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf4c6a8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcf4414c450 con 0x7fcf440bc1c0 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf4c6a8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcf44071e40 con 0x7fcf44146380 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf4ac45640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf4414c8e0 0x7fcf4414f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36702/0 (socket says 172.21.15.5:36702) 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf4ac45640 1 -- 172.21.15.5:0/4258159740 learned_addr learned my addr 172.21.15.5:0/4258159740 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18494697 0 0) 0x7fcf4414c120 con 0x7fcf4414c8e0 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf4a444640 1 --2- 172.21.15.5:0/4258159740 >> v2:172.21.15.157:3300/0 conn(0x7fcf440bc1c0 0x7fcf440a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf30003520 con 0x7fcf4414c8e0 2024-05-16T21:33:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.311+0000 7fcf49c43640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf44146380 0x7fcf44070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 82593632 0 0) 0x7fcf30003520 con 0x7fcf4414c8e0 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf44146380 msgr2=0x7fcf44070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf44146380 0x7fcf44070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 >> v2:172.21.15.157:3300/0 conn(0x7fcf440bc1c0 msgr2=0x7fcf440a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 --2- 172.21.15.5:0/4258159740 >> v2:172.21.15.157:3300/0 conn(0x7fcf440bc1c0 0x7fcf440a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf440713d0 con 0x7fcf4414c8e0 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fcf3c001a90 con 0x7fcf4414c8e0 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 >> v1:172.21.15.5:6789/0 conn(0x7fcf4414c8e0 legacy=0x7fcf4414f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf30003a00 0x7fcf30003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf30004800 0x7fcf30004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf44146380 0x7fcf30005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4414c450 con 0x7fcf30003a00 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcf44071e40 con 0x7fcf30004800 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3000ba70 con 0x7fcf44146380 2024-05-16T21:33:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf4a444640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf30003a00 0x7fcf30003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf49c43640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf30004800 0x7fcf30004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf4ac45640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf44146380 0x7fcf30005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf4a444640 1 -- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf44146380 msgr2=0x7fcf30005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf4a444640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf44146380 0x7fcf30005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf4a444640 1 -- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf30004800 msgr2=0x7fcf30004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf4a444640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf30004800 0x7fcf30004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.312+0000 7fcf4a444640 1 -- 172.21.15.5:0/4258159740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf30003520 con 0x7fcf30003a00 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.313+0000 7fcf4a444640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf30003a00 0x7fcf30003e70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009ac0 tx=0x7fcf30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915fd8b6119f7cc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.313+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40036070 con 0x7fcf30003a00 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.313+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf40031400 con 0x7fcf30003a00 2024-05-16T21:33:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.313+0000 7fcf49442640 1 -- 172.21.15.5:0/4258159740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40009690 con 0x7fcf30003a00 2024-05-16T21:33:24.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.314+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/4258159740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf30003a00 msgr2=0x7fcf30003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.314+0000 7fcf4c6a8640 1 --2- 172.21.15.5:0/4258159740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf30003a00 0x7fcf30003e70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009ac0 tx=0x7fcf30005830 comp rx=0 tx=0).stop 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.314+0000 7fcf4ac45640 1 -- 172.21.15.5:0/4258159740 reap_dead start 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.314+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/4258159740 shutdown_connections 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.314+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/4258159740 >> 172.21.15.5:0/4258159740 conn(0x7fcf440c17c0 msgr2=0x7fcf440c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.314+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/4258159740 shutdown_connections 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.314+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/4258159740 wait complete. 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.315+0000 7fcf4c6a8640 1 Processor -- start 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.315+0000 7fcf4c6a8640 1 -- start start 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.316+0000 7fcf4c6a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf30003a00 0x7fcf4414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.316+0000 7fcf4c6a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4413fb80 0x7fcf4413ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.316+0000 7fcf4c6a8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf440a14e0 0x7fcf440a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf4c6a8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcf440bd5f0 con 0x7fcf4413fb80 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf4c6a8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcf44146790 con 0x7fcf440a14e0 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf4c6a8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcf440bd770 con 0x7fcf30003a00 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4413fb80 0x7fcf4413ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4413fb80 0x7fcf4413ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50968/0 (socket says 172.21.15.5:50968) 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 -- 172.21.15.5:0/2123776236 learned_addr learned my addr 172.21.15.5:0/2123776236 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf4ac45640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf440a14e0 0x7fcf440a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf4a444640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf30003a00 0x7fcf4414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 -- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf30003a00 msgr2=0x7fcf4414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf30003a00 0x7fcf4414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 -- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf440a14e0 msgr2=0x7fcf440a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf440a14e0 0x7fcf440a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 -- 172.21.15.5:0/2123776236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf441482a0 con 0x7fcf4413fb80 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf49c43640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4413fb80 0x7fcf4413ff90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcf34011910 tx=0x7fcf34011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf3affd640 1 -- 172.21.15.5:0/2123776236 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400f9f0 con 0x7fcf4413fb80 2024-05-16T21:33:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf3affd640 1 -- 172.21.15.5:0/2123776236 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3400fb90 con 0x7fcf4413fb80 2024-05-16T21:33:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4414b6e0 con 0x7fcf4413fb80 2024-05-16T21:33:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf3affd640 1 -- 172.21.15.5:0/2123776236 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf34014440 con 0x7fcf4413fb80 2024-05-16T21:33:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.317+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf441470e0 con 0x7fcf4413fb80 2024-05-16T21:33:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.318+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf440a7b50 con 0x7fcf4413fb80 2024-05-16T21:33:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.319+0000 7fcf3affd640 1 -- 172.21.15.5:0/2123776236 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf34012040 con 0x7fcf4413fb80 2024-05-16T21:33:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.320+0000 7fcf3affd640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcf28076300 0x7fcf28078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.320+0000 7fcf3affd640 1 -- 172.21.15.5:0/2123776236 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fcf34097670 con 0x7fcf4413fb80 2024-05-16T21:33:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.320+0000 7fcf4a444640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcf28076300 0x7fcf28078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.321+0000 7fcf4a444640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcf28076300 0x7fcf28078810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009ac0 tx=0x7fcf40008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.325+0000 7fcf3affd640 1 -- 172.21.15.5:0/2123776236 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf34019030 con 0x7fcf4413fb80 2024-05-16T21:33:24.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.610+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]} v 0) -- 0x7fcf44149b20 con 0x7fcf4413fb80 2024-05-16T21:33:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.823+0000 7fcf3affd640 1 -- 172.21.15.5:0/2123776236 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]}]=0 v77) ==== 141+0+0 (secure 0 0 0) 0x7fcf34060c80 con 0x7fcf4413fb80 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcf28076300 msgr2=0x7fcf28078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcf28076300 0x7fcf28078810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009ac0 tx=0x7fcf40008030 comp rx=0 tx=0).stop 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4413fb80 msgr2=0x7fcf4413ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4413fb80 0x7fcf4413ff90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcf34011910 tx=0x7fcf34011dd0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 shutdown_connections 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcf28076300 0x7fcf28078810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf440a14e0 0x7fcf440a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4413fb80 0x7fcf4413ff90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 --2- 172.21.15.5:0/2123776236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf30003a00 0x7fcf4414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 >> 172.21.15.5:0/2123776236 conn(0x7fcf440c17c0 msgr2=0x7fcf441425b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:24.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 shutdown_connections 2024-05-16T21:33:24.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.826+0000 7fcf4c6a8640 1 -- 172.21.15.5:0/2123776236 wait complete. 2024-05-16T21:33:24.842 INFO:tasks.cephfs_test_runner:That fscrypt can be setup and ingest files. ... ok 2024-05-16T21:33:24.843 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) That alternate_name can be recovered from the journal. 2024-05-16T21:33:24.843 INFO:tasks.cephfs_test_runner:test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T21:33:24.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:33:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.959+0000 7fe81dd4d640 1 Processor -- start 2024-05-16T21:33:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.959+0000 7fe81dd4d640 1 -- start start 2024-05-16T21:33:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.960+0000 7fe81dd4d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe818151fc0 0x7fe8180bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.960+0000 7fe81dd4d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe81806da30 0x7fe8180be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.960+0000 7fe81dd4d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806de40 0x7fe8180bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.960+0000 7fe81dd4d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe8180bdc10 con 0x7fe81806da30 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.960+0000 7fe81dd4d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe8180c36f0 con 0x7fe818151fc0 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.960+0000 7fe81dd4d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe818152530 con 0x7fe81806de40 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.960+0000 7fe816ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe81806da30 0x7fe8180be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe816ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe81806da30 0x7fe8180be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50978/0 (socket says 172.21.15.5:50978) 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe816ffd640 1 -- 172.21.15.5:0/3657960720 learned_addr learned my addr 172.21.15.5:0/3657960720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe817fff640 1 --2- 172.21.15.5:0/3657960720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806de40 0x7fe8180bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe8177fe640 1 --2- 172.21.15.5:0/3657960720 >> v2:172.21.15.157:3300/0 conn(0x7fe818151fc0 0x7fe8180bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe816ffd640 1 -- 172.21.15.5:0/3657960720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806de40 msgr2=0x7fe8180bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe816ffd640 1 --2- 172.21.15.5:0/3657960720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806de40 0x7fe8180bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe816ffd640 1 -- 172.21.15.5:0/3657960720 >> v2:172.21.15.157:3300/0 conn(0x7fe818151fc0 msgr2=0x7fe8180bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe816ffd640 1 --2- 172.21.15.5:0/3657960720 >> v2:172.21.15.157:3300/0 conn(0x7fe818151fc0 0x7fe8180bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe816ffd640 1 -- 172.21.15.5:0/3657960720 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe818152810 con 0x7fe81806da30 2024-05-16T21:33:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe817fff640 1 --2- 172.21.15.5:0/3657960720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806de40 0x7fe8180bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.961+0000 7fe8177fe640 1 --2- 172.21.15.5:0/3657960720 >> v2:172.21.15.157:3300/0 conn(0x7fe818151fc0 0x7fe8180bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe816ffd640 1 --2- 172.21.15.5:0/3657960720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe81806da30 0x7fe8180be940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe8180c38d0 tx=0x7fe80c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad813229443c15 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe8167fc640 1 -- 172.21.15.5:0/3657960720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c037070 con 0x7fe81806da30 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe8167fc640 1 -- 172.21.15.5:0/3657960720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c032440 con 0x7fe81806da30 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe8167fc640 1 -- 172.21.15.5:0/3657960720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c032810 con 0x7fe81806da30 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe81dd4d640 1 -- 172.21.15.5:0/3657960720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe81806da30 msgr2=0x7fe8180be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/3657960720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe81806da30 0x7fe8180be940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe8180c38d0 tx=0x7fe80c02a1c0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe81dd4d640 1 -- 172.21.15.5:0/3657960720 shutdown_connections 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/3657960720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe81806da30 0x7fe8180be940 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/3657960720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806de40 0x7fe8180bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.962+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/3657960720 >> v2:172.21.15.157:3300/0 conn(0x7fe818151fc0 0x7fe8180bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.963+0000 7fe81dd4d640 1 -- 172.21.15.5:0/3657960720 >> 172.21.15.5:0/3657960720 conn(0x7fe8180c3d20 msgr2=0x7fe8180c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.963+0000 7fe81dd4d640 1 -- 172.21.15.5:0/3657960720 shutdown_connections 2024-05-16T21:33:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.963+0000 7fe81dd4d640 1 -- 172.21.15.5:0/3657960720 wait complete. 2024-05-16T21:33:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.964+0000 7fe81dd4d640 1 Processor -- start 2024-05-16T21:33:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.964+0000 7fe81dd4d640 1 -- start start 2024-05-16T21:33:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.965+0000 7fe81dd4d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806da30 0x7fe8180a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.965+0000 7fe81dd4d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe81806de40 0x7fe81814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.965+0000 7fe81dd4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818151fc0 0x7fe81814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.965+0000 7fe81dd4d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180a3050 con 0x7fe818151fc0 2024-05-16T21:33:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.965+0000 7fe81dd4d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180a2ed0 con 0x7fe81806de40 2024-05-16T21:33:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.965+0000 7fe81dd4d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe81814e570 con 0x7fe81806da30 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818151fc0 0x7fe81814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818151fc0 0x7fe81814bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50984/0 (socket says 172.21.15.5:50984) 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 -- 172.21.15.5:0/312587200 learned_addr learned my addr 172.21.15.5:0/312587200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe816ffd640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe81806de40 0x7fe81814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe8177fe640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806da30 0x7fe8180a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 -- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806da30 msgr2=0x7fe8180a2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806da30 0x7fe8180a2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 -- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe81806de40 msgr2=0x7fe81814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe81806de40 0x7fe81814b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 -- 172.21.15.5:0/312587200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8180a2b80 con 0x7fe818151fc0 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe817fff640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818151fc0 0x7fe81814bae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe810007db0 tx=0x7fe81000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe7fffff640 1 -- 172.21.15.5:0/312587200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81001a070 con 0x7fe818151fc0 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe7fffff640 1 -- 172.21.15.5:0/312587200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810003990 con 0x7fe818151fc0 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8180bc600 con 0x7fe818151fc0 2024-05-16T21:33:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe7fffff640 1 -- 172.21.15.5:0/312587200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810003d60 con 0x7fe818151fc0 2024-05-16T21:33:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.966+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8180b7680 con 0x7fe818151fc0 2024-05-16T21:33:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.967+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8180bc410 con 0x7fe818151fc0 2024-05-16T21:33:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.968+0000 7fe7fffff640 1 -- 172.21.15.5:0/312587200 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe81001d070 con 0x7fe818151fc0 2024-05-16T21:33:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.968+0000 7fe7fffff640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe804076300 0x7fe804078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.969+0000 7fe7fffff640 1 -- 172.21.15.5:0/312587200 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fe810097420 con 0x7fe818151fc0 2024-05-16T21:33:24.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.969+0000 7fe8177fe640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe804076300 0x7fe804078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:24.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.969+0000 7fe8177fe640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe804076300 0x7fe804078810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe808006fd0 tx=0x7fe808008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:24.973+0000 7fe7fffff640 1 -- 172.21.15.5:0/312587200 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe810010070 con 0x7fe818151fc0 2024-05-16T21:33:25.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.166+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe818050940 con 0x7fe818151fc0 2024-05-16T21:33:25.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.167+0000 7fe7fffff640 1 -- 172.21.15.5:0/312587200 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+12970 (secure 0 0 0) 0x7fe810060a30 con 0x7fe818151fc0 2024-05-16T21:33:25.170 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:25.170 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:33:23.817093+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/2543237506":"2024-05-17T21:33:20.808353+0000","172.21.15.5:6833/2543237506":"2024-05-17T21:33:20.808353+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:33:25.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe804076300 msgr2=0x7fe804078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe804076300 0x7fe804078810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe808006fd0 tx=0x7fe808008040 comp rx=0 tx=0).stop 2024-05-16T21:33:25.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818151fc0 msgr2=0x7fe81814bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818151fc0 0x7fe81814bae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe810007db0 tx=0x7fe81000d4a0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 shutdown_connections 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe804076300 0x7fe804078810 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818151fc0 0x7fe81814bae0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe81806de40 0x7fe81814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 --2- 172.21.15.5:0/312587200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe81806da30 0x7fe8180a2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 >> 172.21.15.5:0/312587200 conn(0x7fe8180c3d20 msgr2=0x7fe8180c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 shutdown_connections 2024-05-16T21:33:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.169+0000 7fe81dd4d640 1 -- 172.21.15.5:0/312587200 wait complete. 2024-05-16T21:33:25.183 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-16T21:32:10.378693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-16T21:33:25.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-16T21:33:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.294+0000 7fdf23496640 1 Processor -- start 2024-05-16T21:33:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.295+0000 7fdf23496640 1 -- start start 2024-05-16T21:33:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf23496640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdf1c0c10a0 0x7fdf1c14f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf23496640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c14c7e0 0x7fdf1c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf23496640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf1c14ffe0 con 0x7fdf1c146070 2024-05-16T21:33:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf23496640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdf1c0a1200 con 0x7fdf1c0c10a0 2024-05-16T21:33:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf23496640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdf1c14c350 con 0x7fdf1c14c7e0 2024-05-16T21:33:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf21232640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdf1c0c10a0 0x7fdf1c14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf21a33640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c14c7e0 0x7fdf1c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf21232640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdf1c0c10a0 0x7fdf1c14f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.5:57960/0 (socket says 172.21.15.5:57960) 2024-05-16T21:33:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf21232640 1 -- 172.21.15.5:0/3358894619 learned_addr learned my addr 172.21.15.5:0/3358894619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf21a33640 1 -- 172.21.15.5:0/3358894619 >> v2:172.21.15.157:3300/0 conn(0x7fdf1c0c10a0 msgr2=0x7fdf1c14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf21a33640 1 --2- 172.21.15.5:0/3358894619 >> v2:172.21.15.157:3300/0 conn(0x7fdf1c0c10a0 0x7fdf1c14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf21a33640 1 -- 172.21.15.5:0/3358894619 >> v1:172.21.15.157:6789/0 conn(0x7fdf1c146070 legacy=0x7fdf1c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.296+0000 7fdf21a33640 1 -- 172.21.15.5:0/3358894619 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1c1502c0 con 0x7fdf1c14c7e0 2024-05-16T21:33:25.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.297+0000 7fdf21232640 1 --2- 172.21.15.5:0/3358894619 >> v2:172.21.15.157:3300/0 conn(0x7fdf1c0c10a0 0x7fdf1c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:33:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.297+0000 7fdf21a33640 1 --2- 172.21.15.5:0/3358894619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c14c7e0 0x7fdf1c14cbf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009d90 tx=0x7fdf1402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecce9f1a2f28524 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.297+0000 7fdf0ffff640 1 -- 172.21.15.5:0/3358894619 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14007740 con 0x7fdf1c14c7e0 2024-05-16T21:33:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.297+0000 7fdf0ffff640 1 -- 172.21.15.5:0/3358894619 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf140078e0 con 0x7fdf1c14c7e0 2024-05-16T21:33:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.297+0000 7fdf0ffff640 1 -- 172.21.15.5:0/3358894619 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14007cb0 con 0x7fdf1c14c7e0 2024-05-16T21:33:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.298+0000 7fdf23496640 1 -- 172.21.15.5:0/3358894619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c14c7e0 msgr2=0x7fdf1c14cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.298+0000 7fdf23496640 1 --2- 172.21.15.5:0/3358894619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c14c7e0 0x7fdf1c14cbf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009d90 tx=0x7fdf1402a6f0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.298+0000 7fdf23496640 1 -- 172.21.15.5:0/3358894619 shutdown_connections 2024-05-16T21:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.298+0000 7fdf23496640 1 --2- 172.21.15.5:0/3358894619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c14c7e0 0x7fdf1c14cbf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.298+0000 7fdf23496640 1 --2- 172.21.15.5:0/3358894619 >> v2:172.21.15.157:3300/0 conn(0x7fdf1c0c10a0 0x7fdf1c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.298+0000 7fdf23496640 1 -- 172.21.15.5:0/3358894619 >> 172.21.15.5:0/3358894619 conn(0x7fdf1c0c1830 msgr2=0x7fdf1c0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.298+0000 7fdf23496640 1 -- 172.21.15.5:0/3358894619 shutdown_connections 2024-05-16T21:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.298+0000 7fdf23496640 1 -- 172.21.15.5:0/3358894619 wait complete. 2024-05-16T21:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.300+0000 7fdf23496640 1 Processor -- start 2024-05-16T21:33:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.300+0000 7fdf23496640 1 -- start start 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf23496640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c0c10a0 0x7fdf1c0a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf23496640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c146070 0x7fdf1c1e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf23496640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf1c14c7e0 0x7fdf1c14dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf23496640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c14d130 con 0x7fdf1c146070 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf23496640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c0c14b0 con 0x7fdf1c14c7e0 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf23496640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdf1c14fcb0 con 0x7fdf1c0c10a0 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c146070 0x7fdf1c1e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c146070 0x7fdf1c1e2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50986/0 (socket says 172.21.15.5:50986) 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 -- 172.21.15.5:0/1688431293 learned_addr learned my addr 172.21.15.5:0/1688431293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf21a33640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf1c14c7e0 0x7fdf1c14dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf21232640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c0c10a0 0x7fdf1c0a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 -- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c0c10a0 msgr2=0x7fdf1c0a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c0c10a0 0x7fdf1c0a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 -- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf1c14c7e0 msgr2=0x7fdf1c14dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf1c14c7e0 0x7fdf1c14dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 -- 172.21.15.5:0/1688431293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1c1e2760 con 0x7fdf1c146070 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.301+0000 7fdf20a31640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c146070 0x7fdf1c1e2220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000c370 tx=0x7fdf1000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.302+0000 7fdf0dffb640 1 -- 172.21.15.5:0/1688431293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10017070 con 0x7fdf1c146070 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.302+0000 7fdf0dffb640 1 -- 172.21.15.5:0/1688431293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf100052d0 con 0x7fdf1c146070 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.302+0000 7fdf0dffb640 1 -- 172.21.15.5:0/1688431293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10003810 con 0x7fdf1c146070 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.302+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1c0a5df0 con 0x7fdf1c146070 2024-05-16T21:33:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.302+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1c0a4df0 con 0x7fdf1c146070 2024-05-16T21:33:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.303+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf1c050940 con 0x7fdf1c146070 2024-05-16T21:33:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.303+0000 7fdf0dffb640 1 -- 172.21.15.5:0/1688431293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf1001a070 con 0x7fdf1c146070 2024-05-16T21:33:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.304+0000 7fdf0dffb640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdf000762d0 0x7fdf000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.304+0000 7fdf0dffb640 1 -- 172.21.15.5:0/1688431293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fdf10096580 con 0x7fdf1c146070 2024-05-16T21:33:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.304+0000 7fdf21232640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdf000762d0 0x7fdf000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.305+0000 7fdf21232640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdf000762d0 0x7fdf000787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf18006ca0 tx=0x7fdf18009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.309+0000 7fdf0dffb640 1 -- 172.21.15.5:0/1688431293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdf1005fb80 con 0x7fdf1c146070 2024-05-16T21:33:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.501+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf1c14be70 con 0x7fdf1c146070 2024-05-16T21:33:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.502+0000 7fdf0dffb640 1 -- 172.21.15.5:0/1688431293 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7fdf100681c0 con 0x7fdf1c146070 2024-05-16T21:33:25.505 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-05-16T21:33:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdf000762d0 msgr2=0x7fdf000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdf000762d0 0x7fdf000787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf18006ca0 tx=0x7fdf18009240 comp rx=0 tx=0).stop 2024-05-16T21:33:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c146070 msgr2=0x7fdf1c1e2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c146070 0x7fdf1c1e2220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000c370 tx=0x7fdf1000c830 comp rx=0 tx=0).stop 2024-05-16T21:33:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 shutdown_connections 2024-05-16T21:33:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdf000762d0 0x7fdf000787e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf1c14c7e0 0x7fdf1c14dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c146070 0x7fdf1c1e2220 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 --2- 172.21.15.5:0/1688431293 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf1c0c10a0 0x7fdf1c0a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 >> 172.21.15.5:0/1688431293 conn(0x7fdf1c0c1830 msgr2=0x7fdf1c0a3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 shutdown_connections 2024-05-16T21:33:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.504+0000 7fdf23496640 1 -- 172.21.15.5:0/1688431293 wait complete. 2024-05-16T21:33:25.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery' 2024-05-16T21:33:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.626+0000 7fd67f88b640 1 Processor -- start 2024-05-16T21:33:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.627+0000 7fd67f88b640 1 -- start start 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67f88b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6780bd6d0 0x7fd6780be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67f88b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6780bee80 0x7fd678158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67f88b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd67806e140 con 0x7fd678151fc0 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67f88b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd6780c36f0 con 0x7fd6780bee80 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67f88b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd678152530 con 0x7fd6780bd6d0 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67de28640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6780bee80 0x7fd678158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67d627640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd678151fc0 0x7fd67806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36706/0 (socket says 172.21.15.5:36706) 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67d627640 1 -- 172.21.15.5:0/2261417154 learned_addr learned my addr 172.21.15.5:0/2261417154 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67ce26640 1 --2- 172.21.15.5:0/2261417154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6780bd6d0 0x7fd6780be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67de28640 1 -- 172.21.15.5:0/2261417154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6780bd6d0 msgr2=0x7fd6780be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67de28640 1 --2- 172.21.15.5:0/2261417154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6780bd6d0 0x7fd6780be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67de28640 1 -- 172.21.15.5:0/2261417154 >> v1:172.21.15.5:6789/0 conn(0x7fd678151fc0 legacy=0x7fd67806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67de28640 1 -- 172.21.15.5:0/2261417154 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd678152810 con 0x7fd6780bee80 2024-05-16T21:33:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd677fff640 1 -- 172.21.15.5:0/2261417154 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655528738 0 0) 0x7fd670001110 con 0x7fd678151fc0 2024-05-16T21:33:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.628+0000 7fd67ce26640 1 --2- 172.21.15.5:0/2261417154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6780bd6d0 0x7fd6780be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.629+0000 7fd67de28640 1 --2- 172.21.15.5:0/2261417154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd678158e90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd668009d90 tx=0x7fd66802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f6f13c56d72d5d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.629+0000 7fd677fff640 1 -- 172.21.15.5:0/2261417154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668007740 con 0x7fd6780bee80 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.629+0000 7fd677fff640 1 -- 172.21.15.5:0/2261417154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6680078e0 con 0x7fd6780bee80 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.629+0000 7fd677fff640 1 -- 172.21.15.5:0/2261417154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668007cb0 con 0x7fd6780bee80 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.630+0000 7fd67f88b640 1 -- 172.21.15.5:0/2261417154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 msgr2=0x7fd678158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.630+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2261417154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd678158e90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd668009d90 tx=0x7fd66802a660 comp rx=0 tx=0).stop 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.630+0000 7fd67f88b640 1 -- 172.21.15.5:0/2261417154 shutdown_connections 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.630+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2261417154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd678158e90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.630+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2261417154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6780bd6d0 0x7fd6780be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.630+0000 7fd67f88b640 1 -- 172.21.15.5:0/2261417154 >> 172.21.15.5:0/2261417154 conn(0x7fd6780c3d20 msgr2=0x7fd6780c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.630+0000 7fd67f88b640 1 -- 172.21.15.5:0/2261417154 shutdown_connections 2024-05-16T21:33:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.630+0000 7fd67f88b640 1 -- 172.21.15.5:0/2261417154 wait complete. 2024-05-16T21:33:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.631+0000 7fd67f88b640 1 Processor -- start 2024-05-16T21:33:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.631+0000 7fd67f88b640 1 -- start start 2024-05-16T21:33:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67f88b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780bd6d0 0x7fd6780a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67f88b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd6780b8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67f88b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd678151fc0 0x7fd6781e4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67f88b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd6780bdae0 con 0x7fd6780bee80 2024-05-16T21:33:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67f88b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd6780c0070 con 0x7fd6780bd6d0 2024-05-16T21:33:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67f88b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd6780a2ed0 con 0x7fd678151fc0 2024-05-16T21:33:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67ce26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd6780b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67ce26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd6780b8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51002/0 (socket says 172.21.15.5:51002) 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.632+0000 7fd67ce26640 1 -- 172.21.15.5:0/2241327366 learned_addr learned my addr 172.21.15.5:0/2241327366 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67de28640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd678151fc0 0x7fd6781e4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67d627640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780bd6d0 0x7fd6780a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67ce26640 1 -- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd678151fc0 msgr2=0x7fd6781e4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67ce26640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd678151fc0 0x7fd6781e4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67ce26640 1 -- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780bd6d0 msgr2=0x7fd6780a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67ce26640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780bd6d0 0x7fd6780a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67ce26640 1 -- 172.21.15.5:0/2241327366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6780a2b70 con 0x7fd6780bee80 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67ce26640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd6780b8860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00d7d0 tx=0x7fd66c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd675ffb640 1 -- 172.21.15.5:0/2241327366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c004030 con 0x7fd6780bee80 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd675ffb640 1 -- 172.21.15.5:0/2241327366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66c0041d0 con 0x7fd6780bee80 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67814f0d0 con 0x7fd6780bee80 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd675ffb640 1 -- 172.21.15.5:0/2241327366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0096a0 con 0x7fd6780bee80 2024-05-16T21:33:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.633+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67814e330 con 0x7fd6780bee80 2024-05-16T21:33:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.634+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd678050940 con 0x7fd6780bee80 2024-05-16T21:33:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.635+0000 7fd675ffb640 1 -- 172.21.15.5:0/2241327366 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd66c009840 con 0x7fd6780bee80 2024-05-16T21:33:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.635+0000 7fd675ffb640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd6640762d0 0x7fd6640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.636+0000 7fd675ffb640 1 -- 172.21.15.5:0/2241327366 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fd66c097580 con 0x7fd6780bee80 2024-05-16T21:33:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.636+0000 7fd67d627640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd6640762d0 0x7fd6640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.636+0000 7fd67d627640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd6640762d0 0x7fd6640787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd670000f60 tx=0x7fd670007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:25.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.640+0000 7fd675ffb640 1 -- 172.21.15.5:0/2241327366 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd66c0611e0 con 0x7fd6780bee80 2024-05-16T21:33:25.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:25.906+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery"]} v 0) -- 0x7fd67806eb40 con 0x7fd6780bee80 2024-05-16T21:33:26.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:33:26.165 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:33:26.167 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:33:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.830+0000 7fd675ffb640 1 -- 172.21.15.5:0/2241327366 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery"]}]=0 v79) ==== 157+0+0 (secure 0 0 0) 0x7fd66c060ae0 con 0x7fd6780bee80 2024-05-16T21:33:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.832+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd6640762d0 msgr2=0x7fd6640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.832+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd6640762d0 0x7fd6640787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd670000f60 tx=0x7fd670007c00 comp rx=0 tx=0).stop 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.832+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 msgr2=0x7fd6780b8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.832+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd6780b8860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00d7d0 tx=0x7fd66c00dc90 comp rx=0 tx=0).stop 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.833+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 shutdown_connections 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.833+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd6640762d0 0x7fd6640787e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.833+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd678151fc0 0x7fd6781e4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.833+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6780bee80 0x7fd6780b8860 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.833+0000 7fd67f88b640 1 --2- 172.21.15.5:0/2241327366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780bd6d0 0x7fd6780a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.833+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 >> 172.21.15.5:0/2241327366 conn(0x7fd6780c3d20 msgr2=0x7fd6780a4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.833+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 shutdown_connections 2024-05-16T21:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.833+0000 7fd67f88b640 1 -- 172.21.15.5:0/2241327366 wait complete. 2024-05-16T21:33:26.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-16T21:33:26.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.968+0000 7f3e96d1f640 1 Processor -- start 2024-05-16T21:33:26.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.968+0000 7f3e96d1f640 1 -- start start 2024-05-16T21:33:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e96d1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e90151fc0 0x7f3e900bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e96d1f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3e900bf050 0x7f3e90158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e96d1f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e900c36f0 con 0x7f3e9006da30 2024-05-16T21:33:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e96d1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3e900bdc10 con 0x7f3e90151fc0 2024-05-16T21:33:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e96d1f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3e90152530 con 0x7f3e900bf050 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e94abb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e90151fc0 0x7f3e900bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e8ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3e9006da30 0x7f3e900be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50530/0 (socket says 172.21.15.5:50530) 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e8ffff640 1 -- 172.21.15.5:0/1648690892 learned_addr learned my addr 172.21.15.5:0/1648690892 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e952bc640 1 --2- 172.21.15.5:0/1648690892 >> v2:172.21.15.157:3300/0 conn(0x7f3e900bf050 0x7f3e90158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e94abb640 1 -- 172.21.15.5:0/1648690892 >> v2:172.21.15.157:3300/0 conn(0x7f3e900bf050 msgr2=0x7f3e90158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e94abb640 1 --2- 172.21.15.5:0/1648690892 >> v2:172.21.15.157:3300/0 conn(0x7f3e900bf050 0x7f3e90158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e94abb640 1 -- 172.21.15.5:0/1648690892 >> v1:172.21.15.5:6789/0 conn(0x7f3e9006da30 legacy=0x7f3e900be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e94abb640 1 -- 172.21.15.5:0/1648690892 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e90152810 con 0x7f3e90151fc0 2024-05-16T21:33:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.969+0000 7f3e8f7fe640 1 -- 172.21.15.5:0/1648690892 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74098799 0 0) 0x7f3e900c36f0 con 0x7f3e9006da30 2024-05-16T21:33:26.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.970+0000 7f3e94abb640 1 --2- 172.21.15.5:0/1648690892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900bd6d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e900bf8f0 tx=0x7f3e8402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a828f6c7922225d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:26.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.970+0000 7f3e8f7fe640 1 -- 172.21.15.5:0/1648690892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84037070 con 0x7f3e90151fc0 2024-05-16T21:33:26.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.970+0000 7f3e8f7fe640 1 -- 172.21.15.5:0/1648690892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e84032440 con 0x7f3e90151fc0 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.970+0000 7f3e8f7fe640 1 -- 172.21.15.5:0/1648690892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84032810 con 0x7f3e90151fc0 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.971+0000 7f3e96d1f640 1 -- 172.21.15.5:0/1648690892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 msgr2=0x7f3e900bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.971+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/1648690892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900bd6d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e900bf8f0 tx=0x7f3e8402a1a0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.971+0000 7f3e96d1f640 1 -- 172.21.15.5:0/1648690892 shutdown_connections 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.971+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/1648690892 >> v2:172.21.15.157:3300/0 conn(0x7f3e900bf050 0x7f3e90158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.971+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/1648690892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900bd6d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.971+0000 7f3e96d1f640 1 -- 172.21.15.5:0/1648690892 >> 172.21.15.5:0/1648690892 conn(0x7f3e900c3d20 msgr2=0x7f3e900c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.971+0000 7f3e96d1f640 1 -- 172.21.15.5:0/1648690892 shutdown_connections 2024-05-16T21:33:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.971+0000 7f3e96d1f640 1 -- 172.21.15.5:0/1648690892 wait complete. 2024-05-16T21:33:26.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.973+0000 7f3e96d1f640 1 Processor -- start 2024-05-16T21:33:26.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.973+0000 7f3e96d1f640 1 -- start start 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e96d1f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e9006da30 0x7f3e9014e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e96d1f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e900bf050 0x7f3e901e4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e96d1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e96d1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900a3050 con 0x7f3e90151fc0 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e96d1f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900a2ed0 con 0x7f3e9006da30 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e96d1f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9006de40 con 0x7f3e900bf050 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e952bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e952bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55004/0 (socket says 172.21.15.5:55004) 2024-05-16T21:33:26.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e952bc640 1 -- 172.21.15.5:0/2921521533 learned_addr learned my addr 172.21.15.5:0/2921521533 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e94abb640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e9006da30 0x7f3e9014e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e8ffff640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e900bf050 0x7f3e901e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e952bc640 1 -- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e900bf050 msgr2=0x7f3e901e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e952bc640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e900bf050 0x7f3e901e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e952bc640 1 -- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e9006da30 msgr2=0x7f3e9014e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e952bc640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e9006da30 0x7f3e9014e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e952bc640 1 -- 172.21.15.5:0/2921521533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9014d970 con 0x7f3e90151fc0 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.974+0000 7f3e8ffff640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e900bf050 0x7f3e901e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.975+0000 7f3e952bc640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900b60c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800cc60 tx=0x7f3e8800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.975+0000 7f3e8d7fa640 1 -- 172.21.15.5:0/2921521533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88003990 con 0x7f3e90151fc0 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.975+0000 7f3e8d7fa640 1 -- 172.21.15.5:0/2921521533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e88003b30 con 0x7f3e90151fc0 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.975+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9014e920 con 0x7f3e90151fc0 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.975+0000 7f3e8d7fa640 1 -- 172.21.15.5:0/2921521533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88004020 con 0x7f3e90151fc0 2024-05-16T21:33:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.975+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9014dbe0 con 0x7f3e90151fc0 2024-05-16T21:33:26.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.976+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e90050940 con 0x7f3e90151fc0 2024-05-16T21:33:26.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.977+0000 7f3e8d7fa640 1 -- 172.21.15.5:0/2921521533 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3e880041c0 con 0x7f3e90151fc0 2024-05-16T21:33:26.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.977+0000 7f3e8d7fa640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3e740762d0 0x7f3e740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:26.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.977+0000 7f3e8d7fa640 1 -- 172.21.15.5:0/2921521533 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f3e88097610 con 0x7f3e90151fc0 2024-05-16T21:33:26.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.977+0000 7f3e94abb640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3e740762d0 0x7f3e740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:26.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.978+0000 7f3e94abb640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3e740762d0 0x7f3e740787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3e84034000 tx=0x7f3e8402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:26.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:26.982+0000 7f3e8d7fa640 1 -- 172.21.15.5:0/2921521533 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3e88014030 con 0x7f3e90151fc0 2024-05-16T21:33:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.175+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3e9014e080 con 0x7f3e90151fc0 2024-05-16T21:33:27.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.178+0000 7f3e8d7fa640 1 -- 172.21.15.5:0/2921521533 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f3e880692f0 con 0x7f3e90151fc0 2024-05-16T21:33:27.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3e740762d0 msgr2=0x7f3e740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:27.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3e740762d0 0x7f3e740787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3e84034000 tx=0x7f3e8402e000 comp rx=0 tx=0).stop 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 msgr2=0x7f3e900b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900b60c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800cc60 tx=0x7f3e8800a5c0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 shutdown_connections 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3e740762d0 0x7f3e740787e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e90151fc0 0x7f3e900b60c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e900bf050 0x7f3e901e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 --2- 172.21.15.5:0/2921521533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e9006da30 0x7f3e9014e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.180+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 >> 172.21.15.5:0/2921521533 conn(0x7f3e900c3d20 msgr2=0x7f3e900c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.181+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 shutdown_connections 2024-05-16T21:33:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.181+0000 7f3e96d1f640 1 -- 172.21.15.5:0/2921521533 wait complete. 2024-05-16T21:33:27.194 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-16T21:33:27.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:27.220 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:27.375 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:27.485 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-16T21:33:27.486 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:33:27.486 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:33:27.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052711,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497968k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248980k,nr_inodes=812245,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497968k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-05-16T21:33:27.538 INFO:tasks.cephfs.cephfs_test_case:[] 2024-05-16T21:33:27.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.650+0000 7f3d73357640 1 Processor -- start 2024-05-16T21:33:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.650+0000 7f3d73357640 1 -- start start 2024-05-16T21:33:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.651+0000 7f3d73357640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c148770 0x7f3d6c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.651+0000 7f3d73357640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d6c0bf9b0 0x7f3d6c0bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.651+0000 7f3d73357640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d6c0c0620 con 0x7f3d6c14e360 2024-05-16T21:33:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.651+0000 7f3d73357640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3d6c151e40 con 0x7f3d6c0bf9b0 2024-05-16T21:33:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.651+0000 7f3d73357640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6c151ad0 con 0x7f3d6c148770 2024-05-16T21:33:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d718f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d6c0bf9b0 0x7f3d6c0bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d718f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d6c0bf9b0 0x7f3d6c0bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55018/0 (socket says 172.21.15.5:55018) 2024-05-16T21:33:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d718f4640 1 -- 172.21.15.5:0/1167180670 learned_addr learned my addr 172.21.15.5:0/1167180670 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d708f2640 1 --2- 172.21.15.5:0/1167180670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c148770 0x7f3d6c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d718f4640 1 -- 172.21.15.5:0/1167180670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c148770 msgr2=0x7f3d6c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d718f4640 1 --2- 172.21.15.5:0/1167180670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c148770 0x7f3d6c0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d718f4640 1 -- 172.21.15.5:0/1167180670 >> v1:172.21.15.157:6789/0 conn(0x7f3d6c14e360 legacy=0x7f3d6c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d718f4640 1 -- 172.21.15.5:0/1167180670 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c0c0300 con 0x7f3d6c0bf9b0 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.652+0000 7f3d708f2640 1 --2- 172.21.15.5:0/1167180670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c148770 0x7f3d6c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.653+0000 7f3d718f4640 1 --2- 172.21.15.5:0/1167180670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0bf9b0 0x7f3d6c0bfdc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009e50 tx=0x7f3d5c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ced5038cca7c165 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.653+0000 7f3d6bfff640 1 -- 172.21.15.5:0/1167180670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c036070 con 0x7f3d6c0bf9b0 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.653+0000 7f3d6bfff640 1 -- 172.21.15.5:0/1167180670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c031600 con 0x7f3d6c0bf9b0 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.653+0000 7f3d6bfff640 1 -- 172.21.15.5:0/1167180670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0319d0 con 0x7f3d6c0bf9b0 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.653+0000 7f3d73357640 1 -- 172.21.15.5:0/1167180670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0bf9b0 msgr2=0x7f3d6c0bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.653+0000 7f3d73357640 1 --2- 172.21.15.5:0/1167180670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0bf9b0 0x7f3d6c0bfdc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009e50 tx=0x7f3d5c02a7a0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.654+0000 7f3d73357640 1 -- 172.21.15.5:0/1167180670 shutdown_connections 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.654+0000 7f3d73357640 1 --2- 172.21.15.5:0/1167180670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0bf9b0 0x7f3d6c0bfdc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.654+0000 7f3d73357640 1 --2- 172.21.15.5:0/1167180670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c148770 0x7f3d6c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.654+0000 7f3d73357640 1 -- 172.21.15.5:0/1167180670 >> 172.21.15.5:0/1167180670 conn(0x7f3d6c0c17c0 msgr2=0x7f3d6c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.654+0000 7f3d73357640 1 -- 172.21.15.5:0/1167180670 shutdown_connections 2024-05-16T21:33:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.654+0000 7f3d73357640 1 -- 172.21.15.5:0/1167180670 wait complete. 2024-05-16T21:33:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.655+0000 7f3d73357640 1 Processor -- start 2024-05-16T21:33:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.655+0000 7f3d73357640 1 -- start start 2024-05-16T21:33:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d73357640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0bf9b0 0x7f3d6c071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d73357640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c148770 0x7f3d6c150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d73357640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c14e360 0x7f3d6c13d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d73357640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c158cc0 con 0x7f3d6c148770 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d73357640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c0c13d0 con 0x7f3d6c14e360 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d73357640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6c158e40 con 0x7f3d6c0bf9b0 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d708f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c148770 0x7f3d6c150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d708f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c148770 0x7f3d6c150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55028/0 (socket says 172.21.15.5:55028) 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d708f2640 1 -- 172.21.15.5:0/938747020 learned_addr learned my addr 172.21.15.5:0/938747020 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d718f4640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c14e360 0x7f3d6c13d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.656+0000 7f3d710f3640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0bf9b0 0x7f3d6c071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d708f2640 1 -- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0bf9b0 msgr2=0x7f3d6c071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d708f2640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0bf9b0 0x7f3d6c071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d708f2640 1 -- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c14e360 msgr2=0x7f3d6c13d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d708f2640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c14e360 0x7f3d6c13d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d708f2640 1 -- 172.21.15.5:0/938747020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c071e40 con 0x7f3d6c148770 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d708f2640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c148770 0x7f3d6c150900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000d800 tx=0x7f3d6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d69ffb640 1 -- 172.21.15.5:0/938747020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60004030 con 0x7f3d6c148770 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d69ffb640 1 -- 172.21.15.5:0/938747020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d600041d0 con 0x7f3d6c148770 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6c0726b0 con 0x7f3d6c148770 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d69ffb640 1 -- 172.21.15.5:0/938747020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d600096a0 con 0x7f3d6c148770 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.657+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6c1514d0 con 0x7f3d6c148770 2024-05-16T21:33:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.658+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6c070c00 con 0x7f3d6c148770 2024-05-16T21:33:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.659+0000 7f3d69ffb640 1 -- 172.21.15.5:0/938747020 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d60009840 con 0x7f3d6c148770 2024-05-16T21:33:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.659+0000 7f3d69ffb640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3d58076300 0x7f3d58078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.659+0000 7f3d69ffb640 1 -- 172.21.15.5:0/938747020 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f3d60097400 con 0x7f3d6c148770 2024-05-16T21:33:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.660+0000 7f3d710f3640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3d58076300 0x7f3d58078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:27.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.660+0000 7f3d710f3640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3d58076300 0x7f3d58078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0bef30 tx=0x7f3d64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:27.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.664+0000 7f3d69ffb640 1 -- 172.21.15.5:0/938747020 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3d6c070c00 con 0x7f3d6c148770 2024-05-16T21:33:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.898+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d6c0a5fa0 con 0x7f3d6c148770 2024-05-16T21:33:27.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.898+0000 7f3d69ffb640 1 -- 172.21.15.5:0/938747020 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3041 (secure 0 0 0) 0x7f3d60060a00 con 0x7f3d6c148770 2024-05-16T21:33:27.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:27.901 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2890333934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2890333934},{"type":"v1","addr":"172.21.15.5:6834","nonce":2890333934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3111678801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3111678801},{"type":"v1","addr":"172.21.15.157:6835","nonce":3111678801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4061899170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4061899170},{"type":"v1","addr":"172.21.15.5:6835","nonce":4061899170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-05-16T21:33:27.902 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-05-16T21:33:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3d58076300 msgr2=0x7f3d58078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3d58076300 0x7f3d58078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0bef30 tx=0x7f3d64009040 comp rx=0 tx=0).stop 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c148770 msgr2=0x7f3d6c150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c148770 0x7f3d6c150900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000d800 tx=0x7f3d6000dcc0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 shutdown_connections 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f3d58076300 0x7f3d58078810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c14e360 0x7f3d6c13d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c148770 0x7f3d6c150900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 --2- 172.21.15.5:0/938747020 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0bf9b0 0x7f3d6c071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 >> 172.21.15.5:0/938747020 conn(0x7f3d6c0c17c0 msgr2=0x7f3d6c140710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 shutdown_connections 2024-05-16T21:33:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:27.900+0000 7f3d73357640 1 -- 172.21.15.5:0/938747020 wait complete. 2024-05-16T21:33:27.914 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-16T21:33:27.915 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-16T21:33:27.915 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-16T21:33:27.915 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T21:33:27.915 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-16T21:33:27.915 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-16T21:33:27.915 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-16T21:33:27.916 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T21:33:27.916 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-16T21:33:27.916 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-16T21:33:27.916 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-16T21:33:27.916 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T21:33:27.925 INFO:tasks.ceph.mds.c:Stopped 2024-05-16T21:33:27.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-16T21:33:27.927 INFO:tasks.ceph.mds.a:Stopped 2024-05-16T21:33:27.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-16T21:33:27.928 INFO:tasks.ceph.mds.b:Stopped 2024-05-16T21:33:27.929 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-16T21:33:27.969 INFO:tasks.ceph.mds.c:Started 2024-05-16T21:33:27.970 DEBUG:teuthology.parallel:result is None 2024-05-16T21:33:27.971 INFO:tasks.ceph.mds.a:Started 2024-05-16T21:33:27.971 DEBUG:teuthology.parallel:result is None 2024-05-16T21:33:27.972 INFO:tasks.ceph.mds.b:Started 2024-05-16T21:33:27.972 DEBUG:teuthology.parallel:result is None 2024-05-16T21:33:27.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-16T21:33:28.058 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-05-16T21:33:28.059 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-05-16T21:33:28.066 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-05-16T21:33:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.090+0000 7f7a5b0b6640 1 Processor -- start 2024-05-16T21:33:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.090+0000 7f7a5b0b6640 1 -- start start 2024-05-16T21:33:28.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a5b0b6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5414e530 0x7f7a540ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a5b0b6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a540bd440 0x7f7a540bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a5b0b6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7a540b8d70 0x7f7a540b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a5b0b6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7a540b88e0 con 0x7f7a5414e530 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a5b0b6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7a540ba860 con 0x7f7a540b8d70 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a5b0b6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7a540bdd90 con 0x7f7a540bd440 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a58e52640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5414e530 0x7f7a540ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a58e52640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5414e530 0x7f7a540ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55068/0 (socket says 172.21.15.5:55068) 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a58e52640 1 -- 172.21.15.5:0/1949724503 learned_addr learned my addr 172.21.15.5:0/1949724503 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a53fff640 1 --2- 172.21.15.5:0/1949724503 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a540bd440 0x7f7a540bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a59653640 1 --2- 172.21.15.5:0/1949724503 >> v2:172.21.15.157:3300/0 conn(0x7f7a540b8d70 0x7f7a540b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a58e52640 1 -- 172.21.15.5:0/1949724503 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a540bd440 msgr2=0x7f7a540bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a58e52640 1 --2- 172.21.15.5:0/1949724503 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a540bd440 0x7f7a540bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a58e52640 1 -- 172.21.15.5:0/1949724503 >> v2:172.21.15.157:3300/0 conn(0x7f7a540b8d70 msgr2=0x7f7a540b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a58e52640 1 --2- 172.21.15.5:0/1949724503 >> v2:172.21.15.157:3300/0 conn(0x7f7a540b8d70 0x7f7a540b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a58e52640 1 -- 172.21.15.5:0/1949724503 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5414ece0 con 0x7f7a5414e530 2024-05-16T21:33:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.092+0000 7f7a59653640 1 --2- 172.21.15.5:0/1949724503 >> v2:172.21.15.157:3300/0 conn(0x7f7a540b8d70 0x7f7a540b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.093+0000 7f7a58e52640 1 --2- 172.21.15.5:0/1949724503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5414e530 0x7f7a540ba320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7a540b8850 tx=0x7f7a4802a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff30af5bade868a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.093+0000 7f7a537fe640 1 -- 172.21.15.5:0/1949724503 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48036070 con 0x7f7a5414e530 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.093+0000 7f7a537fe640 1 -- 172.21.15.5:0/1949724503 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a48031600 con 0x7f7a5414e530 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.093+0000 7f7a537fe640 1 -- 172.21.15.5:0/1949724503 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480319d0 con 0x7f7a5414e530 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/1949724503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5414e530 msgr2=0x7f7a540ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/1949724503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5414e530 0x7f7a540ba320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7a540b8850 tx=0x7f7a4802a470 comp rx=0 tx=0).stop 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/1949724503 shutdown_connections 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/1949724503 >> v2:172.21.15.157:3300/0 conn(0x7f7a540b8d70 0x7f7a540b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/1949724503 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a540bd440 0x7f7a540bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/1949724503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5414e530 0x7f7a540ba320 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/1949724503 >> 172.21.15.5:0/1949724503 conn(0x7f7a540c0570 msgr2=0x7f7a540c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/1949724503 shutdown_connections 2024-05-16T21:33:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.094+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/1949724503 wait complete. 2024-05-16T21:33:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.096+0000 7f7a5b0b6640 1 Processor -- start 2024-05-16T21:33:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.096+0000 7f7a5b0b6640 1 -- start start 2024-05-16T21:33:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a5b0b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b8d70 0x7f7a541479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a5b0b6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a540bd440 0x7f7a541518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a5b0b6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a5414e530 0x7f7a54151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a5b0b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a540bbb70 con 0x7f7a540b8d70 2024-05-16T21:33:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a5b0b6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5414f2a0 con 0x7f7a540bd440 2024-05-16T21:33:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a5b0b6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7a540b96c0 con 0x7f7a5414e530 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a58e52640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b8d70 0x7f7a541479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a58e52640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b8d70 0x7f7a541479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55076/0 (socket says 172.21.15.5:55076) 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a58e52640 1 -- 172.21.15.5:0/2081357232 learned_addr learned my addr 172.21.15.5:0/2081357232 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a59653640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a5414e530 0x7f7a54151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a53fff640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a540bd440 0x7f7a541518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a58e52640 1 -- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a5414e530 msgr2=0x7f7a54151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a58e52640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a5414e530 0x7f7a54151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a58e52640 1 -- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a540bd440 msgr2=0x7f7a541518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a58e52640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a540bd440 0x7f7a541518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.097+0000 7f7a58e52640 1 -- 172.21.15.5:0/2081357232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a54147f00 con 0x7f7a540b8d70 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.098+0000 7f7a58e52640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b8d70 0x7f7a541479c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009a50 tx=0x7f7a480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.098+0000 7f7a517fa640 1 -- 172.21.15.5:0/2081357232 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48040070 con 0x7f7a540b8d70 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.098+0000 7f7a517fa640 1 -- 172.21.15.5:0/2081357232 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a480319b0 con 0x7f7a540b8d70 2024-05-16T21:33:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.098+0000 7f7a517fa640 1 -- 172.21.15.5:0/2081357232 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48036040 con 0x7f7a540b8d70 2024-05-16T21:33:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.098+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a541e5310 con 0x7f7a540b8d70 2024-05-16T21:33:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.098+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a54152880 con 0x7f7a540b8d70 2024-05-16T21:33:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.099+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a54050940 con 0x7f7a540b8d70 2024-05-16T21:33:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.100+0000 7f7a517fa640 1 -- 172.21.15.5:0/2081357232 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a48043070 con 0x7f7a540b8d70 2024-05-16T21:33:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.101+0000 7f7a517fa640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a380762d0 0x7f7a380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.101+0000 7f7a517fa640 1 -- 172.21.15.5:0/2081357232 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f7a480b78c0 con 0x7f7a540b8d70 2024-05-16T21:33:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.101+0000 7f7a53fff640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a380762d0 0x7f7a380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.101+0000 7f7a53fff640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a380762d0 0x7f7a380787e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a54152aa0 tx=0x7f7a40009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:28.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.105+0000 7f7a517fa640 1 -- 172.21.15.5:0/2081357232 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a48080e40 con 0x7f7a540b8d70 2024-05-16T21:33:28.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.313+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7a540bcbf0 con 0x7f7a540b8d70 2024-05-16T21:33:28.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.841+0000 7f7a517fa640 1 -- 172.21.15.5:0/2081357232 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) ==== 97+0+0 (secure 0 0 0) 0x7f7a48085140 con 0x7f7a540b8d70 2024-05-16T21:33:28.844 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-05-16T21:33:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a380762d0 msgr2=0x7f7a380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a380762d0 0x7f7a380787e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a54152aa0 tx=0x7f7a40009190 comp rx=0 tx=0).stop 2024-05-16T21:33:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b8d70 msgr2=0x7f7a541479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b8d70 0x7f7a541479c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009a50 tx=0x7f7a480046c0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 shutdown_connections 2024-05-16T21:33:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7a380762d0 0x7f7a380787e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a5414e530 0x7f7a54151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a540bd440 0x7f7a541518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 --2- 172.21.15.5:0/2081357232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b8d70 0x7f7a541479c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 >> 172.21.15.5:0/2081357232 conn(0x7f7a540c0570 msgr2=0x7f7a540bc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 shutdown_connections 2024-05-16T21:33:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.844+0000 7f7a5b0b6640 1 -- 172.21.15.5:0/2081357232 wait complete. 2024-05-16T21:33:28.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-16T21:33:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.977+0000 7f20ac814640 1 Processor -- start 2024-05-16T21:33:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.978+0000 7f20ac814640 1 -- start start 2024-05-16T21:33:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20ac814640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80bd510 0x7f20a80bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20ac814640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f20a814ebd0 0x7f20a814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20ac814640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a80bea40 con 0x7f20a80be230 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20ac814640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f20a814c230 con 0x7f20a814ebd0 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20ac814640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f20a80becb0 con 0x7f20a80bd510 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20a5d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80bd510 0x7f20a80bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20a6d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f20a814ebd0 0x7f20a814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20a659c640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f20a80be230 0x7f20a806dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:35326/0 (socket says 172.21.15.5:35326) 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.979+0000 7f20a659c640 1 -- 172.21.15.5:0/1189738731 learned_addr learned my addr 172.21.15.5:0/1189738731 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.980+0000 7f20a559a640 1 -- 172.21.15.5:0/1189738731 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841299602 0 0) 0x7f20a80bea40 con 0x7f20a80be230 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.980+0000 7f20a559a640 1 -- 172.21.15.5:0/1189738731 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2094003520 con 0x7f20a80be230 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.980+0000 7f20a6d9d640 1 -- 172.21.15.5:0/1189738731 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80bd510 msgr2=0x7f20a80bd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.980+0000 7f20a6d9d640 1 --2- 172.21.15.5:0/1189738731 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80bd510 0x7f20a80bd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.980+0000 7f20a6d9d640 1 -- 172.21.15.5:0/1189738731 >> v1:172.21.15.157:6789/0 conn(0x7f20a80be230 legacy=0x7f20a806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.980+0000 7f20a6d9d640 1 -- 172.21.15.5:0/1189738731 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a80bef90 con 0x7f20a814ebd0 2024-05-16T21:33:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.980+0000 7f20a5d9b640 1 --2- 172.21.15.5:0/1189738731 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80bd510 0x7f20a80bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.980+0000 7f20a6d9d640 1 --2- 172.21.15.5:0/1189738731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a814ebd0 0x7f20a814efe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2098009d90 tx=0x7f209802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f04ed59a4e1b96cb server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20a559a640 1 -- 172.21.15.5:0/1189738731 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098007740 con 0x7f20a814ebd0 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20a559a640 1 -- 172.21.15.5:0/1189738731 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20980078e0 con 0x7f20a814ebd0 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20a559a640 1 -- 172.21.15.5:0/1189738731 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098007c90 con 0x7f20a814ebd0 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20ac814640 1 -- 172.21.15.5:0/1189738731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a814ebd0 msgr2=0x7f20a814efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20ac814640 1 --2- 172.21.15.5:0/1189738731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a814ebd0 0x7f20a814efe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2098009d90 tx=0x7f209802a660 comp rx=0 tx=0).stop 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20ac814640 1 -- 172.21.15.5:0/1189738731 shutdown_connections 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20ac814640 1 --2- 172.21.15.5:0/1189738731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a814ebd0 0x7f20a814efe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20ac814640 1 --2- 172.21.15.5:0/1189738731 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80bd510 0x7f20a80bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20ac814640 1 -- 172.21.15.5:0/1189738731 >> 172.21.15.5:0/1189738731 conn(0x7f20a80c3cd0 msgr2=0x7f20a80c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20ac814640 1 -- 172.21.15.5:0/1189738731 shutdown_connections 2024-05-16T21:33:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.981+0000 7f20ac814640 1 -- 172.21.15.5:0/1189738731 wait complete. 2024-05-16T21:33:28.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.983+0000 7f20ac814640 1 Processor -- start 2024-05-16T21:33:28.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.983+0000 7f20ac814640 1 -- start start 2024-05-16T21:33:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20ac814640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a80bd510 0x7f20a80bc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20ac814640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80be230 0x7f20a80a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20ac814640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a814ebd0 0x7f20a81e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20ac814640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20a80be640 con 0x7f20a814ebd0 2024-05-16T21:33:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20ac814640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f20a806ea70 con 0x7f20a80bd510 2024-05-16T21:33:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20ac814640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f20a808d850 con 0x7f20a80be230 2024-05-16T21:33:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20a6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a814ebd0 0x7f20a81e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20a6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a814ebd0 0x7f20a81e45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55082/0 (socket says 172.21.15.5:55082) 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.984+0000 7f20a6d9d640 1 -- 172.21.15.5:0/1832891087 learned_addr learned my addr 172.21.15.5:0/1832891087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20a659c640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a80bd510 0x7f20a80bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20a5d9b640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80be230 0x7f20a80a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20a6d9d640 1 -- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80be230 msgr2=0x7f20a80a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20a6d9d640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80be230 0x7f20a80a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20a6d9d640 1 -- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a80bd510 msgr2=0x7f20a80bc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20a6d9d640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a80bd510 0x7f20a80bc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20a6d9d640 1 -- 172.21.15.5:0/1832891087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a80a7eb0 con 0x7f20a814ebd0 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20a6d9d640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a814ebd0 0x7f20a81e45e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2098009eb0 tx=0x7f2098004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f209effd640 1 -- 172.21.15.5:0/1832891087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209803f070 con 0x7f20a814ebd0 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f209effd640 1 -- 172.21.15.5:0/1832891087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098031c40 con 0x7f20a814ebd0 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a80bce60 con 0x7f20a814ebd0 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f209effd640 1 -- 172.21.15.5:0/1832891087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098009450 con 0x7f20a814ebd0 2024-05-16T21:33:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.985+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a81e8060 con 0x7f20a814ebd0 2024-05-16T21:33:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.986+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a80c3610 con 0x7f20a814ebd0 2024-05-16T21:33:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.987+0000 7f209effd640 1 -- 172.21.15.5:0/1832891087 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2098003990 con 0x7f20a814ebd0 2024-05-16T21:33:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.987+0000 7f209effd640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2088076300 0x7f2088078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.987+0000 7f209effd640 1 -- 172.21.15.5:0/1832891087 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4857+0+0 (secure 0 0 0) 0x7f20980b8350 con 0x7f20a814ebd0 2024-05-16T21:33:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.988+0000 7f20a659c640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2088076300 0x7f2088078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.988+0000 7f20a659c640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2088076300 0x7f2088078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f20a0005880 tx=0x7f20a0006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:28.992+0000 7f209effd640 1 -- 172.21.15.5:0/1832891087 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2098081890 con 0x7f20a814ebd0 2024-05-16T21:33:29.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.266+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f20a8050940 con 0x7f20a814ebd0 2024-05-16T21:33:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.266+0000 7f209effd640 1 -- 172.21.15.5:0/1832891087 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+4150 (secure 0 0 0) 0x7f2098085b90 con 0x7f20a814ebd0 2024-05-16T21:33:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:29.268 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T21:33:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-05-16T21:33:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-05-16T21:33:29.268 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0ZmWOztIxAALEzX4EJJcrGCP7ZoZ/HKgA==", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0ZmQxKaMBAAj7Rge1mcAmfVKbNfu7fwRg==", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-05-16T21:33:29.269 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0Zmqx5zKxAAcFLKr5c1bAYjCHYue1BIIw==", 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.270 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAye0ZmdkSvFxAA5+pykmX9PyzAFWdUwe/dCg==", 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA1e0ZmHAEzFxAAR/4LYW0ce5/kt+sQIGtRCQ==", 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4e0ZmiV+2FxAA7jAztuHwMHlMMRORi+es0Q==", 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7e0ZmMrfwFhAA3/m/SekhouAzfw647Cgcrg==", 2024-05-16T21:33:29.272 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA/e0ZmeRy4IhAA/JFx42eT7j6uAHRIsP35Tw==", 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBCe0ZmF6NJIRAAdbIwZRW9OCyVwbiycii3ug==", 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBFe0ZmzhyfHxAAX8zeKuN/kboQKumY+LNXag==", 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.274 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBIe0ZmXi2qHRAAiIb4iVEEqACfG78J7II+Dg==", 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxe0ZmPwp5BBAApGZXcUeCgiYeu7NGIhsvXg==", 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAve0ZmkNmeNRAABD/29oilXgiBr5doZhyjnQ==", 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-05-16T21:33:29.276 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0ZmkHgyIBAAkoin2vsL2eoaz/QSlB72Pw==", 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-05-16T21:33:29.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwe0Zm7jz5GhAAWjyGahKoqSjedU6is2lhBQ==", 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-05-16T21:33:29.278 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T21:33:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2088076300 msgr2=0x7f2088078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2088076300 0x7f2088078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f20a0005880 tx=0x7f20a0006aa0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a814ebd0 msgr2=0x7f20a81e45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a814ebd0 0x7f20a81e45e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2098009eb0 tx=0x7f2098004a40 comp rx=0 tx=0).stop 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 shutdown_connections 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2088076300 0x7f2088078810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a814ebd0 0x7f20a81e45e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20a80be230 0x7f20a80a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 --2- 172.21.15.5:0/1832891087 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20a80bd510 0x7f20a80bc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 >> 172.21.15.5:0/1832891087 conn(0x7f20a80c3cd0 msgr2=0x7f20a80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 shutdown_connections 2024-05-16T21:33:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.268+0000 7f20ac814640 1 -- 172.21.15.5:0/1832891087 wait complete. 2024-05-16T21:33:29.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-16T21:33:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.391+0000 7fd9864e0640 1 Processor -- start 2024-05-16T21:33:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.391+0000 7fd9864e0640 1 -- start start 2024-05-16T21:33:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd9864e0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd980074a10 0x7fd9801519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd9864e0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd98014ef40 0x7fd980158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd9864e0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9800bf720 con 0x7fd98006c6e0 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd9864e0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd98006cfe0 con 0x7fd98014ef40 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd9864e0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd98006cd00 con 0x7fd980074a10 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd984a7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd98014ef40 0x7fd980158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd984a7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd98014ef40 0x7fd980158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55088/0 (socket says 172.21.15.5:55088) 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd984a7d640 1 -- 172.21.15.5:0/2599844504 learned_addr learned my addr 172.21.15.5:0/2599844504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd97f7fe640 1 --2- 172.21.15.5:0/2599844504 >> v2:172.21.15.157:3300/0 conn(0x7fd980074a10 0x7fd9801519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd984a7d640 1 -- 172.21.15.5:0/2599844504 >> v2:172.21.15.157:3300/0 conn(0x7fd980074a10 msgr2=0x7fd9801519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd984a7d640 1 --2- 172.21.15.5:0/2599844504 >> v2:172.21.15.157:3300/0 conn(0x7fd980074a10 0x7fd9801519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.392+0000 7fd984a7d640 1 -- 172.21.15.5:0/2599844504 >> v1:172.21.15.157:6789/0 conn(0x7fd98006c6e0 legacy=0x7fd9800bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.393+0000 7fd984a7d640 1 -- 172.21.15.5:0/2599844504 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd980074210 con 0x7fd98014ef40 2024-05-16T21:33:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.393+0000 7fd97f7fe640 1 --2- 172.21.15.5:0/2599844504 >> v2:172.21.15.157:3300/0 conn(0x7fd980074a10 0x7fd9801519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:29.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.393+0000 7fd984a7d640 1 --2- 172.21.15.5:0/2599844504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd98014ef40 0x7fd980158d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd9800bff80 tx=0x7fd97802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4358437b220cbe3b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.393+0000 7fd97effd640 1 -- 172.21.15.5:0/2599844504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978036070 con 0x7fd98014ef40 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.393+0000 7fd97effd640 1 -- 172.21.15.5:0/2599844504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd978031600 con 0x7fd98014ef40 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.393+0000 7fd97effd640 1 -- 172.21.15.5:0/2599844504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9780319f0 con 0x7fd98014ef40 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.394+0000 7fd9864e0640 1 -- 172.21.15.5:0/2599844504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd98014ef40 msgr2=0x7fd980158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.394+0000 7fd9864e0640 1 --2- 172.21.15.5:0/2599844504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd98014ef40 0x7fd980158d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd9800bff80 tx=0x7fd97802a7c0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.394+0000 7fd9864e0640 1 -- 172.21.15.5:0/2599844504 shutdown_connections 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.394+0000 7fd9864e0640 1 --2- 172.21.15.5:0/2599844504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd98014ef40 0x7fd980158d40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.394+0000 7fd9864e0640 1 --2- 172.21.15.5:0/2599844504 >> v2:172.21.15.157:3300/0 conn(0x7fd980074a10 0x7fd9801519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.394+0000 7fd9864e0640 1 -- 172.21.15.5:0/2599844504 >> 172.21.15.5:0/2599844504 conn(0x7fd9800bd0f0 msgr2=0x7fd9800bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.394+0000 7fd9864e0640 1 -- 172.21.15.5:0/2599844504 shutdown_connections 2024-05-16T21:33:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.394+0000 7fd9864e0640 1 -- 172.21.15.5:0/2599844504 wait complete. 2024-05-16T21:33:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.396+0000 7fd9864e0640 1 Processor -- start 2024-05-16T21:33:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.396+0000 7fd9864e0640 1 -- start start 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd9864e0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd98006c6e0 0x7fd9800b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd9864e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd980074a10 0x7fd9801e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd9864e0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd98014ef40 0x7fd9801477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd9864e0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd9800be460 con 0x7fd980074a10 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd9864e0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd98014f350 con 0x7fd98014ef40 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd9864e0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9800be5e0 con 0x7fd98006c6e0 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd980074a10 0x7fd9801e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd980074a10 0x7fd9801e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55092/0 (socket says 172.21.15.5:55092) 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97f7fe640 1 -- 172.21.15.5:0/1268509379 learned_addr learned my addr 172.21.15.5:0/1268509379 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd984a7d640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd98014ef40 0x7fd9801477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97ffff640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd98006c6e0 0x7fd9800b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97f7fe640 1 -- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd98006c6e0 msgr2=0x7fd9800b6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97f7fe640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd98006c6e0 0x7fd9800b6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97f7fe640 1 -- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd98014ef40 msgr2=0x7fd9801477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97f7fe640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd98014ef40 0x7fd9801477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97f7fe640 1 -- 172.21.15.5:0/1268509379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9800b6a80 con 0x7fd980074a10 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd97ffff640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd98006c6e0 0x7fd9800b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.397+0000 7fd984a7d640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd98014ef40 0x7fd9801477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.398+0000 7fd97f7fe640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd980074a10 0x7fd9801e7d30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d800 tx=0x7fd96800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.398+0000 7fd97cff9640 1 -- 172.21.15.5:0/1268509379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96800b6c0 con 0x7fd980074a10 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.398+0000 7fd97cff9640 1 -- 172.21.15.5:0/1268509379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd968019070 con 0x7fd980074a10 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.398+0000 7fd97cff9640 1 -- 172.21.15.5:0/1268509379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96800baa0 con 0x7fd980074a10 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.398+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9801e8270 con 0x7fd980074a10 2024-05-16T21:33:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.398+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9801510d0 con 0x7fd980074a10 2024-05-16T21:33:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.399+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd980069b50 con 0x7fd980074a10 2024-05-16T21:33:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.400+0000 7fd97cff9640 1 -- 172.21.15.5:0/1268509379 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd96800bc40 con 0x7fd980074a10 2024-05-16T21:33:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.400+0000 7fd97cff9640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9600762d0 0x7fd9600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.400+0000 7fd97cff9640 1 -- 172.21.15.5:0/1268509379 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4857+0+0 (secure 0 0 0) 0x7fd968097790 con 0x7fd980074a10 2024-05-16T21:33:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.400+0000 7fd97ffff640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9600762d0 0x7fd9600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.401+0000 7fd97ffff640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9600762d0 0x7fd9600787e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd9700016a0 tx=0x7fd970009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.405+0000 7fd97cff9640 1 -- 172.21.15.5:0/1268509379 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd9680613b0 con 0x7fd980074a10 2024-05-16T21:33:29.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.599+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd9800bcb60 con 0x7fd980074a10 2024-05-16T21:33:29.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.600+0000 7fd97cff9640 1 -- 172.21.15.5:0/1268509379 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7fd968060cb0 con 0x7fd980074a10 2024-05-16T21:33:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:29.602 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-05-16T21:33:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-05-16T21:33:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-05-16T21:33:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-05-16T21:33:29.602 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-05-16T21:33:29.602 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9600762d0 msgr2=0x7fd9600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9600762d0 0x7fd9600787e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd9700016a0 tx=0x7fd970009040 comp rx=0 tx=0).stop 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd980074a10 msgr2=0x7fd9801e7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd980074a10 0x7fd9801e7d30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d800 tx=0x7fd96800dcc0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 shutdown_connections 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd9600762d0 0x7fd9600787e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd98014ef40 0x7fd9801477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd980074a10 0x7fd9801e7d30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 --2- 172.21.15.5:0/1268509379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd98006c6e0 0x7fd9800b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 >> 172.21.15.5:0/1268509379 conn(0x7fd9800bd0f0 msgr2=0x7fd9800bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 shutdown_connections 2024-05-16T21:33:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.602+0000 7fd9864e0640 1 -- 172.21.15.5:0/1268509379 wait complete. 2024-05-16T21:33:29.615 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-16T21:33:29.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-16T21:33:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.730+0000 7f63ec242640 1 Processor -- start 2024-05-16T21:33:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.730+0000 7f63ec242640 1 -- start start 2024-05-16T21:33:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63ec242640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f63e40bd6d0 0x7f63e40be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63ec242640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63ec242640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e406e140 con 0x7f63e4151fc0 2024-05-16T21:33:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63ec242640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f63e40c36f0 con 0x7f63e40bd6d0 2024-05-16T21:33:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63ec242640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f63e4152530 con 0x7f63e40bee80 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63ea7df640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63e97dd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f63e40bd6d0 0x7f63e40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63ea7df640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e4158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:46936/0 (socket says 172.21.15.5:46936) 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63e9fde640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f63e4151fc0 0x7f63e406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:35334/0 (socket says 172.21.15.5:35334) 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.731+0000 7f63ea7df640 1 -- 172.21.15.5:0/3204231041 learned_addr learned my addr 172.21.15.5:0/3204231041 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.732+0000 7f63e8fdc640 1 -- 172.21.15.5:0/3204231041 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164339919 0 0) 0x7f63e0001110 con 0x7f63e4151fc0 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.732+0000 7f63e8fdc640 1 -- 172.21.15.5:0/3204231041 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d0003520 con 0x7f63e4151fc0 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.732+0000 7f63ea7df640 1 -- 172.21.15.5:0/3204231041 >> v2:172.21.15.157:3300/0 conn(0x7f63e40bd6d0 msgr2=0x7f63e40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.732+0000 7f63ea7df640 1 --2- 172.21.15.5:0/3204231041 >> v2:172.21.15.157:3300/0 conn(0x7f63e40bd6d0 0x7f63e40be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.732+0000 7f63ea7df640 1 -- 172.21.15.5:0/3204231041 >> v1:172.21.15.157:6789/0 conn(0x7f63e4151fc0 legacy=0x7f63e406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.732+0000 7f63ea7df640 1 -- 172.21.15.5:0/3204231041 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e4152810 con 0x7f63e40bee80 2024-05-16T21:33:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.732+0000 7f63e97dd640 1 --2- 172.21.15.5:0/3204231041 >> v2:172.21.15.157:3300/0 conn(0x7f63e40bd6d0 0x7f63e40be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.732+0000 7f63ea7df640 1 --2- 172.21.15.5:0/3204231041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e4158e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009e50 tx=0x7f63dc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe86f964a4c000a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63e8fdc640 1 -- 172.21.15.5:0/3204231041 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc036070 con 0x7f63e40bee80 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63e8fdc640 1 -- 172.21.15.5:0/3204231041 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc031600 con 0x7f63e40bee80 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63e8fdc640 1 -- 172.21.15.5:0/3204231041 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0319b0 con 0x7f63e40bee80 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63ec242640 1 -- 172.21.15.5:0/3204231041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 msgr2=0x7f63e4158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63ec242640 1 --2- 172.21.15.5:0/3204231041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e4158e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009e50 tx=0x7f63dc02a710 comp rx=0 tx=0).stop 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63ec242640 1 -- 172.21.15.5:0/3204231041 shutdown_connections 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63ec242640 1 --2- 172.21.15.5:0/3204231041 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e4158e90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63ec242640 1 --2- 172.21.15.5:0/3204231041 >> v2:172.21.15.157:3300/0 conn(0x7f63e40bd6d0 0x7f63e40be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.733+0000 7f63ec242640 1 -- 172.21.15.5:0/3204231041 >> 172.21.15.5:0/3204231041 conn(0x7f63e40c3d20 msgr2=0x7f63e40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.734+0000 7f63ec242640 1 -- 172.21.15.5:0/3204231041 shutdown_connections 2024-05-16T21:33:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.734+0000 7f63ec242640 1 -- 172.21.15.5:0/3204231041 wait complete. 2024-05-16T21:33:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.735+0000 7f63ec242640 1 Processor -- start 2024-05-16T21:33:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.735+0000 7f63ec242640 1 -- start start 2024-05-16T21:33:29.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63ec242640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e40bd6d0 0x7f63e40a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63ec242640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e40b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63ec242640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e4151fc0 0x7f63e414b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63ec242640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f63e40bdae0 con 0x7f63e40bd6d0 2024-05-16T21:33:29.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63ec242640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f63e40c0070 con 0x7f63e4151fc0 2024-05-16T21:33:29.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63ec242640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f63e40a2ed0 con 0x7f63e40bee80 2024-05-16T21:33:29.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63e9fde640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e40bd6d0 0x7f63e40a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63e9fde640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e40bd6d0 0x7f63e40a2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55104/0 (socket says 172.21.15.5:55104) 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63e9fde640 1 -- 172.21.15.5:0/3887961552 learned_addr learned my addr 172.21.15.5:0/3887961552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63ea7df640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e4151fc0 0x7f63e414b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.736+0000 7f63e97dd640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e40b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63e9fde640 1 -- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 msgr2=0x7f63e40b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63e9fde640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e40b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63e9fde640 1 -- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e4151fc0 msgr2=0x7f63e414b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63e9fde640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e4151fc0 0x7f63e414b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63e9fde640 1 -- 172.21.15.5:0/3887961552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e40a2a50 con 0x7f63e40bd6d0 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63e9fde640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e40bd6d0 0x7f63e40a2510 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c730 tx=0x7f63e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63da7fc640 1 -- 172.21.15.5:0/3887961552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0007270 con 0x7f63e40bd6d0 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63da7fc640 1 -- 172.21.15.5:0/3887961552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e0007410 con 0x7f63e40bd6d0 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e40b8450 con 0x7f63e40bd6d0 2024-05-16T21:33:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63da7fc640 1 -- 172.21.15.5:0/3887961552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0001d10 con 0x7f63e40bd6d0 2024-05-16T21:33:29.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.737+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e40b8170 con 0x7f63e40bd6d0 2024-05-16T21:33:29.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.738+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e4050940 con 0x7f63e40bd6d0 2024-05-16T21:33:29.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.739+0000 7f63da7fc640 1 -- 172.21.15.5:0/3887961552 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f63e001a020 con 0x7f63e40bd6d0 2024-05-16T21:33:29.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.739+0000 7f63da7fc640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f63c80762d0 0x7f63c80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:29.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.740+0000 7f63da7fc640 1 -- 172.21.15.5:0/3887961552 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4857+0+0 (secure 0 0 0) 0x7f63e0096810 con 0x7f63e40bd6d0 2024-05-16T21:33:29.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.740+0000 7f63e97dd640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f63c80762d0 0x7f63c80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:29.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.740+0000 7f63e97dd640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f63c80762d0 0x7f63c80787e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f63e40b7110 tx=0x7f63d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:29.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.744+0000 7f63da7fc640 1 -- 172.21.15.5:0/3887961552 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f63e406e140 con 0x7f63e40bd6d0 2024-05-16T21:33:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:29.937+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f63e406eb40 con 0x7f63e40bd6d0 2024-05-16T21:33:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.850+0000 7f63da7fc640 1 -- 172.21.15.5:0/3887961552 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7f63e005fe60 con 0x7f63e40bd6d0 2024-05-16T21:33:30.853 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-05-16T21:33:30.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.853+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f63c80762d0 msgr2=0x7f63c80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.853+0000 7f63ec242640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f63c80762d0 0x7f63c80787e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f63e40b7110 tx=0x7f63d4009190 comp rx=0 tx=0).stop 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.853+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e40bd6d0 msgr2=0x7f63e40a2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e40bd6d0 0x7f63e40a2510 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c730 tx=0x7f63e000cbf0 comp rx=0 tx=0).stop 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 shutdown_connections 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f63c80762d0 0x7f63c80787e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e4151fc0 0x7f63e414b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63e40bee80 0x7f63e40b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 --2- 172.21.15.5:0/3887961552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e40bd6d0 0x7f63e40a2510 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 >> 172.21.15.5:0/3887961552 conn(0x7f63e40c3d20 msgr2=0x7f63e40a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 shutdown_connections 2024-05-16T21:33:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.854+0000 7f63ec242640 1 -- 172.21.15.5:0/3887961552 wait complete. 2024-05-16T21:33:30.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-16T21:33:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.997+0000 7f8d6a984640 1 Processor -- start 2024-05-16T21:33:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.997+0000 7f8d6a984640 1 -- start start 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d6a984640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d6414e360 0x7f8d641522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d6a984640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8d64148770 0x7f8d640c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d6a984640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d640bf9b0 0x7f8d640bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d6a984640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8d64151e40 con 0x7f8d640bf9b0 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d6a984640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8d640c0620 con 0x7f8d64148770 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d6a984640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8d64151ad0 con 0x7f8d6414e360 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d68f21640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d640bf9b0 0x7f8d640bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d68f21640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d640bf9b0 0x7f8d640bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55112/0 (socket says 172.21.15.5:55112) 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.998+0000 7f8d68f21640 1 -- 172.21.15.5:0/3796780188 learned_addr learned my addr 172.21.15.5:0/3796780188 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.999+0000 7f8d637fe640 1 --2- 172.21.15.5:0/3796780188 >> v2:172.21.15.157:3300/0 conn(0x7f8d64148770 0x7f8d640c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.999+0000 7f8d63fff640 1 --2- 172.21.15.5:0/3796780188 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d6414e360 0x7f8d641522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.999+0000 7f8d68f21640 1 -- 172.21.15.5:0/3796780188 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d6414e360 msgr2=0x7f8d641522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:31.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.999+0000 7f8d68f21640 1 --2- 172.21.15.5:0/3796780188 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d6414e360 0x7f8d641522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.999+0000 7f8d68f21640 1 -- 172.21.15.5:0/3796780188 >> v2:172.21.15.157:3300/0 conn(0x7f8d64148770 msgr2=0x7f8d640c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:31.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.999+0000 7f8d68f21640 1 --2- 172.21.15.5:0/3796780188 >> v2:172.21.15.157:3300/0 conn(0x7f8d64148770 0x7f8d640c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.999+0000 7f8d68f21640 1 -- 172.21.15.5:0/3796780188 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d64152810 con 0x7f8d640bf9b0 2024-05-16T21:33:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:30.999+0000 7f8d68f21640 1 --2- 172.21.15.5:0/3796780188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640bfdc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009e50 tx=0x7f8d5c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de2937e14f9c4f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d62ffd640 1 -- 172.21.15.5:0/3796780188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c036070 con 0x7f8d640bf9b0 2024-05-16T21:33:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d62ffd640 1 -- 172.21.15.5:0/3796780188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5c031600 con 0x7f8d640bf9b0 2024-05-16T21:33:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d62ffd640 1 -- 172.21.15.5:0/3796780188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0319d0 con 0x7f8d640bf9b0 2024-05-16T21:33:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 -- 172.21.15.5:0/3796780188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 msgr2=0x7f8d640bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 --2- 172.21.15.5:0/3796780188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640bfdc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009e50 tx=0x7f8d5c02a750 comp rx=0 tx=0).stop 2024-05-16T21:33:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 -- 172.21.15.5:0/3796780188 shutdown_connections 2024-05-16T21:33:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 --2- 172.21.15.5:0/3796780188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640bfdc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 --2- 172.21.15.5:0/3796780188 >> v2:172.21.15.157:3300/0 conn(0x7f8d64148770 0x7f8d640c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 --2- 172.21.15.5:0/3796780188 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d6414e360 0x7f8d641522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 -- 172.21.15.5:0/3796780188 >> 172.21.15.5:0/3796780188 conn(0x7f8d640c17c0 msgr2=0x7f8d640c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 -- 172.21.15.5:0/3796780188 shutdown_connections 2024-05-16T21:33:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.000+0000 7f8d6a984640 1 -- 172.21.15.5:0/3796780188 wait complete. 2024-05-16T21:33:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.002+0000 7f8d6a984640 1 Processor -- start 2024-05-16T21:33:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.002+0000 7f8d6a984640 1 -- start start 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d6a984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d6a984640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d64148770 0x7f8d641e8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d6a984640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d6414e360 0x7f8d641459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d6a984640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8d640c1340 con 0x7f8d640bf9b0 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d6a984640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8d640c11c0 con 0x7f8d6414e360 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d6a984640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6409fd50 con 0x7f8d64148770 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640a5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55124/0 (socket says 172.21.15.5:55124) 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.003+0000 7f8d63fff640 1 -- 172.21.15.5:0/2652222924 learned_addr learned my addr 172.21.15.5:0/2652222924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d68f21640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d6414e360 0x7f8d641459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d637fe640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d64148770 0x7f8d641e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d63fff640 1 -- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d64148770 msgr2=0x7f8d641e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d63fff640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d64148770 0x7f8d641e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d63fff640 1 -- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d6414e360 msgr2=0x7f8d641459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d63fff640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d6414e360 0x7f8d641459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d63fff640 1 -- 172.21.15.5:0/2652222924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d640a60e0 con 0x7f8d640bf9b0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d68f21640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d6414e360 0x7f8d641459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d63fff640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640a5ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e8a0 tx=0x7f8d5400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d60ff9640 1 -- 172.21.15.5:0/2652222924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54017070 con 0x7f8d640bf9b0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d60ff9640 1 -- 172.21.15.5:0/2652222924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5400c940 con 0x7f8d640bf9b0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d640a2490 con 0x7f8d640bf9b0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d60ff9640 1 -- 172.21.15.5:0/2652222924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5400cd30 con 0x7f8d640bf9b0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.004+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d640a1880 con 0x7f8d640bf9b0 2024-05-16T21:33:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.005+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d64050940 con 0x7f8d640bf9b0 2024-05-16T21:33:31.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.006+0000 7f8d60ff9640 1 -- 172.21.15.5:0/2652222924 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d5401a070 con 0x7f8d640bf9b0 2024-05-16T21:33:31.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.007+0000 7f8d60ff9640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8d50076300 0x7f8d50078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:31.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.007+0000 7f8d60ff9640 1 -- 172.21.15.5:0/2652222924 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5227+0+0 (secure 0 0 0) 0x7f8d540973e0 con 0x7f8d640bf9b0 2024-05-16T21:33:31.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.007+0000 7f8d637fe640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8d50076300 0x7f8d50078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:31.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.007+0000 7f8d637fe640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8d50076300 0x7f8d50078810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8d641df160 tx=0x7f8d58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:31.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.012+0000 7f8d60ff9640 1 -- 172.21.15.5:0/2652222924 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8d640a2490 con 0x7f8d640bf9b0 2024-05-16T21:33:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.204+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8d640bf790 con 0x7f8d640bf9b0 2024-05-16T21:33:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.857+0000 7f8d60ff9640 1 -- 172.21.15.5:0/2652222924 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7f8d54067e20 con 0x7f8d640bf9b0 2024-05-16T21:33:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.862+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8d50076300 msgr2=0x7f8d50078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.862+0000 7f8d6a984640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8d50076300 0x7f8d50078810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8d641df160 tx=0x7f8d58008040 comp rx=0 tx=0).stop 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.862+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 msgr2=0x7f8d640a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.862+0000 7f8d6a984640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640a5ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e8a0 tx=0x7f8d5400eca0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.864+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 shutdown_connections 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.864+0000 7f8d6a984640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8d50076300 0x7f8d50078810 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8d641df160 tx=0x7f8d58008040 comp rx=0 tx=0).stop 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.864+0000 7f8d6a984640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d6414e360 0x7f8d641459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.864+0000 7f8d6a984640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d64148770 0x7f8d641e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.864+0000 7f8d6a984640 1 --2- 172.21.15.5:0/2652222924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d640bf9b0 0x7f8d640a5ba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.864+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 >> 172.21.15.5:0/2652222924 conn(0x7f8d640c17c0 msgr2=0x7f8d64146670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:31.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.871+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 shutdown_connections 2024-05-16T21:33:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:31.872+0000 7f8d6a984640 1 -- 172.21.15.5:0/2652222924 wait complete. 2024-05-16T21:33:31.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-16T21:33:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.012+0000 7fa2ccdc7640 1 Processor -- start 2024-05-16T21:33:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.012+0000 7fa2ccdc7640 1 -- start start 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.013+0000 7fa2ccdc7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2c8151fc0 0x7fa2c80bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.013+0000 7fa2ccdc7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806da30 0x7fa2c80be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.013+0000 7fa2ccdc7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c80c36f0 con 0x7fa2c806de40 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.013+0000 7fa2ccdc7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa2c80bdc10 con 0x7fa2c8151fc0 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.013+0000 7fa2ccdc7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c8152530 con 0x7fa2c806da30 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.014+0000 7fa2c659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2c8151fc0 0x7fa2c80bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.014+0000 7fa2c659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2c8151fc0 0x7fa2c80bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55132/0 (socket says 172.21.15.5:55132) 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.014+0000 7fa2c659c640 1 -- 172.21.15.5:0/1674599561 learned_addr learned my addr 172.21.15.5:0/1674599561 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.014+0000 7fa2c5d9b640 1 --2- 172.21.15.5:0/1674599561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806da30 0x7fa2c80be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.014+0000 7fa2c659c640 1 -- 172.21.15.5:0/1674599561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806da30 msgr2=0x7fa2c80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:32.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.014+0000 7fa2c659c640 1 --2- 172.21.15.5:0/1674599561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806da30 0x7fa2c80be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.014+0000 7fa2c659c640 1 -- 172.21.15.5:0/1674599561 >> v1:172.21.15.157:6789/0 conn(0x7fa2c806de40 legacy=0x7fa2c814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:32.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.014+0000 7fa2c659c640 1 -- 172.21.15.5:0/1674599561 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c8152810 con 0x7fa2c8151fc0 2024-05-16T21:33:32.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.015+0000 7fa2c659c640 1 --2- 172.21.15.5:0/1674599561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c80bd6d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009870 tx=0x7fa2c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1b8cf9c31e8407 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:32.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.015+0000 7fa2c559a640 1 -- 172.21.15.5:0/1674599561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0037070 con 0x7fa2c8151fc0 2024-05-16T21:33:32.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.015+0000 7fa2c559a640 1 -- 172.21.15.5:0/1674599561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c0032440 con 0x7fa2c8151fc0 2024-05-16T21:33:32.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.015+0000 7fa2c559a640 1 -- 172.21.15.5:0/1674599561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0032810 con 0x7fa2c8151fc0 2024-05-16T21:33:32.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.015+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/1674599561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 msgr2=0x7fa2c80bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:32.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.015+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/1674599561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c80bd6d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009870 tx=0x7fa2c002a270 comp rx=0 tx=0).stop 2024-05-16T21:33:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.016+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/1674599561 shutdown_connections 2024-05-16T21:33:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.016+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/1674599561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806da30 0x7fa2c80be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.016+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/1674599561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c80bd6d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.016+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/1674599561 >> 172.21.15.5:0/1674599561 conn(0x7fa2c80c3d20 msgr2=0x7fa2c80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.016+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/1674599561 shutdown_connections 2024-05-16T21:33:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.016+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/1674599561 wait complete. 2024-05-16T21:33:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.017+0000 7fa2ccdc7640 1 Processor -- start 2024-05-16T21:33:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.017+0000 7fa2ccdc7640 1 -- start start 2024-05-16T21:33:32.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.018+0000 7fa2ccdc7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c806da30 0x7fa2c81e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:32.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.018+0000 7fa2ccdc7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806de40 0x7fa2c80a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:32.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.018+0000 7fa2ccdc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:32.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.018+0000 7fa2ccdc7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c80a3050 con 0x7fa2c8151fc0 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.018+0000 7fa2ccdc7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c80a2ed0 con 0x7fa2c806da30 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.018+0000 7fa2ccdc7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c80bee80 con 0x7fa2c806de40 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c814fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55138/0 (socket says 172.21.15.5:55138) 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 -- 172.21.15.5:0/2750954434 learned_addr learned my addr 172.21.15.5:0/2750954434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c659c640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c806da30 0x7fa2c81e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c5d9b640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806de40 0x7fa2c80a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 -- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806de40 msgr2=0x7fa2c80a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806de40 0x7fa2c80a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 -- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c806da30 msgr2=0x7fa2c81e4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c806da30 0x7fa2c81e4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 -- 172.21.15.5:0/2750954434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c80a3fb0 con 0x7fa2c8151fc0 2024-05-16T21:33:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2c6d9d640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c814fef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c700 tx=0x7fa2b800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2beffd640 1 -- 172.21.15.5:0/2750954434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8003b70 con 0x7fa2c8151fc0 2024-05-16T21:33:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2beffd640 1 -- 172.21.15.5:0/2750954434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b8003d10 con 0x7fa2c8151fc0 2024-05-16T21:33:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2beffd640 1 -- 172.21.15.5:0/2750954434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800a9f0 con 0x7fa2c8151fc0 2024-05-16T21:33:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c8151210 con 0x7fa2c8151fc0 2024-05-16T21:33:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.019+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c8151950 con 0x7fa2c8151fc0 2024-05-16T21:33:32.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.020+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c8151480 con 0x7fa2c8151fc0 2024-05-16T21:33:32.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.021+0000 7fa2beffd640 1 -- 172.21.15.5:0/2750954434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa2b800ab90 con 0x7fa2c8151fc0 2024-05-16T21:33:32.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.022+0000 7fa2beffd640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa2a80762d0 0x7fa2a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:32.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.022+0000 7fa2beffd640 1 -- 172.21.15.5:0/2750954434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5609+0+0 (secure 0 0 0) 0x7fa2b8097250 con 0x7fa2c8151fc0 2024-05-16T21:33:32.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.022+0000 7fa2c659c640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa2a80762d0 0x7fa2a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:32.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.023+0000 7fa2c659c640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa2a80762d0 0x7fa2a80787e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0034000 tx=0x7fa2c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:32.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.027+0000 7fa2beffd640 1 -- 172.21.15.5:0/2750954434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2b80605c0 con 0x7fa2c8151fc0 2024-05-16T21:33:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.257+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa2c8050940 con 0x7fa2c8151fc0 2024-05-16T21:33:32.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.874+0000 7fa2beffd640 1 -- 172.21.15.5:0/2750954434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) ==== 172+0+0 (secure 0 0 0) 0x7fa2b80648c0 con 0x7fa2c8151fc0 2024-05-16T21:33:32.876 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 6 and data pool 7 2024-05-16T21:33:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.879+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa2a80762d0 msgr2=0x7fa2a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.879+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa2a80762d0 0x7fa2a80787e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0034000 tx=0x7fa2c002e000 comp rx=0 tx=0).stop 2024-05-16T21:33:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.879+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 msgr2=0x7fa2c814fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.879+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c814fef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c700 tx=0x7fa2b800cbc0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.881+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 shutdown_connections 2024-05-16T21:33:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.881+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa2a80762d0 0x7fa2a80787e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.881+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c8151fc0 0x7fa2c814fef0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.881+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c806de40 0x7fa2c80a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.881+0000 7fa2ccdc7640 1 --2- 172.21.15.5:0/2750954434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c806da30 0x7fa2c81e4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.881+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 >> 172.21.15.5:0/2750954434 conn(0x7fa2c80c3d20 msgr2=0x7fa2c80c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.881+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 shutdown_connections 2024-05-16T21:33:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:32.881+0000 7fa2ccdc7640 1 -- 172.21.15.5:0/2750954434 wait complete. 2024-05-16T21:33:32.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:33:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.022+0000 7f8454b40640 1 Processor -- start 2024-05-16T21:33:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.022+0000 7f8454b40640 1 -- start start 2024-05-16T21:33:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.023+0000 7f8454b40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f845014cce0 0x7f84500716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.023+0000 7f8454b40640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8450071be0 0x7f8450156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f8454b40640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84500720d0 con 0x7f84500be4f0 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f8454b40640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f84500bfa60 con 0x7f845014cce0 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f8454b40640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8450071310 con 0x7f8450071be0 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f84500be4f0 0x7f84500bfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50560/0 (socket says 172.21.15.5:50560) 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844e59c640 1 -- 172.21.15.5:0/2032747956 learned_addr learned my addr 172.21.15.5:0/2032747956 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844dd9b640 1 --2- 172.21.15.5:0/2032747956 >> v2:172.21.15.5:3300/0 conn(0x7f845014cce0 0x7f84500716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844d59a640 1 -- 172.21.15.5:0/2032747956 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721359186 0 0) 0x7f84500720d0 con 0x7f84500be4f0 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844ed9d640 1 --2- 172.21.15.5:0/2032747956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8450071be0 0x7f8450156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844d59a640 1 -- 172.21.15.5:0/2032747956 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f843c003520 con 0x7f84500be4f0 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844dd9b640 1 -- 172.21.15.5:0/2032747956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8450071be0 msgr2=0x7f8450156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844dd9b640 1 --2- 172.21.15.5:0/2032747956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8450071be0 0x7f8450156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844dd9b640 1 -- 172.21.15.5:0/2032747956 >> v1:172.21.15.5:6789/0 conn(0x7f84500be4f0 legacy=0x7f84500bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.024+0000 7f844dd9b640 1 -- 172.21.15.5:0/2032747956 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84500bf6f0 con 0x7f845014cce0 2024-05-16T21:33:33.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.025+0000 7f844dd9b640 1 --2- 172.21.15.5:0/2032747956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845014cce0 0x7f84500716a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f84380097a0 tx=0x7f843802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d84878bd9b9882 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.025+0000 7f844d59a640 1 -- 172.21.15.5:0/2032747956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438037070 con 0x7f845014cce0 2024-05-16T21:33:33.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.025+0000 7f844d59a640 1 -- 172.21.15.5:0/2032747956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843802ae50 con 0x7f845014cce0 2024-05-16T21:33:33.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.025+0000 7f844d59a640 1 -- 172.21.15.5:0/2032747956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438032660 con 0x7f845014cce0 2024-05-16T21:33:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.026+0000 7f8454b40640 1 -- 172.21.15.5:0/2032747956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845014cce0 msgr2=0x7f84500716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.026+0000 7f8454b40640 1 --2- 172.21.15.5:0/2032747956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845014cce0 0x7f84500716a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f84380097a0 tx=0x7f843802a100 comp rx=0 tx=0).stop 2024-05-16T21:33:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.026+0000 7f8454b40640 1 -- 172.21.15.5:0/2032747956 shutdown_connections 2024-05-16T21:33:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.026+0000 7f8454b40640 1 --2- 172.21.15.5:0/2032747956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8450071be0 0x7f8450156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.026+0000 7f8454b40640 1 --2- 172.21.15.5:0/2032747956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845014cce0 0x7f84500716a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.026+0000 7f8454b40640 1 -- 172.21.15.5:0/2032747956 >> 172.21.15.5:0/2032747956 conn(0x7f84500c17c0 msgr2=0x7f84500c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.026+0000 7f8454b40640 1 -- 172.21.15.5:0/2032747956 shutdown_connections 2024-05-16T21:33:33.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.026+0000 7f8454b40640 1 -- 172.21.15.5:0/2032747956 wait complete. 2024-05-16T21:33:33.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.027+0000 7f8454b40640 1 Processor -- start 2024-05-16T21:33:33.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.028+0000 7f8454b40640 1 -- start start 2024-05-16T21:33:33.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8454b40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8450071be0 0x7f84501d2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8454b40640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84500be4f0 0x7f84500a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8454b40640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f845014cce0 0x7f84501e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8454b40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f84500a6c90 con 0x7f8450071be0 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8454b40640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f84500723b0 con 0x7f84500be4f0 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8454b40640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84500bc1c0 con 0x7f845014cce0 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8450071be0 0x7f84501d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8450071be0 0x7f84501d2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55156/0 (socket says 172.21.15.5:55156) 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 -- 172.21.15.5:0/4081497529 learned_addr learned my addr 172.21.15.5:0/4081497529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844ed9d640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f845014cce0 0x7f84501e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844dd9b640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84500be4f0 0x7f84500a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 -- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f845014cce0 msgr2=0x7f84501e24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f845014cce0 0x7f84501e24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 -- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84500be4f0 msgr2=0x7f84500a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84500be4f0 0x7f84500a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 -- 172.21.15.5:0/4081497529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84500a5fe0 con 0x7f8450071be0 2024-05-16T21:33:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f844e59c640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8450071be0 0x7f84501d2600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f844800c440 tx=0x7f844800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8446ffd640 1 -- 172.21.15.5:0/4081497529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448017070 con 0x7f8450071be0 2024-05-16T21:33:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8446ffd640 1 -- 172.21.15.5:0/4081497529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8448005ce0 con 0x7f8450071be0 2024-05-16T21:33:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.029+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84500a2c50 con 0x7f8450071be0 2024-05-16T21:33:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.030+0000 7f8446ffd640 1 -- 172.21.15.5:0/4081497529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448007270 con 0x7f8450071be0 2024-05-16T21:33:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.030+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8450147860 con 0x7f8450071be0 2024-05-16T21:33:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.030+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8450147580 con 0x7f8450071be0 2024-05-16T21:33:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.031+0000 7f8446ffd640 1 -- 172.21.15.5:0/4081497529 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f844801a070 con 0x7f8450071be0 2024-05-16T21:33:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.032+0000 7f8446ffd640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f84300762d0 0x7f84300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.032+0000 7f8446ffd640 1 -- 172.21.15.5:0/4081497529 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5709+0+0 (secure 0 0 0) 0x7f84480967b0 con 0x7f8450071be0 2024-05-16T21:33:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.032+0000 7f844dd9b640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f84300762d0 0x7f84300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.032+0000 7f844dd9b640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f84300762d0 0x7f84300787e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8438034000 tx=0x7f843802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.036+0000 7f8446ffd640 1 -- 172.21.15.5:0/4081497529 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f844805fab0 con 0x7f8450071be0 2024-05-16T21:33:33.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.229+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84500c0e20 con 0x7f8450071be0 2024-05-16T21:33:33.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.230+0000 7f8446ffd640 1 -- 172.21.15.5:0/4081497529 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16578 (secure 0 0 0) 0x7f8448063db0 con 0x7f8450071be0 2024-05-16T21:33:33.232 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:33.233 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:33:32.258724+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:33:29.941238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T21:33:31.208339+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f84300762d0 msgr2=0x7f84300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f84300762d0 0x7f84300787e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8438034000 tx=0x7f843802e000 comp rx=0 tx=0).stop 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8450071be0 msgr2=0x7f84501d2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8450071be0 0x7f84501d2600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f844800c440 tx=0x7f844800c900 comp rx=0 tx=0).stop 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 shutdown_connections 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f84300762d0 0x7f84300787e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f845014cce0 0x7f84501e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84500be4f0 0x7f84500a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 --2- 172.21.15.5:0/4081497529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8450071be0 0x7f84501d2600 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.232+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 >> 172.21.15.5:0/4081497529 conn(0x7f84500c17c0 msgr2=0x7f84501d89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.233+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 shutdown_connections 2024-05-16T21:33:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.233+0000 7f8454b40640 1 -- 172.21.15.5:0/4081497529 wait complete. 2024-05-16T21:33:33.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:33:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.355+0000 7f3855972640 1 Processor -- start 2024-05-16T21:33:33.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.355+0000 7f3855972640 1 -- start start 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.356+0000 7f3855972640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f385006c8c0 0x7f38500bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.356+0000 7f3855972640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3850074a30 0x7f3850152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.356+0000 7f3855972640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38500bb9f0 con 0x7f3850152180 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.356+0000 7f3855972640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3850151a10 con 0x7f3850074a30 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.356+0000 7f3855972640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f38500bb090 con 0x7f385006c8c0 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.356+0000 7f384f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3850074a30 0x7f3850152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.356+0000 7f384e7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3850152180 0x7f3850074320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50562/0 (socket says 172.21.15.5:50562) 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.356+0000 7f384e7fc640 1 -- 172.21.15.5:0/2428198377 learned_addr learned my addr 172.21.15.5:0/2428198377 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.357+0000 7f384effd640 1 --2- 172.21.15.5:0/2428198377 >> v2:172.21.15.157:3300/0 conn(0x7f385006c8c0 0x7f38500bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.357+0000 7f384f7fe640 1 -- 172.21.15.5:0/2428198377 >> v2:172.21.15.157:3300/0 conn(0x7f385006c8c0 msgr2=0x7f38500bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.357+0000 7f384f7fe640 1 --2- 172.21.15.5:0/2428198377 >> v2:172.21.15.157:3300/0 conn(0x7f385006c8c0 0x7f38500bb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.357+0000 7f384f7fe640 1 -- 172.21.15.5:0/2428198377 >> v1:172.21.15.5:6789/0 conn(0x7f3850152180 legacy=0x7f3850074320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.357+0000 7f384f7fe640 1 -- 172.21.15.5:0/2428198377 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38500bbc80 con 0x7f3850074a30 2024-05-16T21:33:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.357+0000 7f384dffb640 1 -- 172.21.15.5:0/2428198377 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404028406 0 0) 0x7f38500bb9f0 con 0x7f3850152180 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f384f7fe640 1 --2- 172.21.15.5:0/2428198377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850152590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f385009fe70 tx=0x7f384802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b69ecf5a0e1c57a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f384dffb640 1 -- 172.21.15.5:0/2428198377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848037070 con 0x7f3850074a30 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f384dffb640 1 -- 172.21.15.5:0/2428198377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3848032440 con 0x7f3850074a30 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f384dffb640 1 -- 172.21.15.5:0/2428198377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848032810 con 0x7f3850074a30 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f3855972640 1 -- 172.21.15.5:0/2428198377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 msgr2=0x7f3850152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f3855972640 1 --2- 172.21.15.5:0/2428198377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850152590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f385009fe70 tx=0x7f384802a1a0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f3855972640 1 -- 172.21.15.5:0/2428198377 shutdown_connections 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f3855972640 1 --2- 172.21.15.5:0/2428198377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850152590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f3855972640 1 --2- 172.21.15.5:0/2428198377 >> v2:172.21.15.157:3300/0 conn(0x7f385006c8c0 0x7f38500bb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f3855972640 1 -- 172.21.15.5:0/2428198377 >> 172.21.15.5:0/2428198377 conn(0x7f38500bd0f0 msgr2=0x7f38500bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f3855972640 1 -- 172.21.15.5:0/2428198377 shutdown_connections 2024-05-16T21:33:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.358+0000 7f3855972640 1 -- 172.21.15.5:0/2428198377 wait complete. 2024-05-16T21:33:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.360+0000 7f3855972640 1 Processor -- start 2024-05-16T21:33:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.360+0000 7f3855972640 1 -- start start 2024-05-16T21:33:33.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f3855972640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f385006c8c0 0x7f38500b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f3855972640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f3855972640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3850152180 0x7f38500b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f3855972640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f385014e4c0 con 0x7f3850074a30 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f3855972640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3850151c60 con 0x7f385006c8c0 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f3855972640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f385006ccd0 con 0x7f3850152180 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f384e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f384e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55168/0 (socket says 172.21.15.5:55168) 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f384e7fc640 1 -- 172.21.15.5:0/2065233270 learned_addr learned my addr 172.21.15.5:0/2065233270 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f384effd640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f385006c8c0 0x7f38500b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.361+0000 7f384f7fe640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3850152180 0x7f38500b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f384e7fc640 1 -- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3850152180 msgr2=0x7f38500b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f384e7fc640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3850152180 0x7f38500b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f384e7fc640 1 -- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f385006c8c0 msgr2=0x7f38500b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f384e7fc640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f385006c8c0 0x7f38500b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f384e7fc640 1 -- 172.21.15.5:0/2065233270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38500715a0 con 0x7f3850074a30 2024-05-16T21:33:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f384e7fc640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850071060 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f383800c3c0 tx=0x7f383800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f3847fff640 1 -- 172.21.15.5:0/2065233270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38380074e0 con 0x7f3850074a30 2024-05-16T21:33:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f3847fff640 1 -- 172.21.15.5:0/2065233270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38380047e0 con 0x7f3850074a30 2024-05-16T21:33:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38500b6eb0 con 0x7f3850074a30 2024-05-16T21:33:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f3847fff640 1 -- 172.21.15.5:0/2065233270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838004bd0 con 0x7f3850074a30 2024-05-16T21:33:33.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.362+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38500b5bd0 con 0x7f3850074a30 2024-05-16T21:33:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.363+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385006a280 con 0x7f3850074a30 2024-05-16T21:33:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.364+0000 7f3847fff640 1 -- 172.21.15.5:0/2065233270 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3838011070 con 0x7f3850074a30 2024-05-16T21:33:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.364+0000 7f3847fff640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38300762d0 0x7f38300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.364+0000 7f3847fff640 1 -- 172.21.15.5:0/2065233270 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5709+0+0 (secure 0 0 0) 0x7f3838096f00 con 0x7f3850074a30 2024-05-16T21:33:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.365+0000 7f384effd640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38300762d0 0x7f38300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.365+0000 7f384effd640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38300762d0 0x7f38300787e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3840011340 tx=0x7f384000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.369+0000 7f3847fff640 1 -- 172.21.15.5:0/2065233270 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f385006a280 con 0x7f3850074a30 2024-05-16T21:33:33.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.561+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38500be3f0 con 0x7f3850074a30 2024-05-16T21:33:33.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.562+0000 7f3847fff640 1 -- 172.21.15.5:0/2065233270 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16578 (secure 0 0 0) 0x7f38380602a0 con 0x7f3850074a30 2024-05-16T21:33:33.564 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:33.565 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:33:32.258724+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:33:29.941238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T21:33:31.208339+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:33:33.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38300762d0 msgr2=0x7f38300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38300762d0 0x7f38300787e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3840011340 tx=0x7f384000b040 comp rx=0 tx=0).stop 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 msgr2=0x7f3850071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850071060 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f383800c3c0 tx=0x7f383800c880 comp rx=0 tx=0).stop 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 shutdown_connections 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f38300762d0 0x7f38300787e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3850152180 0x7f38500b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3850074a30 0x7f3850071060 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 --2- 172.21.15.5:0/2065233270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f385006c8c0 0x7f38500b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.564+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 >> 172.21.15.5:0/2065233270 conn(0x7f38500bd0f0 msgr2=0x7f38500a0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.565+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 shutdown_connections 2024-05-16T21:33:33.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.565+0000 7f3855972640 1 -- 172.21.15.5:0/2065233270 wait complete. 2024-05-16T21:33:33.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-16T21:33:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.691+0000 7f25bfb00640 1 Processor -- start 2024-05-16T21:33:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.691+0000 7f25bfb00640 1 -- start start 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25bfb00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f25b80b4aa0 0x7f25b80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25bfb00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25b814e720 0x7f25b814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25bfb00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25b806fed0 con 0x7f25b814f070 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25bfb00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f25b8071f40 con 0x7f25b814e720 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25bfb00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f25b80bbe50 con 0x7f25b80b4aa0 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25bd09b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25b814e720 0x7f25b814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25be09d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25b814f070 0x7f25b806e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50576/0 (socket says 172.21.15.5:50576) 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25bd09b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25b814e720 0x7f25b814eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55184/0 (socket says 172.21.15.5:55184) 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.692+0000 7f25be09d640 1 -- 172.21.15.5:0/2286227013 learned_addr learned my addr 172.21.15.5:0/2286227013 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.693+0000 7f25bd89c640 1 --2- 172.21.15.5:0/2286227013 >> v2:172.21.15.157:3300/0 conn(0x7f25b80b4aa0 0x7f25b80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.693+0000 7f25bd09b640 1 -- 172.21.15.5:0/2286227013 >> v2:172.21.15.157:3300/0 conn(0x7f25b80b4aa0 msgr2=0x7f25b80b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.693+0000 7f25bd09b640 1 --2- 172.21.15.5:0/2286227013 >> v2:172.21.15.157:3300/0 conn(0x7f25b80b4aa0 0x7f25b80b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.693+0000 7f25bd09b640 1 -- 172.21.15.5:0/2286227013 >> v1:172.21.15.5:6789/0 conn(0x7f25b814f070 legacy=0x7f25b806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.693+0000 7f25bd09b640 1 -- 172.21.15.5:0/2286227013 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b80bb0e0 con 0x7f25b814e720 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.693+0000 7f25bd09b640 1 --2- 172.21.15.5:0/2286227013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814e720 0x7f25b814eb30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f25a80097a0 tx=0x7f25a802b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9811500ad1b18d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bc89a640 1 -- 172.21.15.5:0/2286227013 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8038070 con 0x7f25b814e720 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bc89a640 1 -- 172.21.15.5:0/2286227013 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a8033440 con 0x7f25b814e720 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bc89a640 1 -- 172.21.15.5:0/2286227013 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8033810 con 0x7f25b814e720 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bfb00640 1 -- 172.21.15.5:0/2286227013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814e720 msgr2=0x7f25b814eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2286227013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814e720 0x7f25b814eb30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f25a80097a0 tx=0x7f25a802b2f0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bfb00640 1 -- 172.21.15.5:0/2286227013 shutdown_connections 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2286227013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814e720 0x7f25b814eb30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2286227013 >> v2:172.21.15.157:3300/0 conn(0x7f25b80b4aa0 0x7f25b80b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bfb00640 1 -- 172.21.15.5:0/2286227013 >> 172.21.15.5:0/2286227013 conn(0x7f25b80a1ac0 msgr2=0x7f25b80bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bfb00640 1 -- 172.21.15.5:0/2286227013 shutdown_connections 2024-05-16T21:33:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.694+0000 7f25bfb00640 1 -- 172.21.15.5:0/2286227013 wait complete. 2024-05-16T21:33:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.696+0000 7f25bfb00640 1 Processor -- start 2024-05-16T21:33:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.696+0000 7f25bfb00640 1 -- start start 2024-05-16T21:33:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25bfb00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b80b4aa0 0x7f25b80a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25bfb00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b814e720 0x7f25b80a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25bfb00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814f070 0x7f25b81e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25bfb00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f25b814f480 con 0x7f25b814f070 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25bfb00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f25b80bab60 con 0x7f25b80b4aa0 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25bfb00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f25b80b9ee0 con 0x7f25b814e720 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25be09d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814f070 0x7f25b81e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25be09d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814f070 0x7f25b81e3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55186/0 (socket says 172.21.15.5:55186) 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25be09d640 1 -- 172.21.15.5:0/2700767294 learned_addr learned my addr 172.21.15.5:0/2700767294 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25bd89c640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b80b4aa0 0x7f25b80a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25bd09b640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b814e720 0x7f25b80a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25be09d640 1 -- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b814e720 msgr2=0x7f25b80a2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25be09d640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b814e720 0x7f25b80a2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25be09d640 1 -- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b80b4aa0 msgr2=0x7f25b80a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25be09d640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b80b4aa0 0x7f25b80a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.697+0000 7f25be09d640 1 -- 172.21.15.5:0/2700767294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b80a4770 con 0x7f25b814f070 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.698+0000 7f25be09d640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814f070 0x7f25b81e3c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f25b000cb40 tx=0x7f25b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.698+0000 7f25ae7fc640 1 -- 172.21.15.5:0/2700767294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0017070 con 0x7f25b814f070 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.698+0000 7f25ae7fc640 1 -- 172.21.15.5:0/2700767294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b000abe0 con 0x7f25b814f070 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.698+0000 7f25ae7fc640 1 -- 172.21.15.5:0/2700767294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0012400 con 0x7f25b814f070 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.698+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b80a3120 con 0x7f25b814f070 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.698+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b80a37c0 con 0x7f25b814f070 2024-05-16T21:33:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.699+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b80a4a70 con 0x7f25b814f070 2024-05-16T21:33:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.700+0000 7f25ae7fc640 1 -- 172.21.15.5:0/2700767294 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f25b001a070 con 0x7f25b814f070 2024-05-16T21:33:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.700+0000 7f25ae7fc640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f259c076300 0x7f259c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.700+0000 7f25ae7fc640 1 -- 172.21.15.5:0/2700767294 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5709+0+0 (secure 0 0 0) 0x7f25b00971a0 con 0x7f25b814f070 2024-05-16T21:33:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.700+0000 7f25bd89c640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f259c076300 0x7f259c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.701+0000 7f25bd89c640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f259c076300 0x7f259c078810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25b8071430 tx=0x7f25b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:33.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.705+0000 7f25ae7fc640 1 -- 172.21.15.5:0/2700767294 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f25b806fed0 con 0x7f25b814f070 2024-05-16T21:33:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:33.939+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f25b8050940 con 0x7f25b814f070 2024-05-16T21:33:34.852 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-05-16T21:33:34.850+0000 7f3405bc7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T21:33:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.883+0000 7f25ae7fc640 1 -- 172.21.15.5:0/2700767294 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f25b0060420 con 0x7f25b814f070 2024-05-16T21:33:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f259c076300 msgr2=0x7f259c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f259c076300 0x7f259c078810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25b8071430 tx=0x7f25b4008040 comp rx=0 tx=0).stop 2024-05-16T21:33:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814f070 msgr2=0x7f25b81e3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814f070 0x7f25b81e3c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f25b000cb40 tx=0x7f25b000a060 comp rx=0 tx=0).stop 2024-05-16T21:33:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 shutdown_connections 2024-05-16T21:33:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f259c076300 0x7f259c078810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b814f070 0x7f25b81e3c50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b814e720 0x7f25b80a2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 --2- 172.21.15.5:0/2700767294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b80b4aa0 0x7f25b80a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 >> 172.21.15.5:0/2700767294 conn(0x7f25b80a1ac0 msgr2=0x7f25b8143c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 shutdown_connections 2024-05-16T21:33:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:34.886+0000 7f25bfb00640 1 -- 172.21.15.5:0/2700767294 wait complete. 2024-05-16T21:33:34.902 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-16T21:33:34.902 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-16T21:33:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.022+0000 7f2b5b9ce640 1 Processor -- start 2024-05-16T21:33:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.022+0000 7f2b5b9ce640 1 -- start start 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.023+0000 7f2b5b9ce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b5414e360 0x7f2b541522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.023+0000 7f2b5b9ce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b540bf9b0 0x7f2b540bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.023+0000 7f2b5b9ce640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b540c1390 con 0x7f2b54148770 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.023+0000 7f2b5b9ce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2b54151e40 con 0x7f2b540bf9b0 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.023+0000 7f2b5b9ce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2b540c0620 con 0x7f2b5414e360 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.024+0000 7f2b59f6b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b540bf9b0 0x7f2b540bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.024+0000 7f2b59f6b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b540bf9b0 0x7f2b540bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55190/0 (socket says 172.21.15.5:55190) 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.024+0000 7f2b59f6b640 1 -- 172.21.15.5:0/4205932609 learned_addr learned my addr 172.21.15.5:0/4205932609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.024+0000 7f2b5976a640 1 --2- 172.21.15.5:0/4205932609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b5414e360 0x7f2b541522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.024+0000 7f2b59f6b640 1 -- 172.21.15.5:0/4205932609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b5414e360 msgr2=0x7f2b541522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.024+0000 7f2b59f6b640 1 --2- 172.21.15.5:0/4205932609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b5414e360 0x7f2b541522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.024+0000 7f2b59f6b640 1 -- 172.21.15.5:0/4205932609 >> v1:172.21.15.157:6789/0 conn(0x7f2b54148770 legacy=0x7f2b540c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.024+0000 7f2b59f6b640 1 -- 172.21.15.5:0/4205932609 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b54151ad0 con 0x7f2b540bf9b0 2024-05-16T21:33:35.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.025+0000 7f2b59f6b640 1 --2- 172.21.15.5:0/4205932609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b540bfdc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009e80 tx=0x7f2b4402a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71836c0d1086662 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.025+0000 7f2b53fff640 1 -- 172.21.15.5:0/4205932609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44036070 con 0x7f2b540bf9b0 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.025+0000 7f2b53fff640 1 -- 172.21.15.5:0/4205932609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b44031600 con 0x7f2b540bf9b0 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.025+0000 7f2b53fff640 1 -- 172.21.15.5:0/4205932609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b440319d0 con 0x7f2b540bf9b0 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.025+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/4205932609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 msgr2=0x7f2b540bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.025+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/4205932609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b540bfdc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009e80 tx=0x7f2b4402a7f0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.026+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/4205932609 shutdown_connections 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.026+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/4205932609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b540bfdc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.026+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/4205932609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b5414e360 0x7f2b541522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.026+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/4205932609 >> 172.21.15.5:0/4205932609 conn(0x7f2b540c17c0 msgr2=0x7f2b540c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.026+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/4205932609 shutdown_connections 2024-05-16T21:33:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.026+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/4205932609 wait complete. 2024-05-16T21:33:35.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.027+0000 7f2b5b9ce640 1 Processor -- start 2024-05-16T21:33:35.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.027+0000 7f2b5b9ce640 1 -- start start 2024-05-16T21:33:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5b9ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5b9ce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b54148770 0x7f2b541e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5b9ce640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b5414e360 0x7f2b5413da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5b9ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b54158cc0 con 0x7f2b540bf9b0 2024-05-16T21:33:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5b9ce640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2b540c0300 con 0x7f2b5414e360 2024-05-16T21:33:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5b9ce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2b54158e40 con 0x7f2b54148770 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5976a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5976a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b5406edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55204/0 (socket says 172.21.15.5:55204) 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.028+0000 7f2b5976a640 1 -- 172.21.15.5:0/234503356 learned_addr learned my addr 172.21.15.5:0/234503356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b59f6b640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b5414e360 0x7f2b5413da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b58f69640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b54148770 0x7f2b541e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b5976a640 1 -- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b54148770 msgr2=0x7f2b541e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b5976a640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b54148770 0x7f2b541e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b5976a640 1 -- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b5414e360 msgr2=0x7f2b5413da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b5976a640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b5414e360 0x7f2b5413da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b5976a640 1 -- 172.21.15.5:0/234503356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5406f2f0 con 0x7f2b540bf9b0 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b5976a640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b5406edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00d620 tx=0x7f2b4c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b51ffb640 1 -- 172.21.15.5:0/234503356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00b620 con 0x7f2b540bf9b0 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b51ffb640 1 -- 172.21.15.5:0/234503356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c019070 con 0x7f2b540bf9b0 2024-05-16T21:33:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b541e7ec0 con 0x7f2b540bf9b0 2024-05-16T21:33:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b51ffb640 1 -- 172.21.15.5:0/234503356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00ba00 con 0x7f2b540bf9b0 2024-05-16T21:33:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.029+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b54141c30 con 0x7f2b540bf9b0 2024-05-16T21:33:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.031+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b54069c60 con 0x7f2b540bf9b0 2024-05-16T21:33:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.031+0000 7f2b51ffb640 1 -- 172.21.15.5:0/234503356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b4c00bba0 con 0x7f2b540bf9b0 2024-05-16T21:33:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.031+0000 7f2b51ffb640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b40076300 0x7f2b40078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.031+0000 7f2b51ffb640 1 -- 172.21.15.5:0/234503356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7f2b4c097820 con 0x7f2b540bf9b0 2024-05-16T21:33:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.032+0000 7f2b58f69640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b40076300 0x7f2b40078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.032+0000 7f2b58f69640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b40076300 0x7f2b40078810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b54144a80 tx=0x7f2b48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:35.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.036+0000 7f2b51ffb640 1 -- 172.21.15.5:0/234503356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2b4c060bc0 con 0x7f2b540bf9b0 2024-05-16T21:33:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.267+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2b54050940 con 0x7f2b540bf9b0 2024-05-16T21:33:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.884+0000 7f2b51ffb640 1 -- 172.21.15.5:0/234503356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f2b4c069030 con 0x7f2b540bf9b0 2024-05-16T21:33:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b40076300 msgr2=0x7f2b40078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b40076300 0x7f2b40078810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b54144a80 tx=0x7f2b48009040 comp rx=0 tx=0).stop 2024-05-16T21:33:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 msgr2=0x7f2b5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b5406edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00d620 tx=0x7f2b4c00dae0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 shutdown_connections 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b40076300 0x7f2b40078810 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b5414e360 0x7f2b5413da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b54148770 0x7f2b541e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 --2- 172.21.15.5:0/234503356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540bf9b0 0x7f2b5406edb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 >> 172.21.15.5:0/234503356 conn(0x7f2b540c17c0 msgr2=0x7f2b540be760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 shutdown_connections 2024-05-16T21:33:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:35.888+0000 7f2b5b9ce640 1 -- 172.21.15.5:0/234503356 wait complete. 2024-05-16T21:33:35.904 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-16T21:33:35.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.021+0000 7fe1e9cf9640 1 Processor -- start 2024-05-16T21:33:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.021+0000 7fe1e9cf9640 1 -- start start 2024-05-16T21:33:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e9cf9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1e4151fc0 0x7fe1e40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e9cf9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe1e40bf050 0x7fe1e4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e9cf9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e40c36f0 con 0x7fe1e406da30 2024-05-16T21:33:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e9cf9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e40bdc10 con 0x7fe1e4151fc0 2024-05-16T21:33:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e9cf9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e4152530 con 0x7fe1e40bf050 2024-05-16T21:33:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1e4151fc0 0x7fe1e40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1e4151fc0 0x7fe1e40bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55218/0 (socket says 172.21.15.5:55218) 2024-05-16T21:33:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e37fe640 1 -- 172.21.15.5:0/4206522983 learned_addr learned my addr 172.21.15.5:0/4206522983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.022+0000 7fe1e3fff640 1 --2- 172.21.15.5:0/4206522983 >> v2:172.21.15.157:3300/0 conn(0x7fe1e40bf050 0x7fe1e4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.023+0000 7fe1e37fe640 1 -- 172.21.15.5:0/4206522983 >> v2:172.21.15.157:3300/0 conn(0x7fe1e40bf050 msgr2=0x7fe1e4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.023+0000 7fe1e37fe640 1 --2- 172.21.15.5:0/4206522983 >> v2:172.21.15.157:3300/0 conn(0x7fe1e40bf050 0x7fe1e4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.023+0000 7fe1e37fe640 1 -- 172.21.15.5:0/4206522983 >> v1:172.21.15.157:6789/0 conn(0x7fe1e406da30 legacy=0x7fe1e40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.023+0000 7fe1e37fe640 1 -- 172.21.15.5:0/4206522983 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e4152810 con 0x7fe1e4151fc0 2024-05-16T21:33:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.023+0000 7fe1e37fe640 1 --2- 172.21.15.5:0/4206522983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e4151fc0 0x7fe1e40bd6d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40bf8f0 tx=0x7fe1d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc25b1fced079e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e27fc640 1 -- 172.21.15.5:0/4206522983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4037070 con 0x7fe1e4151fc0 2024-05-16T21:33:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e27fc640 1 -- 172.21.15.5:0/4206522983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d4032440 con 0x7fe1e4151fc0 2024-05-16T21:33:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e27fc640 1 -- 172.21.15.5:0/4206522983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4032810 con 0x7fe1e4151fc0 2024-05-16T21:33:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/4206522983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e4151fc0 msgr2=0x7fe1e40bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/4206522983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e4151fc0 0x7fe1e40bd6d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40bf8f0 tx=0x7fe1d402a270 comp rx=0 tx=0).stop 2024-05-16T21:33:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/4206522983 shutdown_connections 2024-05-16T21:33:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/4206522983 >> v2:172.21.15.157:3300/0 conn(0x7fe1e40bf050 0x7fe1e4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/4206522983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e4151fc0 0x7fe1e40bd6d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/4206522983 >> 172.21.15.5:0/4206522983 conn(0x7fe1e40c3d20 msgr2=0x7fe1e40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/4206522983 shutdown_connections 2024-05-16T21:33:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.024+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/4206522983 wait complete. 2024-05-16T21:33:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.026+0000 7fe1e9cf9640 1 Processor -- start 2024-05-16T21:33:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.026+0000 7fe1e9cf9640 1 -- start start 2024-05-16T21:33:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e9cf9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1e406da30 0x7fe1e40a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e9cf9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40bf050 0x7fe1e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e9cf9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1e4151fc0 0x7fe1e41e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e9cf9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e40a3050 con 0x7fe1e40bf050 2024-05-16T21:33:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e9cf9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e40a2ed0 con 0x7fe1e406da30 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e9cf9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e406de40 con 0x7fe1e4151fc0 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40bf050 0x7fe1e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40bf050 0x7fe1e40b8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55224/0 (socket says 172.21.15.5:55224) 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e2ffd640 1 -- 172.21.15.5:0/1243111151 learned_addr learned my addr 172.21.15.5:0/1243111151 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e37fe640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1e406da30 0x7fe1e40a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.027+0000 7fe1e3fff640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1e4151fc0 0x7fe1e41e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e2ffd640 1 -- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1e4151fc0 msgr2=0x7fe1e41e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e2ffd640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1e4151fc0 0x7fe1e41e4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e2ffd640 1 -- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1e406da30 msgr2=0x7fe1e40a2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e2ffd640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1e406da30 0x7fe1e40a2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e2ffd640 1 -- 172.21.15.5:0/1243111151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e40ba3c0 con 0x7fe1e40bf050 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e3fff640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1e4151fc0 0x7fe1e41e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e2ffd640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40bf050 0x7fe1e40b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c3c0 tx=0x7fe1d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1cbfff640 1 -- 172.21.15.5:0/1243111151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80052d0 con 0x7fe1e40bf050 2024-05-16T21:33:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1cbfff640 1 -- 172.21.15.5:0/1243111151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d8005490 con 0x7fe1e40bf050 2024-05-16T21:33:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1cbfff640 1 -- 172.21.15.5:0/1243111151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8007260 con 0x7fe1e40bf050 2024-05-16T21:33:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e40a2bc0 con 0x7fe1e40bf050 2024-05-16T21:33:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.028+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e41e48a0 con 0x7fe1e40bf050 2024-05-16T21:33:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.029+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e40beb40 con 0x7fe1e40bf050 2024-05-16T21:33:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.030+0000 7fe1cbfff640 1 -- 172.21.15.5:0/1243111151 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe1d8007400 con 0x7fe1e40bf050 2024-05-16T21:33:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.030+0000 7fe1cbfff640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1d00762d0 0x7fe1d00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.030+0000 7fe1cbfff640 1 -- 172.21.15.5:0/1243111151 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d8096900 con 0x7fe1e40bf050 2024-05-16T21:33:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.031+0000 7fe1e37fe640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1d00762d0 0x7fe1d00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.031+0000 7fe1e37fe640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1d00762d0 0x7fe1d00787e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4034000 tx=0x7fe1d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.035+0000 7fe1cbfff640 1 -- 172.21.15.5:0/1243111151 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe1d8060260 con 0x7fe1e40bf050 2024-05-16T21:33:36.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.266+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1e4050940 con 0x7fe1e40bf050 2024-05-16T21:33:36.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.267+0000 7fe1cbfff640 1 -- 172.21.15.5:0/1243111151 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+4353 (secure 0 0 0) 0x7fe1d805fb60 con 0x7fe1e40bf050 2024-05-16T21:33:36.269 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:36.269 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:35.268817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1584346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1584346239},{"type":"v1","addr":"172.21.15.5:6835","nonce":1584346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5013,"qdb_cluster":[5013]},"id":3}]} 2024-05-16T21:33:36.269 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-05-16T21:33:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1d00762d0 msgr2=0x7fe1d00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1d00762d0 0x7fe1d00787e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4034000 tx=0x7fe1d402e000 comp rx=0 tx=0).stop 2024-05-16T21:33:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40bf050 msgr2=0x7fe1e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40bf050 0x7fe1e40b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c3c0 tx=0x7fe1d800c880 comp rx=0 tx=0).stop 2024-05-16T21:33:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 shutdown_connections 2024-05-16T21:33:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe1d00762d0 0x7fe1d00787e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1e4151fc0 0x7fe1e41e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40bf050 0x7fe1e40b8a20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 --2- 172.21.15.5:0/1243111151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1e406da30 0x7fe1e40a2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 >> 172.21.15.5:0/1243111151 conn(0x7fe1e40c3d20 msgr2=0x7fe1e40c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 shutdown_connections 2024-05-16T21:33:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.269+0000 7fe1e9cf9640 1 -- 172.21.15.5:0/1243111151 wait complete. 2024-05-16T21:33:36.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:33:36.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.391+0000 7feb6a615640 1 Processor -- start 2024-05-16T21:33:36.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.391+0000 7feb6a615640 1 -- start start 2024-05-16T21:33:36.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb6a615640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feb64148770 0x7feb640c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb6a615640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb640c0620 con 0x7feb640bf9b0 2024-05-16T21:33:36.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb6a615640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb64151ad0 con 0x7feb6414e360 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb6a615640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7feb64151e40 con 0x7feb64148770 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb68bb2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb640bf9b0 0x7feb640bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50592/0 (socket says 172.21.15.5:50592) 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb68bb2640 1 -- 172.21.15.5:0/4204965980 learned_addr learned my addr 172.21.15.5:0/4204965980 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb637fe640 1 --2- 172.21.15.5:0/4204965980 >> v2:172.21.15.157:3300/0 conn(0x7feb64148770 0x7feb640c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818275946 0 0) 0x7feb640c0620 con 0x7feb640bf9b0 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb50003520 con 0x7feb640bf9b0 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2419925640 0 0) 0x7feb50003520 con 0x7feb640bf9b0 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 >> v2:172.21.15.157:3300/0 conn(0x7feb64148770 msgr2=0x7feb640c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 --2- 172.21.15.5:0/4204965980 >> v2:172.21.15.157:3300/0 conn(0x7feb64148770 0x7feb640c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 >> v1:172.21.15.157:6789/0 conn(0x7feb6414e360 legacy=0x7feb641522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb640c11c0 con 0x7feb640bf9b0 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7feb5c001a70 con 0x7feb640bf9b0 2024-05-16T21:33:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 >> v1:172.21.15.5:6789/0 conn(0x7feb640bf9b0 legacy=0x7feb640bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb50003a50 0x7feb50003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50004800 0x7feb50004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb50005250 0x7feb5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb64151e40 con 0x7feb50005250 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb5000c1d0 con 0x7feb50003a50 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.393+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb5000c3d0 con 0x7feb50004800 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb68bb2640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb50005250 0x7feb5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb63fff640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb50003a50 0x7feb50003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb637fe640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50004800 0x7feb50004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb68bb2640 1 -- 172.21.15.5:0/4204965980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50004800 msgr2=0x7feb50004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb68bb2640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50004800 0x7feb50004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb68bb2640 1 -- 172.21.15.5:0/4204965980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb50003a50 msgr2=0x7feb50003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:36.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb68bb2640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb50003a50 0x7feb50003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb68bb2640 1 -- 172.21.15.5:0/4204965980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb50003520 con 0x7feb50005250 2024-05-16T21:33:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.394+0000 7feb68bb2640 1 -- 172.21.15.5:0/4204965980 reap_dead start 2024-05-16T21:33:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb68bb2640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb50005250 0x7feb5000b9c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feb6414e790 tx=0x7feb50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8579782bbf3c3f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c00a480 con 0x7feb50005250 2024-05-16T21:33:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c02f070 con 0x7feb50005250 2024-05-16T21:33:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb62ffd640 1 -- 172.21.15.5:0/4204965980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c02bc00 con 0x7feb50005250 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb6a615640 1 -- 172.21.15.5:0/4204965980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb50005250 msgr2=0x7feb5000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb6a615640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb50005250 0x7feb5000b9c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feb6414e790 tx=0x7feb50005830 comp rx=0 tx=0).stop 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb6a615640 1 -- 172.21.15.5:0/4204965980 shutdown_connections 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb6a615640 1 --2- 172.21.15.5:0/4204965980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb50005250 0x7feb5000b9c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.395+0000 7feb6a615640 1 -- 172.21.15.5:0/4204965980 >> 172.21.15.5:0/4204965980 conn(0x7feb640c17c0 msgr2=0x7feb640c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.396+0000 7feb6a615640 1 -- 172.21.15.5:0/4204965980 shutdown_connections 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.396+0000 7feb6a615640 1 -- 172.21.15.5:0/4204965980 wait complete. 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.397+0000 7feb6a615640 1 Processor -- start 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.397+0000 7feb6a615640 1 -- start start 2024-05-16T21:33:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb6a615640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50005250 0x7feb641e4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb6a615640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb64150e20 0x7feb64146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb6a615640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb641473c0 0x7feb641e7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb6a615640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb640c1010 con 0x7feb64150e20 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb6a615640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb640c0e90 con 0x7feb641473c0 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb6a615640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb641522d0 con 0x7feb50005250 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb64150e20 0x7feb64146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb64150e20 0x7feb64146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55236/0 (socket says 172.21.15.5:55236) 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.398+0000 7feb637fe640 1 -- 172.21.15.5:0/246171121 learned_addr learned my addr 172.21.15.5:0/246171121 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb68bb2640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb641473c0 0x7feb641e7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb63fff640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50005250 0x7feb641e4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb637fe640 1 -- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50005250 msgr2=0x7feb641e4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb637fe640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50005250 0x7feb641e4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb637fe640 1 -- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb641473c0 msgr2=0x7feb641e7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb637fe640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb641473c0 0x7feb641e7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb637fe640 1 -- 172.21.15.5:0/246171121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb641e46b0 con 0x7feb64150e20 2024-05-16T21:33:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb637fe640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb64150e20 0x7feb64146e80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb54011910 tx=0x7feb54011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb60ff9640 1 -- 172.21.15.5:0/246171121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5400faf0 con 0x7feb64150e20 2024-05-16T21:33:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb60ff9640 1 -- 172.21.15.5:0/246171121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5400fc90 con 0x7feb64150e20 2024-05-16T21:33:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb640a6400 con 0x7feb64150e20 2024-05-16T21:33:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb60ff9640 1 -- 172.21.15.5:0/246171121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54014440 con 0x7feb64150e20 2024-05-16T21:33:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.399+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6414f5a0 con 0x7feb64150e20 2024-05-16T21:33:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.400+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb64148370 con 0x7feb64150e20 2024-05-16T21:33:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.401+0000 7feb60ff9640 1 -- 172.21.15.5:0/246171121 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb54012040 con 0x7feb64150e20 2024-05-16T21:33:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.401+0000 7feb60ff9640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7feb440762d0 0x7feb440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.402+0000 7feb60ff9640 1 -- 172.21.15.5:0/246171121 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7feb54097cd0 con 0x7feb64150e20 2024-05-16T21:33:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.402+0000 7feb63fff640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7feb440762d0 0x7feb440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.402+0000 7feb63fff640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7feb440762d0 0x7feb440787e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0035f0 tx=0x7feb4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.406+0000 7feb60ff9640 1 -- 172.21.15.5:0/246171121 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feb54019030 con 0x7feb64150e20 2024-05-16T21:33:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.598+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb64050940 con 0x7feb64150e20 2024-05-16T21:33:36.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.599+0000 7feb60ff9640 1 -- 172.21.15.5:0/246171121 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16565 (secure 0 0 0) 0x7feb540615a0 con 0x7feb64150e20 2024-05-16T21:33:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:36.602 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:33:33.873345+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:33:29.941238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T21:33:31.208339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:33:36.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7feb440762d0 msgr2=0x7feb440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7feb440762d0 0x7feb440787e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0035f0 tx=0x7feb4c009040 comp rx=0 tx=0).stop 2024-05-16T21:33:36.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb64150e20 msgr2=0x7feb64146e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb64150e20 0x7feb64146e80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb54011910 tx=0x7feb54011dd0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 shutdown_connections 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7feb440762d0 0x7feb440787e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb641473c0 0x7feb641e7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb64150e20 0x7feb64146e80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 --2- 172.21.15.5:0/246171121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb50005250 0x7feb641e4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.601+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 >> 172.21.15.5:0/246171121 conn(0x7feb640c17c0 msgr2=0x7feb640bd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.602+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 shutdown_connections 2024-05-16T21:33:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.602+0000 7feb6a615640 1 -- 172.21.15.5:0/246171121 wait complete. 2024-05-16T21:33:36.615 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T21:33:36.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T21:33:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.724+0000 7fdb78a84640 1 Processor -- start 2024-05-16T21:33:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.724+0000 7fdb78a84640 1 -- start start 2024-05-16T21:33:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb78a84640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb740be4f0 0x7fdb740bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb78a84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb7414d0f0 0x7fdb74156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb78a84640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb740720d0 con 0x7fdb7414cce0 2024-05-16T21:33:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb78a84640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdb740bfa60 con 0x7fdb740be4f0 2024-05-16T21:33:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb78a84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb74071310 con 0x7fdb7414d0f0 2024-05-16T21:33:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb7259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb740be4f0 0x7fdb740bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb71d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdb7414cce0 0x7fdb740716a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44220/0 (socket says 172.21.15.5:44220) 2024-05-16T21:33:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb71d9b640 1 -- 172.21.15.5:0/1220596318 learned_addr learned my addr 172.21.15.5:0/1220596318 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb72d9d640 1 --2- 172.21.15.5:0/1220596318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb7414d0f0 0x7fdb74156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb7259c640 1 -- 172.21.15.5:0/1220596318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb7414d0f0 msgr2=0x7fdb74156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb7259c640 1 --2- 172.21.15.5:0/1220596318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb7414d0f0 0x7fdb74156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb7259c640 1 -- 172.21.15.5:0/1220596318 >> v1:172.21.15.5:6789/0 conn(0x7fdb7414cce0 legacy=0x7fdb740716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb7159a640 1 -- 172.21.15.5:0/1220596318 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67449282 0 0) 0x7fdb740720d0 con 0x7fdb7414cce0 2024-05-16T21:33:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb7259c640 1 -- 172.21.15.5:0/1220596318 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb740bf6f0 con 0x7fdb740be4f0 2024-05-16T21:33:36.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.726+0000 7fdb72d9d640 1 --2- 172.21.15.5:0/1220596318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb7414d0f0 0x7fdb74156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.727+0000 7fdb7259c640 1 --2- 172.21.15.5:0/1220596318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb740be4f0 0x7fdb740bfef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0097a0 tx=0x7fdb6c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c39b97b92e856 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.727+0000 7fdb7159a640 1 -- 172.21.15.5:0/1220596318 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c037070 con 0x7fdb740be4f0 2024-05-16T21:33:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.727+0000 7fdb7159a640 1 -- 172.21.15.5:0/1220596318 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6c02ae50 con 0x7fdb740be4f0 2024-05-16T21:33:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.727+0000 7fdb7159a640 1 -- 172.21.15.5:0/1220596318 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c032660 con 0x7fdb740be4f0 2024-05-16T21:33:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.728+0000 7fdb78a84640 1 -- 172.21.15.5:0/1220596318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb740be4f0 msgr2=0x7fdb740bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.728+0000 7fdb78a84640 1 --2- 172.21.15.5:0/1220596318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb740be4f0 0x7fdb740bfef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0097a0 tx=0x7fdb6c02a100 comp rx=0 tx=0).stop 2024-05-16T21:33:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.728+0000 7fdb78a84640 1 -- 172.21.15.5:0/1220596318 shutdown_connections 2024-05-16T21:33:36.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.728+0000 7fdb78a84640 1 --2- 172.21.15.5:0/1220596318 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb7414d0f0 0x7fdb74156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.728+0000 7fdb78a84640 1 --2- 172.21.15.5:0/1220596318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb740be4f0 0x7fdb740bfef0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.728+0000 7fdb78a84640 1 -- 172.21.15.5:0/1220596318 >> 172.21.15.5:0/1220596318 conn(0x7fdb740c17c0 msgr2=0x7fdb740c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:36.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.728+0000 7fdb78a84640 1 -- 172.21.15.5:0/1220596318 shutdown_connections 2024-05-16T21:33:36.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.728+0000 7fdb78a84640 1 -- 172.21.15.5:0/1220596318 wait complete. 2024-05-16T21:33:36.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.729+0000 7fdb78a84640 1 Processor -- start 2024-05-16T21:33:36.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.730+0000 7fdb78a84640 1 -- start start 2024-05-16T21:33:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb78a84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb740be4f0 0x7fdb741d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb78a84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb7414cce0 0x7fdb741d57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb78a84640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7414d0f0 0x7fdb7409fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb78a84640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74071db0 con 0x7fdb7414cce0 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb78a84640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdb740723b0 con 0x7fdb7414d0f0 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb78a84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb740c0430 con 0x7fdb740be4f0 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb7414cce0 0x7fdb741d57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb7414cce0 0x7fdb741d57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46422/0 (socket says 172.21.15.5:46422) 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 -- 172.21.15.5:0/4006442709 learned_addr learned my addr 172.21.15.5:0/4006442709 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb72d9d640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7414d0f0 0x7fdb7409fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb7259c640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb740be4f0 0x7fdb741d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 -- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb740be4f0 msgr2=0x7fdb741d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb740be4f0 0x7fdb741d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 -- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7414d0f0 msgr2=0x7fdb7409fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7414d0f0 0x7fdb7409fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 -- 172.21.15.5:0/4006442709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb740a0a30 con 0x7fdb7414cce0 2024-05-16T21:33:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb7259c640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb740be4f0 0x7fdb741d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb71d9b640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb7414cce0 0x7fdb741d57b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c390 tx=0x7fdb6800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb62ffd640 1 -- 172.21.15.5:0/4006442709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680074e0 con 0x7fdb7414cce0 2024-05-16T21:33:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb62ffd640 1 -- 172.21.15.5:0/4006442709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb680047e0 con 0x7fdb7414cce0 2024-05-16T21:33:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.731+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb741d3a10 con 0x7fdb7414cce0 2024-05-16T21:33:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.732+0000 7fdb62ffd640 1 -- 172.21.15.5:0/4006442709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68004bd0 con 0x7fdb7414cce0 2024-05-16T21:33:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.732+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb741d4a30 con 0x7fdb7414cce0 2024-05-16T21:33:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.732+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb74050940 con 0x7fdb7414cce0 2024-05-16T21:33:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.733+0000 7fdb62ffd640 1 -- 172.21.15.5:0/4006442709 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb68011070 con 0x7fdb7414cce0 2024-05-16T21:33:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.734+0000 7fdb62ffd640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb540762d0 0x7fdb540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.734+0000 7fdb62ffd640 1 -- 172.21.15.5:0/4006442709 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fdb68097070 con 0x7fdb7414cce0 2024-05-16T21:33:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.734+0000 7fdb7259c640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb540762d0 0x7fdb540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.734+0000 7fdb7259c640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb540762d0 0x7fdb540787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c034000 tx=0x7fdb6c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.738+0000 7fdb62ffd640 1 -- 172.21.15.5:0/4006442709 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdb68060a60 con 0x7fdb7414cce0 2024-05-16T21:33:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.926+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb741d3730 con 0x7fdb540762d0 2024-05-16T21:33:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.933+0000 7fdb62ffd640 1 -- 172.21.15.5:0/4006442709 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7fdb741d3730 con 0x7fdb540762d0 2024-05-16T21:33:36.938 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T21:33:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb540762d0 msgr2=0x7fdb540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb540762d0 0x7fdb540787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c034000 tx=0x7fdb6c02e000 comp rx=0 tx=0).stop 2024-05-16T21:33:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb7414cce0 msgr2=0x7fdb741d57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb7414cce0 0x7fdb741d57b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c390 tx=0x7fdb6800c850 comp rx=0 tx=0).stop 2024-05-16T21:33:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 shutdown_connections 2024-05-16T21:33:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdb540762d0 0x7fdb540787e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7414d0f0 0x7fdb7409fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb7414cce0 0x7fdb741d57b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 --2- 172.21.15.5:0/4006442709 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb740be4f0 0x7fdb741d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 >> 172.21.15.5:0/4006442709 conn(0x7fdb740c17c0 msgr2=0x7fdb740a4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 shutdown_connections 2024-05-16T21:33:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:36.936+0000 7fdb78a84640 1 -- 172.21.15.5:0/4006442709 wait complete. 2024-05-16T21:33:36.949 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-05-16T21:33:36.380958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254384,"kb_used_data":4896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720336,"statfs":{"total":773094113280,"available":772833624064,"internally_reserved":0,"allocated":5013504,"data_stored":2682756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.528637"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.882094+0000","last_change":"2024-05-16T21:33:32.874450+0000","last_active":"2024-05-16T21:33:33.882094+0000","last_peered":"2024-05-16T21:33:33.882094+0000","last_clean":"2024-05-16T21:33:33.882094+0000","last_became_active":"2024-05-16T21:33:32.874157+0000","last_became_peered":"2024-05-16T21:33:32.874157+0000","last_unstale":"2024-05-16T21:33:33.882094+0000","last_undegraded":"2024-05-16T21:33:33.882094+0000","last_fullsized":"2024-05-16T21:33:33.882094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:41:21.820435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881695+0000","last_change":"2024-05-16T21:33:32.883288+0000","last_active":"2024-05-16T21:33:33.881695+0000","last_peered":"2024-05-16T21:33:33.881695+0000","last_clean":"2024-05-16T21:33:33.881695+0000","last_became_active":"2024-05-16T21:33:32.882959+0000","last_became_peered":"2024-05-16T21:33:32.882959+0000","last_unstale":"2024-05-16T21:33:33.881695+0000","last_undegraded":"2024-05-16T21:33:33.881695+0000","last_fullsized":"2024-05-16T21:33:33.881695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:23:00.840173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898859+0000","last_change":"2024-05-16T21:33:32.882357+0000","last_active":"2024-05-16T21:33:33.898859+0000","last_peered":"2024-05-16T21:33:33.898859+0000","last_clean":"2024-05-16T21:33:33.898859+0000","last_became_active":"2024-05-16T21:33:32.881939+0000","last_became_peered":"2024-05-16T21:33:32.881939+0000","last_unstale":"2024-05-16T21:33:33.898859+0000","last_undegraded":"2024-05-16T21:33:33.898859+0000","last_fullsized":"2024-05-16T21:33:33.898859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:42:11.877138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304548+0000","last_change":"2024-05-16T21:33:32.891006+0000","last_active":"2024-05-16T21:33:34.304548+0000","last_peered":"2024-05-16T21:33:34.304548+0000","last_clean":"2024-05-16T21:33:34.304548+0000","last_became_active":"2024-05-16T21:33:32.890648+0000","last_became_peered":"2024-05-16T21:33:32.890648+0000","last_unstale":"2024-05-16T21:33:34.304548+0000","last_undegraded":"2024-05-16T21:33:34.304548+0000","last_fullsized":"2024-05-16T21:33:34.304548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:05:31.733731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880992+0000","last_change":"2024-05-16T21:33:32.883325+0000","last_active":"2024-05-16T21:33:33.880992+0000","last_peered":"2024-05-16T21:33:33.880992+0000","last_clean":"2024-05-16T21:33:33.880992+0000","last_became_active":"2024-05-16T21:33:32.882992+0000","last_became_peered":"2024-05-16T21:33:32.882992+0000","last_unstale":"2024-05-16T21:33:33.880992+0000","last_undegraded":"2024-05-16T21:33:33.880992+0000","last_fullsized":"2024-05-16T21:33:33.880992+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:20:43.978009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896488+0000","last_change":"2024-05-16T21:33:32.887003+0000","last_active":"2024-05-16T21:33:33.896488+0000","last_peered":"2024-05-16T21:33:33.896488+0000","last_clean":"2024-05-16T21:33:33.896488+0000","last_became_active":"2024-05-16T21:33:32.886265+0000","last_became_peered":"2024-05-16T21:33:32.886265+0000","last_unstale":"2024-05-16T21:33:33.896488+0000","last_undegraded":"2024-05-16T21:33:33.896488+0000","last_fullsized":"2024-05-16T21:33:33.896488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:28:26.193644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880796+0000","last_change":"2024-05-16T21:33:32.879834+0000","last_active":"2024-05-16T21:33:33.880796+0000","last_peered":"2024-05-16T21:33:33.880796+0000","last_clean":"2024-05-16T21:33:33.880796+0000","last_became_active":"2024-05-16T21:33:32.879346+0000","last_became_peered":"2024-05-16T21:33:32.879346+0000","last_unstale":"2024-05-16T21:33:33.880796+0000","last_undegraded":"2024-05-16T21:33:33.880796+0000","last_fullsized":"2024-05-16T21:33:33.880796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:25:28.050094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303924+0000","last_change":"2024-05-16T21:33:32.890280+0000","last_active":"2024-05-16T21:33:34.303924+0000","last_peered":"2024-05-16T21:33:34.303924+0000","last_clean":"2024-05-16T21:33:34.303924+0000","last_became_active":"2024-05-16T21:33:32.889951+0000","last_became_peered":"2024-05-16T21:33:32.889951+0000","last_unstale":"2024-05-16T21:33:34.303924+0000","last_undegraded":"2024-05-16T21:33:34.303924+0000","last_fullsized":"2024-05-16T21:33:34.303924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:21.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304487+0000","last_change":"2024-05-16T21:33:32.876524+0000","last_active":"2024-05-16T21:33:34.304487+0000","last_peered":"2024-05-16T21:33:34.304487+0000","last_clean":"2024-05-16T21:33:34.304487+0000","last_became_active":"2024-05-16T21:33:32.876153+0000","last_became_peered":"2024-05-16T21:33:32.876153+0000","last_unstale":"2024-05-16T21:33:34.304487+0000","last_undegraded":"2024-05-16T21:33:34.304487+0000","last_fullsized":"2024-05-16T21:33:34.304487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:28.368999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304973+0000","last_change":"2024-05-16T21:33:32.890829+0000","last_active":"2024-05-16T21:33:34.304973+0000","last_peered":"2024-05-16T21:33:34.304973+0000","last_clean":"2024-05-16T21:33:34.304973+0000","last_became_active":"2024-05-16T21:33:32.889897+0000","last_became_peered":"2024-05-16T21:33:32.889897+0000","last_unstale":"2024-05-16T21:33:34.304973+0000","last_undegraded":"2024-05-16T21:33:34.304973+0000","last_fullsized":"2024-05-16T21:33:34.304973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:25:28.050094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304447+0000","last_change":"2024-05-16T21:33:32.878061+0000","last_active":"2024-05-16T21:33:34.304447+0000","last_peered":"2024-05-16T21:33:34.304447+0000","last_clean":"2024-05-16T21:33:34.304447+0000","last_became_active":"2024-05-16T21:33:32.877723+0000","last_became_peered":"2024-05-16T21:33:32.877723+0000","last_unstale":"2024-05-16T21:33:34.304447+0000","last_undegraded":"2024-05-16T21:33:34.304447+0000","last_fullsized":"2024-05-16T21:33:34.304447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:03:30.530147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880963+0000","last_change":"2024-05-16T21:33:32.884260+0000","last_active":"2024-05-16T21:33:33.880963+0000","last_peered":"2024-05-16T21:33:33.880963+0000","last_clean":"2024-05-16T21:33:33.880963+0000","last_became_active":"2024-05-16T21:33:32.883917+0000","last_became_peered":"2024-05-16T21:33:32.883917+0000","last_unstale":"2024-05-16T21:33:33.880963+0000","last_undegraded":"2024-05-16T21:33:33.880963+0000","last_fullsized":"2024-05-16T21:33:33.880963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:05:31.733731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304784+0000","last_change":"2024-05-16T21:33:32.889040+0000","last_active":"2024-05-16T21:33:34.304784+0000","last_peered":"2024-05-16T21:33:34.304784+0000","last_clean":"2024-05-16T21:33:34.304784+0000","last_became_active":"2024-05-16T21:33:32.888717+0000","last_became_peered":"2024-05-16T21:33:32.888717+0000","last_unstale":"2024-05-16T21:33:34.304784+0000","last_undegraded":"2024-05-16T21:33:34.304784+0000","last_fullsized":"2024-05-16T21:33:34.304784+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:59.916487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304765+0000","last_change":"2024-05-16T21:33:32.875298+0000","last_active":"2024-05-16T21:33:34.304765+0000","last_peered":"2024-05-16T21:33:34.304765+0000","last_clean":"2024-05-16T21:33:34.304765+0000","last_became_active":"2024-05-16T21:33:32.874961+0000","last_became_peered":"2024-05-16T21:33:32.874961+0000","last_unstale":"2024-05-16T21:33:34.304765+0000","last_undegraded":"2024-05-16T21:33:34.304765+0000","last_fullsized":"2024-05-16T21:33:34.304765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:40:46.466193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896348+0000","last_change":"2024-05-16T21:33:32.886253+0000","last_active":"2024-05-16T21:33:33.896348+0000","last_peered":"2024-05-16T21:33:33.896348+0000","last_clean":"2024-05-16T21:33:33.896348+0000","last_became_active":"2024-05-16T21:33:32.885099+0000","last_became_peered":"2024-05-16T21:33:32.885099+0000","last_unstale":"2024-05-16T21:33:33.896348+0000","last_undegraded":"2024-05-16T21:33:33.896348+0000","last_fullsized":"2024-05-16T21:33:33.896348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:57:07.066325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303760+0000","last_change":"2024-05-16T21:33:32.889926+0000","last_active":"2024-05-16T21:33:34.303760+0000","last_peered":"2024-05-16T21:33:34.303760+0000","last_clean":"2024-05-16T21:33:34.303760+0000","last_became_active":"2024-05-16T21:33:32.889523+0000","last_became_peered":"2024-05-16T21:33:32.889523+0000","last_unstale":"2024-05-16T21:33:34.303760+0000","last_undegraded":"2024-05-16T21:33:34.303760+0000","last_fullsized":"2024-05-16T21:33:34.303760+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:54:57.175421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899062+0000","last_change":"2024-05-16T21:33:32.873518+0000","last_active":"2024-05-16T21:33:33.899062+0000","last_peered":"2024-05-16T21:33:33.899062+0000","last_clean":"2024-05-16T21:33:33.899062+0000","last_became_active":"2024-05-16T21:33:32.873177+0000","last_became_peered":"2024-05-16T21:33:32.873177+0000","last_unstale":"2024-05-16T21:33:33.899062+0000","last_undegraded":"2024-05-16T21:33:33.899062+0000","last_fullsized":"2024-05-16T21:33:33.899062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:53.371881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899131+0000","last_change":"2024-05-16T21:33:32.889675+0000","last_active":"2024-05-16T21:33:33.899131+0000","last_peered":"2024-05-16T21:33:33.899131+0000","last_clean":"2024-05-16T21:33:33.899131+0000","last_became_active":"2024-05-16T21:33:32.889335+0000","last_became_peered":"2024-05-16T21:33:32.889335+0000","last_unstale":"2024-05-16T21:33:33.899131+0000","last_undegraded":"2024-05-16T21:33:33.899131+0000","last_fullsized":"2024-05-16T21:33:33.899131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:49.390033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304282+0000","last_change":"2024-05-16T21:33:32.878342+0000","last_active":"2024-05-16T21:33:34.304282+0000","last_peered":"2024-05-16T21:33:34.304282+0000","last_clean":"2024-05-16T21:33:34.304282+0000","last_became_active":"2024-05-16T21:33:32.877881+0000","last_became_peered":"2024-05-16T21:33:32.877881+0000","last_unstale":"2024-05-16T21:33:34.304282+0000","last_undegraded":"2024-05-16T21:33:34.304282+0000","last_fullsized":"2024-05-16T21:33:34.304282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:11.384815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304708+0000","last_change":"2024-05-16T21:33:32.882442+0000","last_active":"2024-05-16T21:33:34.304708+0000","last_peered":"2024-05-16T21:33:34.304708+0000","last_clean":"2024-05-16T21:33:34.304708+0000","last_became_active":"2024-05-16T21:33:32.880171+0000","last_became_peered":"2024-05-16T21:33:32.880171+0000","last_unstale":"2024-05-16T21:33:34.304708+0000","last_undegraded":"2024-05-16T21:33:34.304708+0000","last_fullsized":"2024-05-16T21:33:34.304708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:50:45.299794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896454+0000","last_change":"2024-05-16T21:33:32.885091+0000","last_active":"2024-05-16T21:33:33.896454+0000","last_peered":"2024-05-16T21:33:33.896454+0000","last_clean":"2024-05-16T21:33:33.896454+0000","last_became_active":"2024-05-16T21:33:32.884696+0000","last_became_peered":"2024-05-16T21:33:32.884696+0000","last_unstale":"2024-05-16T21:33:33.896454+0000","last_undegraded":"2024-05-16T21:33:33.896454+0000","last_fullsized":"2024-05-16T21:33:33.896454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:57:12.907639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304329+0000","last_change":"2024-05-16T21:33:32.890266+0000","last_active":"2024-05-16T21:33:34.304329+0000","last_peered":"2024-05-16T21:33:34.304329+0000","last_clean":"2024-05-16T21:33:34.304329+0000","last_became_active":"2024-05-16T21:33:32.889801+0000","last_became_peered":"2024-05-16T21:33:32.889801+0000","last_unstale":"2024-05-16T21:33:34.304329+0000","last_undegraded":"2024-05-16T21:33:34.304329+0000","last_fullsized":"2024-05-16T21:33:34.304329+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:56:56.377242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303927+0000","last_change":"2024-05-16T21:33:32.880797+0000","last_active":"2024-05-16T21:33:34.303927+0000","last_peered":"2024-05-16T21:33:34.303927+0000","last_clean":"2024-05-16T21:33:34.303927+0000","last_became_active":"2024-05-16T21:33:32.880259+0000","last_became_peered":"2024-05-16T21:33:32.880259+0000","last_unstale":"2024-05-16T21:33:34.303927+0000","last_undegraded":"2024-05-16T21:33:34.303927+0000","last_fullsized":"2024-05-16T21:33:34.303927+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:44:40.826278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303836+0000","last_change":"2024-05-16T21:33:32.879090+0000","last_active":"2024-05-16T21:33:34.303836+0000","last_peered":"2024-05-16T21:33:34.303836+0000","last_clean":"2024-05-16T21:33:34.303836+0000","last_became_active":"2024-05-16T21:33:32.878646+0000","last_became_peered":"2024-05-16T21:33:32.878646+0000","last_unstale":"2024-05-16T21:33:34.303836+0000","last_undegraded":"2024-05-16T21:33:34.303836+0000","last_fullsized":"2024-05-16T21:33:34.303836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:53:25.064910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304280+0000","last_change":"2024-05-16T21:33:32.887436+0000","last_active":"2024-05-16T21:33:34.304280+0000","last_peered":"2024-05-16T21:33:34.304280+0000","last_clean":"2024-05-16T21:33:34.304280+0000","last_became_active":"2024-05-16T21:33:32.887116+0000","last_became_peered":"2024-05-16T21:33:32.887116+0000","last_unstale":"2024-05-16T21:33:34.304280+0000","last_undegraded":"2024-05-16T21:33:34.304280+0000","last_fullsized":"2024-05-16T21:33:34.304280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:04:50.979272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304350+0000","last_change":"2024-05-16T21:33:32.889005+0000","last_active":"2024-05-16T21:33:34.304350+0000","last_peered":"2024-05-16T21:33:34.304350+0000","last_clean":"2024-05-16T21:33:34.304350+0000","last_became_active":"2024-05-16T21:33:32.888679+0000","last_became_peered":"2024-05-16T21:33:32.888679+0000","last_unstale":"2024-05-16T21:33:34.304350+0000","last_undegraded":"2024-05-16T21:33:34.304350+0000","last_fullsized":"2024-05-16T21:33:34.304350+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:14:09.010239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899049+0000","last_change":"2024-05-16T21:33:32.872953+0000","last_active":"2024-05-16T21:33:33.899049+0000","last_peered":"2024-05-16T21:33:33.899049+0000","last_clean":"2024-05-16T21:33:33.899049+0000","last_became_active":"2024-05-16T21:33:32.872631+0000","last_became_peered":"2024-05-16T21:33:32.872631+0000","last_unstale":"2024-05-16T21:33:33.899049+0000","last_undegraded":"2024-05-16T21:33:33.899049+0000","last_fullsized":"2024-05-16T21:33:33.899049+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:56:56.377242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881327+0000","last_change":"2024-05-16T21:33:32.884825+0000","last_active":"2024-05-16T21:33:33.881327+0000","last_peered":"2024-05-16T21:33:33.881327+0000","last_clean":"2024-05-16T21:33:33.881327+0000","last_became_active":"2024-05-16T21:33:32.884496+0000","last_became_peered":"2024-05-16T21:33:32.884496+0000","last_unstale":"2024-05-16T21:33:33.881327+0000","last_undegraded":"2024-05-16T21:33:33.881327+0000","last_fullsized":"2024-05-16T21:33:33.881327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:40:46.466193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303871+0000","last_change":"2024-05-16T21:33:32.875345+0000","last_active":"2024-05-16T21:33:34.303871+0000","last_peered":"2024-05-16T21:33:34.303871+0000","last_clean":"2024-05-16T21:33:34.303871+0000","last_became_active":"2024-05-16T21:33:32.875030+0000","last_became_peered":"2024-05-16T21:33:32.875030+0000","last_unstale":"2024-05-16T21:33:34.303871+0000","last_undegraded":"2024-05-16T21:33:34.303871+0000","last_fullsized":"2024-05-16T21:33:34.303871+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:36:15.829862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898825+0000","last_change":"2024-05-16T21:33:32.873320+0000","last_active":"2024-05-16T21:33:33.898825+0000","last_peered":"2024-05-16T21:33:33.898825+0000","last_clean":"2024-05-16T21:33:33.898825+0000","last_became_active":"2024-05-16T21:33:32.872372+0000","last_became_peered":"2024-05-16T21:33:32.872372+0000","last_unstale":"2024-05-16T21:33:33.898825+0000","last_undegraded":"2024-05-16T21:33:33.898825+0000","last_fullsized":"2024-05-16T21:33:33.898825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:55.605989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896439+0000","last_change":"2024-05-16T21:33:32.886016+0000","last_active":"2024-05-16T21:33:33.896439+0000","last_peered":"2024-05-16T21:33:33.896439+0000","last_clean":"2024-05-16T21:33:33.896439+0000","last_became_active":"2024-05-16T21:33:32.885507+0000","last_became_peered":"2024-05-16T21:33:32.885507+0000","last_unstale":"2024-05-16T21:33:33.896439+0000","last_undegraded":"2024-05-16T21:33:33.896439+0000","last_fullsized":"2024-05-16T21:33:33.896439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:32:52.755735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304207+0000","last_change":"2024-05-16T21:33:32.880770+0000","last_active":"2024-05-16T21:33:34.304207+0000","last_peered":"2024-05-16T21:33:34.304207+0000","last_clean":"2024-05-16T21:33:34.304207+0000","last_became_active":"2024-05-16T21:33:32.880454+0000","last_became_peered":"2024-05-16T21:33:32.880454+0000","last_unstale":"2024-05-16T21:33:34.304207+0000","last_undegraded":"2024-05-16T21:33:34.304207+0000","last_fullsized":"2024-05-16T21:33:34.304207+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:50:16.663853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.879932+0000","last_change":"2024-05-16T21:33:32.886405+0000","last_active":"2024-05-16T21:33:33.879932+0000","last_peered":"2024-05-16T21:33:33.879932+0000","last_clean":"2024-05-16T21:33:33.879932+0000","last_became_active":"2024-05-16T21:33:32.886064+0000","last_became_peered":"2024-05-16T21:33:32.886064+0000","last_unstale":"2024-05-16T21:33:33.879932+0000","last_undegraded":"2024-05-16T21:33:33.879932+0000","last_fullsized":"2024-05-16T21:33:33.879932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:34:21.861374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896859+0000","last_change":"2024-05-16T21:33:31.869058+0000","last_active":"2024-05-16T21:33:33.896859+0000","last_peered":"2024-05-16T21:33:33.896859+0000","last_clean":"2024-05-16T21:33:33.896859+0000","last_became_active":"2024-05-16T21:33:31.868567+0000","last_became_peered":"2024-05-16T21:33:31.868567+0000","last_unstale":"2024-05-16T21:33:33.896859+0000","last_undegraded":"2024-05-16T21:33:33.896859+0000","last_fullsized":"2024-05-16T21:33:33.896859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:27.363650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304293+0000","last_change":"2024-05-16T21:33:32.883463+0000","last_active":"2024-05-16T21:33:34.304293+0000","last_peered":"2024-05-16T21:33:34.304293+0000","last_clean":"2024-05-16T21:33:34.304293+0000","last_became_active":"2024-05-16T21:33:32.883134+0000","last_became_peered":"2024-05-16T21:33:32.883134+0000","last_unstale":"2024-05-16T21:33:34.304293+0000","last_undegraded":"2024-05-16T21:33:34.304293+0000","last_fullsized":"2024-05-16T21:33:34.304293+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:34:21.861374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899173+0000","last_change":"2024-05-16T21:33:31.872862+0000","last_active":"2024-05-16T21:33:33.899173+0000","last_peered":"2024-05-16T21:33:33.899173+0000","last_clean":"2024-05-16T21:33:33.899173+0000","last_became_active":"2024-05-16T21:33:31.872177+0000","last_became_peered":"2024-05-16T21:33:31.872177+0000","last_unstale":"2024-05-16T21:33:33.899173+0000","last_undegraded":"2024-05-16T21:33:33.899173+0000","last_fullsized":"2024-05-16T21:33:33.899173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:51:51.826886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881546+0000","last_change":"2024-05-16T21:33:32.892233+0000","last_active":"2024-05-16T21:33:33.881546+0000","last_peered":"2024-05-16T21:33:33.881546+0000","last_clean":"2024-05-16T21:33:33.881546+0000","last_became_active":"2024-05-16T21:33:32.891850+0000","last_became_peered":"2024-05-16T21:33:32.891850+0000","last_unstale":"2024-05-16T21:33:33.881546+0000","last_undegraded":"2024-05-16T21:33:33.881546+0000","last_fullsized":"2024-05-16T21:33:33.881546+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:25:28.050094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880137+0000","last_change":"2024-05-16T21:33:31.873183+0000","last_active":"2024-05-16T21:33:33.880137+0000","last_peered":"2024-05-16T21:33:33.880137+0000","last_clean":"2024-05-16T21:33:33.880137+0000","last_became_active":"2024-05-16T21:33:31.872235+0000","last_became_peered":"2024-05-16T21:33:31.872235+0000","last_unstale":"2024-05-16T21:33:33.880137+0000","last_undegraded":"2024-05-16T21:33:33.880137+0000","last_fullsized":"2024-05-16T21:33:33.880137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:52:24.982666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880200+0000","last_change":"2024-05-16T21:33:32.881300+0000","last_active":"2024-05-16T21:33:33.880200+0000","last_peered":"2024-05-16T21:33:33.880200+0000","last_clean":"2024-05-16T21:33:33.880200+0000","last_became_active":"2024-05-16T21:33:32.880825+0000","last_became_peered":"2024-05-16T21:33:32.880825+0000","last_unstale":"2024-05-16T21:33:33.880200+0000","last_undegraded":"2024-05-16T21:33:33.880200+0000","last_fullsized":"2024-05-16T21:33:33.880200+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:21.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881777+0000","last_change":"2024-05-16T21:33:31.879734+0000","last_active":"2024-05-16T21:33:33.881777+0000","last_peered":"2024-05-16T21:33:33.881777+0000","last_clean":"2024-05-16T21:33:33.881777+0000","last_became_active":"2024-05-16T21:33:31.879373+0000","last_became_peered":"2024-05-16T21:33:31.879373+0000","last_unstale":"2024-05-16T21:33:33.881777+0000","last_undegraded":"2024-05-16T21:33:33.881777+0000","last_fullsized":"2024-05-16T21:33:33.881777+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:20.728570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898828+0000","last_change":"2024-05-16T21:33:32.882138+0000","last_active":"2024-05-16T21:33:33.898828+0000","last_peered":"2024-05-16T21:33:33.898828+0000","last_clean":"2024-05-16T21:33:33.898828+0000","last_became_active":"2024-05-16T21:33:32.881708+0000","last_became_peered":"2024-05-16T21:33:32.881708+0000","last_unstale":"2024-05-16T21:33:33.898828+0000","last_undegraded":"2024-05-16T21:33:33.898828+0000","last_fullsized":"2024-05-16T21:33:33.898828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:21.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896722+0000","last_change":"2024-05-16T21:33:31.877999+0000","last_active":"2024-05-16T21:33:33.896722+0000","last_peered":"2024-05-16T21:33:33.896722+0000","last_clean":"2024-05-16T21:33:33.896722+0000","last_became_active":"2024-05-16T21:33:31.877481+0000","last_became_peered":"2024-05-16T21:33:31.877481+0000","last_unstale":"2024-05-16T21:33:33.896722+0000","last_undegraded":"2024-05-16T21:33:33.896722+0000","last_fullsized":"2024-05-16T21:33:33.896722+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:20:42.972660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304221+0000","last_change":"2024-05-16T21:33:32.883634+0000","last_active":"2024-05-16T21:33:34.304221+0000","last_peered":"2024-05-16T21:33:34.304221+0000","last_clean":"2024-05-16T21:33:34.304221+0000","last_became_active":"2024-05-16T21:33:32.883298+0000","last_became_peered":"2024-05-16T21:33:32.883298+0000","last_unstale":"2024-05-16T21:33:34.304221+0000","last_undegraded":"2024-05-16T21:33:34.304221+0000","last_fullsized":"2024-05-16T21:33:34.304221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:53.371881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898938+0000","last_change":"2024-05-16T21:33:31.876983+0000","last_active":"2024-05-16T21:33:33.898938+0000","last_peered":"2024-05-16T21:33:33.898938+0000","last_clean":"2024-05-16T21:33:33.898938+0000","last_became_active":"2024-05-16T21:33:31.876044+0000","last_became_peered":"2024-05-16T21:33:31.876044+0000","last_unstale":"2024-05-16T21:33:33.898938+0000","last_undegraded":"2024-05-16T21:33:33.898938+0000","last_fullsized":"2024-05-16T21:33:33.898938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:34:35.638011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303998+0000","last_change":"2024-05-16T21:33:32.890107+0000","last_active":"2024-05-16T21:33:34.303998+0000","last_peered":"2024-05-16T21:33:34.303998+0000","last_clean":"2024-05-16T21:33:34.303998+0000","last_became_active":"2024-05-16T21:33:32.889781+0000","last_became_peered":"2024-05-16T21:33:32.889781+0000","last_unstale":"2024-05-16T21:33:34.303998+0000","last_undegraded":"2024-05-16T21:33:34.303998+0000","last_fullsized":"2024-05-16T21:33:34.303998+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:18:04.578132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880630+0000","last_change":"2024-05-16T21:33:31.871567+0000","last_active":"2024-05-16T21:33:33.880630+0000","last_peered":"2024-05-16T21:33:33.880630+0000","last_clean":"2024-05-16T21:33:33.880630+0000","last_became_active":"2024-05-16T21:33:31.870838+0000","last_became_peered":"2024-05-16T21:33:31.870838+0000","last_unstale":"2024-05-16T21:33:33.880630+0000","last_undegraded":"2024-05-16T21:33:33.880630+0000","last_fullsized":"2024-05-16T21:33:33.880630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.379466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303679+0000","last_change":"2024-05-16T21:33:32.882023+0000","last_active":"2024-05-16T21:33:34.303679+0000","last_peered":"2024-05-16T21:33:34.303679+0000","last_clean":"2024-05-16T21:33:34.303679+0000","last_became_active":"2024-05-16T21:33:32.880691+0000","last_became_peered":"2024-05-16T21:33:32.880691+0000","last_unstale":"2024-05-16T21:33:34.303679+0000","last_undegraded":"2024-05-16T21:33:34.303679+0000","last_fullsized":"2024-05-16T21:33:34.303679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:34:36.643360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304044+0000","last_change":"2024-05-16T21:33:31.880424+0000","last_active":"2024-05-16T21:33:34.304044+0000","last_peered":"2024-05-16T21:33:34.304044+0000","last_clean":"2024-05-16T21:33:34.304044+0000","last_became_active":"2024-05-16T21:33:31.879864+0000","last_became_peered":"2024-05-16T21:33:31.879864+0000","last_unstale":"2024-05-16T21:33:34.304044+0000","last_undegraded":"2024-05-16T21:33:34.304044+0000","last_fullsized":"2024-05-16T21:33:34.304044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:42:35.253243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899030+0000","last_change":"2024-05-16T21:33:32.881605+0000","last_active":"2024-05-16T21:33:33.899030+0000","last_peered":"2024-05-16T21:33:33.899030+0000","last_clean":"2024-05-16T21:33:33.899030+0000","last_became_active":"2024-05-16T21:33:32.881201+0000","last_became_peered":"2024-05-16T21:33:32.881201+0000","last_unstale":"2024-05-16T21:33:33.899030+0000","last_undegraded":"2024-05-16T21:33:33.899030+0000","last_fullsized":"2024-05-16T21:33:33.899030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:18:04.578132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899071+0000","last_change":"2024-05-16T21:33:31.876589+0000","last_active":"2024-05-16T21:33:33.899071+0000","last_peered":"2024-05-16T21:33:33.899071+0000","last_clean":"2024-05-16T21:33:33.899071+0000","last_became_active":"2024-05-16T21:33:31.876244+0000","last_became_peered":"2024-05-16T21:33:31.876244+0000","last_unstale":"2024-05-16T21:33:33.899071+0000","last_undegraded":"2024-05-16T21:33:33.899071+0000","last_fullsized":"2024-05-16T21:33:33.899071+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:18.465547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.882275+0000","last_change":"2024-05-16T21:33:32.873325+0000","last_active":"2024-05-16T21:33:33.882275+0000","last_peered":"2024-05-16T21:33:33.882275+0000","last_clean":"2024-05-16T21:33:33.882275+0000","last_became_active":"2024-05-16T21:33:32.872876+0000","last_became_peered":"2024-05-16T21:33:32.872876+0000","last_unstale":"2024-05-16T21:33:33.882275+0000","last_undegraded":"2024-05-16T21:33:33.882275+0000","last_fullsized":"2024-05-16T21:33:33.882275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:02:14.691919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.305051+0000","last_change":"2024-05-16T21:33:31.882172+0000","last_active":"2024-05-16T21:33:34.305051+0000","last_peered":"2024-05-16T21:33:34.305051+0000","last_clean":"2024-05-16T21:33:34.305051+0000","last_became_active":"2024-05-16T21:33:31.881868+0000","last_became_peered":"2024-05-16T21:33:31.881868+0000","last_unstale":"2024-05-16T21:33:34.305051+0000","last_undegraded":"2024-05-16T21:33:34.305051+0000","last_fullsized":"2024-05-16T21:33:34.305051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:51:51.826886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896725+0000","last_change":"2024-05-16T21:33:32.887206+0000","last_active":"2024-05-16T21:33:33.896725+0000","last_peered":"2024-05-16T21:33:33.896725+0000","last_clean":"2024-05-16T21:33:33.896725+0000","last_became_active":"2024-05-16T21:33:32.886706+0000","last_became_peered":"2024-05-16T21:33:32.886706+0000","last_unstale":"2024-05-16T21:33:33.896725+0000","last_undegraded":"2024-05-16T21:33:33.896725+0000","last_fullsized":"2024-05-16T21:33:33.896725+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:31:22.170564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.882084+0000","last_change":"2024-05-16T21:33:31.881075+0000","last_active":"2024-05-16T21:33:33.882084+0000","last_peered":"2024-05-16T21:33:33.882084+0000","last_clean":"2024-05-16T21:33:33.882084+0000","last_became_active":"2024-05-16T21:33:31.879388+0000","last_became_peered":"2024-05-16T21:33:31.879388+0000","last_unstale":"2024-05-16T21:33:33.882084+0000","last_undegraded":"2024-05-16T21:33:33.882084+0000","last_fullsized":"2024-05-16T21:33:33.882084+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:18:03.572784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881958+0000","last_change":"2024-05-16T21:33:32.886213+0000","last_active":"2024-05-16T21:33:33.881958+0000","last_peered":"2024-05-16T21:33:33.881958+0000","last_clean":"2024-05-16T21:33:33.881958+0000","last_became_active":"2024-05-16T21:33:32.885904+0000","last_became_peered":"2024-05-16T21:33:32.885904+0000","last_unstale":"2024-05-16T21:33:33.881958+0000","last_undegraded":"2024-05-16T21:33:33.881958+0000","last_fullsized":"2024-05-16T21:33:33.881958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:43:31.689055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304899+0000","last_change":"2024-05-16T21:33:31.879584+0000","last_active":"2024-05-16T21:33:34.304899+0000","last_peered":"2024-05-16T21:33:34.304899+0000","last_clean":"2024-05-16T21:33:34.304899+0000","last_became_active":"2024-05-16T21:33:31.879224+0000","last_became_peered":"2024-05-16T21:33:31.879224+0000","last_unstale":"2024-05-16T21:33:34.304899+0000","last_undegraded":"2024-05-16T21:33:34.304899+0000","last_fullsized":"2024-05-16T21:33:34.304899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:44:28.213463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303934+0000","last_change":"2024-05-16T21:33:32.879098+0000","last_active":"2024-05-16T21:33:34.303934+0000","last_peered":"2024-05-16T21:33:34.303934+0000","last_clean":"2024-05-16T21:33:34.303934+0000","last_became_active":"2024-05-16T21:33:32.878713+0000","last_became_peered":"2024-05-16T21:33:32.878713+0000","last_unstale":"2024-05-16T21:33:34.303934+0000","last_undegraded":"2024-05-16T21:33:34.303934+0000","last_fullsized":"2024-05-16T21:33:34.303934+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:52:25.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896839+0000","last_change":"2024-05-16T21:33:31.877679+0000","last_active":"2024-05-16T21:33:33.896839+0000","last_peered":"2024-05-16T21:33:33.896839+0000","last_clean":"2024-05-16T21:33:33.896839+0000","last_became_active":"2024-05-16T21:33:31.877027+0000","last_became_peered":"2024-05-16T21:33:31.877027+0000","last_unstale":"2024-05-16T21:33:33.896839+0000","last_undegraded":"2024-05-16T21:33:33.896839+0000","last_fullsized":"2024-05-16T21:33:33.896839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:40:45.460844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304418+0000","last_change":"2024-05-16T21:33:32.881502+0000","last_active":"2024-05-16T21:33:34.304418+0000","last_peered":"2024-05-16T21:33:34.304418+0000","last_clean":"2024-05-16T21:33:34.304418+0000","last_became_active":"2024-05-16T21:33:32.877547+0000","last_became_peered":"2024-05-16T21:33:32.877547+0000","last_unstale":"2024-05-16T21:33:34.304418+0000","last_undegraded":"2024-05-16T21:33:34.304418+0000","last_fullsized":"2024-05-16T21:33:34.304418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:49.390033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881346+0000","last_change":"2024-05-16T21:33:31.880867+0000","last_active":"2024-05-16T21:33:33.881346+0000","last_peered":"2024-05-16T21:33:33.881346+0000","last_clean":"2024-05-16T21:33:33.881346+0000","last_became_active":"2024-05-16T21:33:31.879408+0000","last_became_peered":"2024-05-16T21:33:31.879408+0000","last_unstale":"2024-05-16T21:33:33.881346+0000","last_undegraded":"2024-05-16T21:33:33.881346+0000","last_fullsized":"2024-05-16T21:33:33.881346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:56:55.371893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896348+0000","last_change":"2024-05-16T21:33:32.880315+0000","last_active":"2024-05-16T21:33:33.896348+0000","last_peered":"2024-05-16T21:33:33.896348+0000","last_clean":"2024-05-16T21:33:33.896348+0000","last_became_active":"2024-05-16T21:33:32.879976+0000","last_became_peered":"2024-05-16T21:33:32.879976+0000","last_unstale":"2024-05-16T21:33:33.896348+0000","last_undegraded":"2024-05-16T21:33:33.896348+0000","last_fullsized":"2024-05-16T21:33:33.896348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:48.989694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896499+0000","last_change":"2024-05-16T21:33:31.878577+0000","last_active":"2024-05-16T21:33:33.896499+0000","last_peered":"2024-05-16T21:33:33.896499+0000","last_clean":"2024-05-16T21:33:33.896499+0000","last_became_active":"2024-05-16T21:33:31.876096+0000","last_became_peered":"2024-05-16T21:33:31.876096+0000","last_unstale":"2024-05-16T21:33:33.896499+0000","last_undegraded":"2024-05-16T21:33:33.896499+0000","last_fullsized":"2024-05-16T21:33:33.896499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:05:30.728382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880938+0000","last_change":"2024-05-16T21:33:32.881491+0000","last_active":"2024-05-16T21:33:33.880938+0000","last_peered":"2024-05-16T21:33:33.880938+0000","last_clean":"2024-05-16T21:33:33.880938+0000","last_became_active":"2024-05-16T21:33:32.881187+0000","last_became_peered":"2024-05-16T21:33:32.881187+0000","last_unstale":"2024-05-16T21:33:33.880938+0000","last_undegraded":"2024-05-16T21:33:33.880938+0000","last_fullsized":"2024-05-16T21:33:33.880938+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:23:00.840173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304144+0000","last_change":"2024-05-16T21:33:31.880658+0000","last_active":"2024-05-16T21:33:34.304144+0000","last_peered":"2024-05-16T21:33:34.304144+0000","last_clean":"2024-05-16T21:33:34.304144+0000","last_became_active":"2024-05-16T21:33:31.880322+0000","last_became_peered":"2024-05-16T21:33:31.880322+0000","last_unstale":"2024-05-16T21:33:34.304144+0000","last_undegraded":"2024-05-16T21:33:34.304144+0000","last_fullsized":"2024-05-16T21:33:34.304144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:36:16.069465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304538+0000","last_change":"2024-05-16T21:33:32.879619+0000","last_active":"2024-05-16T21:33:34.304538+0000","last_peered":"2024-05-16T21:33:34.304538+0000","last_clean":"2024-05-16T21:33:34.304538+0000","last_became_active":"2024-05-16T21:33:32.879281+0000","last_became_peered":"2024-05-16T21:33:32.879281+0000","last_unstale":"2024-05-16T21:33:34.304538+0000","last_undegraded":"2024-05-16T21:33:34.304538+0000","last_fullsized":"2024-05-16T21:33:34.304538+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:04:14.195670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304746+0000","last_change":"2024-05-16T21:33:31.877949+0000","last_active":"2024-05-16T21:33:34.304746+0000","last_peered":"2024-05-16T21:33:34.304746+0000","last_clean":"2024-05-16T21:33:34.304746+0000","last_became_active":"2024-05-16T21:33:31.877507+0000","last_became_peered":"2024-05-16T21:33:31.877507+0000","last_unstale":"2024-05-16T21:33:34.304746+0000","last_undegraded":"2024-05-16T21:33:34.304746+0000","last_fullsized":"2024-05-16T21:33:34.304746+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:55.837861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304681+0000","last_change":"2024-05-16T21:33:32.892527+0000","last_active":"2024-05-16T21:33:34.304681+0000","last_peered":"2024-05-16T21:33:34.304681+0000","last_clean":"2024-05-16T21:33:34.304681+0000","last_became_active":"2024-05-16T21:33:32.892060+0000","last_became_peered":"2024-05-16T21:33:32.892060+0000","last_unstale":"2024-05-16T21:33:34.304681+0000","last_undegraded":"2024-05-16T21:33:34.304681+0000","last_fullsized":"2024-05-16T21:33:34.304681+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:20:43.978009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899206+0000","last_change":"2024-05-16T21:33:31.872581+0000","last_active":"2024-05-16T21:33:33.899206+0000","last_peered":"2024-05-16T21:33:33.899206+0000","last_clean":"2024-05-16T21:33:33.899206+0000","last_became_active":"2024-05-16T21:33:31.871825+0000","last_became_peered":"2024-05-16T21:33:31.871825+0000","last_unstale":"2024-05-16T21:33:33.899206+0000","last_undegraded":"2024-05-16T21:33:33.899206+0000","last_fullsized":"2024-05-16T21:33:33.899206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:52:13.849468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304128+0000","last_change":"2024-05-16T21:33:32.887740+0000","last_active":"2024-05-16T21:33:34.304128+0000","last_peered":"2024-05-16T21:33:34.304128+0000","last_clean":"2024-05-16T21:33:34.304128+0000","last_became_active":"2024-05-16T21:33:32.887453+0000","last_became_peered":"2024-05-16T21:33:32.887453+0000","last_unstale":"2024-05-16T21:33:34.304128+0000","last_undegraded":"2024-05-16T21:33:34.304128+0000","last_fullsized":"2024-05-16T21:33:34.304128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:21:14.017935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881757+0000","last_change":"2024-05-16T21:33:31.877158+0000","last_active":"2024-05-16T21:33:33.881757+0000","last_peered":"2024-05-16T21:33:33.881757+0000","last_clean":"2024-05-16T21:33:33.881757+0000","last_became_active":"2024-05-16T21:33:31.876862+0000","last_became_peered":"2024-05-16T21:33:31.876862+0000","last_unstale":"2024-05-16T21:33:33.881757+0000","last_undegraded":"2024-05-16T21:33:33.881757+0000","last_fullsized":"2024-05-16T21:33:33.881757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:20.728570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304142+0000","last_change":"2024-05-16T21:33:32.884238+0000","last_active":"2024-05-16T21:33:34.304142+0000","last_peered":"2024-05-16T21:33:34.304142+0000","last_clean":"2024-05-16T21:33:34.304142+0000","last_became_active":"2024-05-16T21:33:32.883276+0000","last_became_peered":"2024-05-16T21:33:32.883276+0000","last_unstale":"2024-05-16T21:33:34.304142+0000","last_undegraded":"2024-05-16T21:33:34.304142+0000","last_fullsized":"2024-05-16T21:33:34.304142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:55:55.769898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896727+0000","last_change":"2024-05-16T21:33:31.870715+0000","last_active":"2024-05-16T21:33:33.896727+0000","last_peered":"2024-05-16T21:33:33.896727+0000","last_clean":"2024-05-16T21:33:33.896727+0000","last_became_active":"2024-05-16T21:33:31.870294+0000","last_became_peered":"2024-05-16T21:33:31.870294+0000","last_unstale":"2024-05-16T21:33:33.896727+0000","last_undegraded":"2024-05-16T21:33:33.896727+0000","last_fullsized":"2024-05-16T21:33:33.896727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:55.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896700+0000","last_change":"2024-05-16T21:33:32.886654+0000","last_active":"2024-05-16T21:33:33.896700+0000","last_peered":"2024-05-16T21:33:33.896700+0000","last_clean":"2024-05-16T21:33:33.896700+0000","last_became_active":"2024-05-16T21:33:32.884977+0000","last_became_peered":"2024-05-16T21:33:32.884977+0000","last_unstale":"2024-05-16T21:33:33.896700+0000","last_undegraded":"2024-05-16T21:33:33.896700+0000","last_fullsized":"2024-05-16T21:33:33.896700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:31:32.288578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896923+0000","last_change":"2024-05-16T21:33:31.877818+0000","last_active":"2024-05-16T21:33:33.896923+0000","last_peered":"2024-05-16T21:33:33.896923+0000","last_clean":"2024-05-16T21:33:33.896923+0000","last_became_active":"2024-05-16T21:33:31.877325+0000","last_became_peered":"2024-05-16T21:33:31.877325+0000","last_unstale":"2024-05-16T21:33:33.896923+0000","last_undegraded":"2024-05-16T21:33:33.896923+0000","last_fullsized":"2024-05-16T21:33:33.896923+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:25:27.044745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.879970+0000","last_change":"2024-05-16T21:33:32.873090+0000","last_active":"2024-05-16T21:33:33.879970+0000","last_peered":"2024-05-16T21:33:33.879970+0000","last_clean":"2024-05-16T21:33:33.879970+0000","last_became_active":"2024-05-16T21:33:32.872740+0000","last_became_peered":"2024-05-16T21:33:32.872740+0000","last_unstale":"2024-05-16T21:33:33.879970+0000","last_undegraded":"2024-05-16T21:33:33.879970+0000","last_fullsized":"2024-05-16T21:33:33.879970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:55.605989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880797+0000","last_change":"2024-05-16T21:33:31.876560+0000","last_active":"2024-05-16T21:33:33.880797+0000","last_peered":"2024-05-16T21:33:33.880797+0000","last_clean":"2024-05-16T21:33:33.880797+0000","last_became_active":"2024-05-16T21:33:31.875662+0000","last_became_peered":"2024-05-16T21:33:31.875662+0000","last_unstale":"2024-05-16T21:33:33.880797+0000","last_undegraded":"2024-05-16T21:33:33.880797+0000","last_fullsized":"2024-05-16T21:33:33.880797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:54.600640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304391+0000","last_change":"2024-05-16T21:33:32.879576+0000","last_active":"2024-05-16T21:33:34.304391+0000","last_peered":"2024-05-16T21:33:34.304391+0000","last_clean":"2024-05-16T21:33:34.304391+0000","last_became_active":"2024-05-16T21:33:32.879231+0000","last_became_peered":"2024-05-16T21:33:32.879231+0000","last_unstale":"2024-05-16T21:33:34.304391+0000","last_undegraded":"2024-05-16T21:33:34.304391+0000","last_fullsized":"2024-05-16T21:33:34.304391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:57:03.843689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303994+0000","last_change":"2024-05-16T21:33:31.876761+0000","last_active":"2024-05-16T21:33:34.303994+0000","last_peered":"2024-05-16T21:33:34.303994+0000","last_clean":"2024-05-16T21:33:34.303994+0000","last_became_active":"2024-05-16T21:33:31.875779+0000","last_became_peered":"2024-05-16T21:33:31.875779+0000","last_unstale":"2024-05-16T21:33:34.303994+0000","last_undegraded":"2024-05-16T21:33:34.303994+0000","last_fullsized":"2024-05-16T21:33:34.303994+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:38:14.918688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303987+0000","last_change":"2024-05-16T21:33:32.876602+0000","last_active":"2024-05-16T21:33:34.303987+0000","last_peered":"2024-05-16T21:33:34.303987+0000","last_clean":"2024-05-16T21:33:34.303987+0000","last_became_active":"2024-05-16T21:33:32.876230+0000","last_became_peered":"2024-05-16T21:33:32.876230+0000","last_unstale":"2024-05-16T21:33:34.303987+0000","last_undegraded":"2024-05-16T21:33:34.303987+0000","last_fullsized":"2024-05-16T21:33:34.303987+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:42:11.877138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880607+0000","last_change":"2024-05-16T21:33:31.880592+0000","last_active":"2024-05-16T21:33:33.880607+0000","last_peered":"2024-05-16T21:33:33.880607+0000","last_clean":"2024-05-16T21:33:33.880607+0000","last_became_active":"2024-05-16T21:33:31.879418+0000","last_became_peered":"2024-05-16T21:33:31.879418+0000","last_unstale":"2024-05-16T21:33:33.880607+0000","last_undegraded":"2024-05-16T21:33:33.880607+0000","last_fullsized":"2024-05-16T21:33:33.880607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:54.600640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304466+0000","last_change":"2024-05-16T21:33:32.889853+0000","last_active":"2024-05-16T21:33:34.304466+0000","last_peered":"2024-05-16T21:33:34.304466+0000","last_clean":"2024-05-16T21:33:34.304466+0000","last_became_active":"2024-05-16T21:33:32.889509+0000","last_became_peered":"2024-05-16T21:33:32.889509+0000","last_unstale":"2024-05-16T21:33:34.304466+0000","last_undegraded":"2024-05-16T21:33:34.304466+0000","last_fullsized":"2024-05-16T21:33:34.304466+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:55.605989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898214+0000","last_change":"2024-05-16T21:33:31.879138+0000","last_active":"2024-05-16T21:33:33.898214+0000","last_peered":"2024-05-16T21:33:33.898214+0000","last_clean":"2024-05-16T21:33:33.898214+0000","last_became_active":"2024-05-16T21:33:31.878467+0000","last_became_peered":"2024-05-16T21:33:31.878467+0000","last_unstale":"2024-05-16T21:33:33.898214+0000","last_undegraded":"2024-05-16T21:33:33.898214+0000","last_fullsized":"2024-05-16T21:33:33.898214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:22:59.834824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304709+0000","last_change":"2024-05-16T21:33:32.876609+0000","last_active":"2024-05-16T21:33:34.304709+0000","last_peered":"2024-05-16T21:33:34.304709+0000","last_clean":"2024-05-16T21:33:34.304709+0000","last_became_active":"2024-05-16T21:33:32.876208+0000","last_became_peered":"2024-05-16T21:33:32.876208+0000","last_unstale":"2024-05-16T21:33:34.304709+0000","last_undegraded":"2024-05-16T21:33:34.304709+0000","last_fullsized":"2024-05-16T21:33:34.304709+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:56.433513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.882081+0000","last_change":"2024-05-16T21:33:31.881385+0000","last_active":"2024-05-16T21:33:33.882081+0000","last_peered":"2024-05-16T21:33:33.882081+0000","last_clean":"2024-05-16T21:33:33.882081+0000","last_became_active":"2024-05-16T21:33:31.880839+0000","last_became_peered":"2024-05-16T21:33:31.880839+0000","last_unstale":"2024-05-16T21:33:33.882081+0000","last_undegraded":"2024-05-16T21:33:33.882081+0000","last_fullsized":"2024-05-16T21:33:33.882081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:52.366532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881964+0000","last_change":"2024-05-16T21:33:32.881418+0000","last_active":"2024-05-16T21:33:33.881964+0000","last_peered":"2024-05-16T21:33:33.881964+0000","last_clean":"2024-05-16T21:33:33.881964+0000","last_became_active":"2024-05-16T21:33:32.880375+0000","last_became_peered":"2024-05-16T21:33:32.880375+0000","last_unstale":"2024-05-16T21:33:33.881964+0000","last_undegraded":"2024-05-16T21:33:33.881964+0000","last_fullsized":"2024-05-16T21:33:33.881964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:17:32.098362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.879901+0000","last_change":"2024-05-16T21:33:31.872634+0000","last_active":"2024-05-16T21:33:33.879901+0000","last_peered":"2024-05-16T21:33:33.879901+0000","last_clean":"2024-05-16T21:33:33.879901+0000","last_became_active":"2024-05-16T21:33:31.872148+0000","last_became_peered":"2024-05-16T21:33:31.872148+0000","last_unstale":"2024-05-16T21:33:33.879901+0000","last_undegraded":"2024-05-16T21:33:33.879901+0000","last_fullsized":"2024-05-16T21:33:33.879901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:44:39.820929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896711+0000","last_change":"2024-05-16T21:33:32.885941+0000","last_active":"2024-05-16T21:33:33.896711+0000","last_peered":"2024-05-16T21:33:33.896711+0000","last_clean":"2024-05-16T21:33:33.896711+0000","last_became_active":"2024-05-16T21:33:32.884608+0000","last_became_peered":"2024-05-16T21:33:32.884608+0000","last_unstale":"2024-05-16T21:33:33.896711+0000","last_undegraded":"2024-05-16T21:33:33.896711+0000","last_fullsized":"2024-05-16T21:33:33.896711+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:04:49.947660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881669+0000","last_change":"2024-05-16T21:33:31.881262+0000","last_active":"2024-05-16T21:33:33.881669+0000","last_peered":"2024-05-16T21:33:33.881669+0000","last_clean":"2024-05-16T21:33:33.881669+0000","last_became_active":"2024-05-16T21:33:31.880947+0000","last_became_peered":"2024-05-16T21:33:31.880947+0000","last_unstale":"2024-05-16T21:33:33.881669+0000","last_undegraded":"2024-05-16T21:33:33.881669+0000","last_fullsized":"2024-05-16T21:33:33.881669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:42:10.871789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896702+0000","last_change":"2024-05-16T21:33:32.883549+0000","last_active":"2024-05-16T21:33:33.896702+0000","last_peered":"2024-05-16T21:33:33.896702+0000","last_clean":"2024-05-16T21:33:33.896702+0000","last_became_active":"2024-05-16T21:33:32.883198+0000","last_became_peered":"2024-05-16T21:33:32.883198+0000","last_unstale":"2024-05-16T21:33:33.896702+0000","last_undegraded":"2024-05-16T21:33:33.896702+0000","last_fullsized":"2024-05-16T21:33:33.896702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:58:02.917081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898980+0000","last_change":"2024-05-16T21:33:31.879474+0000","last_active":"2024-05-16T21:33:33.898980+0000","last_peered":"2024-05-16T21:33:33.898980+0000","last_clean":"2024-05-16T21:33:33.898980+0000","last_became_active":"2024-05-16T21:33:31.879088+0000","last_became_peered":"2024-05-16T21:33:31.879088+0000","last_unstale":"2024-05-16T21:33:33.898980+0000","last_undegraded":"2024-05-16T21:33:33.898980+0000","last_fullsized":"2024-05-16T21:33:33.898980+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:54:56.170072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881141+0000","last_change":"2024-05-16T21:33:32.876257+0000","last_active":"2024-05-16T21:33:33.881141+0000","last_peered":"2024-05-16T21:33:33.881141+0000","last_clean":"2024-05-16T21:33:33.881141+0000","last_became_active":"2024-05-16T21:33:32.875954+0000","last_became_peered":"2024-05-16T21:33:32.875954+0000","last_unstale":"2024-05-16T21:33:33.881141+0000","last_undegraded":"2024-05-16T21:33:33.881141+0000","last_fullsized":"2024-05-16T21:33:33.881141+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:56.433513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.879754+0000","last_change":"2024-05-16T21:33:31.871490+0000","last_active":"2024-05-16T21:33:33.879754+0000","last_peered":"2024-05-16T21:33:33.879754+0000","last_clean":"2024-05-16T21:33:33.879754+0000","last_became_active":"2024-05-16T21:33:31.871051+0000","last_became_peered":"2024-05-16T21:33:31.871051+0000","last_unstale":"2024-05-16T21:33:33.879754+0000","last_undegraded":"2024-05-16T21:33:33.879754+0000","last_fullsized":"2024-05-16T21:33:33.879754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:36:14.824513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898772+0000","last_change":"2024-05-16T21:33:32.891847+0000","last_active":"2024-05-16T21:33:33.898772+0000","last_peered":"2024-05-16T21:33:33.898772+0000","last_clean":"2024-05-16T21:33:33.898772+0000","last_became_active":"2024-05-16T21:33:32.891425+0000","last_became_peered":"2024-05-16T21:33:32.891425+0000","last_unstale":"2024-05-16T21:33:33.898772+0000","last_undegraded":"2024-05-16T21:33:33.898772+0000","last_fullsized":"2024-05-16T21:33:33.898772+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:34:21.861374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304181+0000","last_change":"2024-05-16T21:33:31.875526+0000","last_active":"2024-05-16T21:33:34.304181+0000","last_peered":"2024-05-16T21:33:34.304181+0000","last_clean":"2024-05-16T21:33:34.304181+0000","last_became_active":"2024-05-16T21:33:31.875184+0000","last_became_peered":"2024-05-16T21:33:31.875184+0000","last_unstale":"2024-05-16T21:33:34.304181+0000","last_undegraded":"2024-05-16T21:33:34.304181+0000","last_fullsized":"2024-05-16T21:33:34.304181+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:25:34.894892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.305079+0000","last_change":"2024-05-16T21:33:32.879417+0000","last_active":"2024-05-16T21:33:34.305079+0000","last_peered":"2024-05-16T21:33:34.305079+0000","last_clean":"2024-05-16T21:33:34.305079+0000","last_became_active":"2024-05-16T21:33:32.877892+0000","last_became_peered":"2024-05-16T21:33:32.877892+0000","last_unstale":"2024-05-16T21:33:34.305079+0000","last_undegraded":"2024-05-16T21:33:34.305079+0000","last_fullsized":"2024-05-16T21:33:34.305079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:23:00.840173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881743+0000","last_change":"2024-05-16T21:33:31.872970+0000","last_active":"2024-05-16T21:33:33.881743+0000","last_peered":"2024-05-16T21:33:33.881743+0000","last_clean":"2024-05-16T21:33:33.881743+0000","last_became_active":"2024-05-16T21:33:31.872659+0000","last_became_peered":"2024-05-16T21:33:31.872659+0000","last_unstale":"2024-05-16T21:33:33.881743+0000","last_undegraded":"2024-05-16T21:33:33.881743+0000","last_fullsized":"2024-05-16T21:33:33.881743+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:34:20.856025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":148,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881013+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T21:33:33.881013+0000","last_peered":"2024-05-16T21:33:33.881013+0000","last_clean":"2024-05-16T21:33:33.881013+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T21:33:33.881013+0000","last_undegraded":"2024-05-16T21:33:33.881013+0000","last_fullsized":"2024-05-16T21:33:33.881013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":782333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":475136,"data_stored":186247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":185645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":479232,"data_stored":187187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":479232,"data_stored":186213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":495616,"data_stored":193509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":185645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1064960,"data_stored":775977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T21:33:36.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T21:33:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.099+0000 7fa4c66af640 1 Processor -- start 2024-05-16T21:33:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.099+0000 7fa4c66af640 1 -- start start 2024-05-16T21:33:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.100+0000 7fa4c66af640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c0151fc0 0x7fa4c00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.100+0000 7fa4c66af640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c00c36f0 con 0x7fa4c00bf050 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.100+0000 7fa4c66af640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c0152530 con 0x7fa4c006da30 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.100+0000 7fa4c66af640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c00bdc10 con 0x7fa4c0151fc0 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.100+0000 7fa4c4c4c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa4c00bf050 0x7fa4c0158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44222/0 (socket says 172.21.15.5:44222) 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.100+0000 7fa4c4c4c640 1 -- 172.21.15.5:0/129722953 learned_addr learned my addr 172.21.15.5:0/129722953 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.100+0000 7fa4bffff640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c0151fc0 0x7fa4c00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.100+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531118105 0 0) 0x7fa4c00c36f0 con 0x7fa4c00bf050 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4ac003520 con 0x7fa4c00bf050 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956199235 0 0) 0x7fa4c0152530 con 0x7fa4c006da30 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c00c36f0 con 0x7fa4c006da30 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1554925529 0 0) 0x7fa4ac003520 con 0x7fa4c00bf050 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c0151fc0 msgr2=0x7fa4c00bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c0151fc0 0x7fa4c00bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 >> v1:172.21.15.157:6789/0 conn(0x7fa4c006da30 legacy=0x7fa4c00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c0152810 con 0x7fa4c00bf050 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fa4b8001a70 con 0x7fa4c00bf050 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 >> v1:172.21.15.5:6789/0 conn(0x7fa4c00bf050 legacy=0x7fa4c0158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c0151fc0 0x7fa4ac003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4ac004d90 0x7fa4ac005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c00bdc10 con 0x7fa4ac0041c0 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac00bcc0 con 0x7fa4ac004d90 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ac00bec0 con 0x7fa4c0151fc0 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4bf7fe640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4bffff640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c0151fc0 0x7fa4ac003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4c4c4c640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4ac004d90 0x7fa4ac005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4bf7fe640 1 -- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c0151fc0 msgr2=0x7fa4ac003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4bf7fe640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c0151fc0 0x7fa4ac003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4bf7fe640 1 -- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4ac004d90 msgr2=0x7fa4ac005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4bf7fe640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4ac004d90 0x7fa4ac005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4bf7fe640 1 -- 172.21.15.5:0/129722953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac003520 con 0x7fa4ac0041c0 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.101+0000 7fa4c4c4c640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4ac004d90 0x7fa4ac005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.102+0000 7fa4bf7fe640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4ac004800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8001900 tx=0x7fa4ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea791385bc00b7bc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.102+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8001520 con 0x7fa4ac0041c0 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.102+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a802acd0 con 0x7fa4ac0041c0 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.102+0000 7fa4beffd640 1 -- 172.21.15.5:0/129722953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8005310 con 0x7fa4ac0041c0 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.103+0000 7fa4c66af640 1 -- 172.21.15.5:0/129722953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 msgr2=0x7fa4ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.103+0000 7fa4c66af640 1 --2- 172.21.15.5:0/129722953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4ac004800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8001900 tx=0x7fa4ac005830 comp rx=0 tx=0).stop 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.103+0000 7fa4c4c4c640 1 -- 172.21.15.5:0/129722953 reap_dead start 2024-05-16T21:33:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.103+0000 7fa4c66af640 1 -- 172.21.15.5:0/129722953 shutdown_connections 2024-05-16T21:33:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.103+0000 7fa4c66af640 1 -- 172.21.15.5:0/129722953 >> 172.21.15.5:0/129722953 conn(0x7fa4c00c3d20 msgr2=0x7fa4c00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.103+0000 7fa4c66af640 1 -- 172.21.15.5:0/129722953 shutdown_connections 2024-05-16T21:33:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.103+0000 7fa4c66af640 1 -- 172.21.15.5:0/129722953 wait complete. 2024-05-16T21:33:37.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.104+0000 7fa4c66af640 1 Processor -- start 2024-05-16T21:33:37.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.105+0000 7fa4c66af640 1 -- start start 2024-05-16T21:33:37.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4c66af640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4c00b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4c66af640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4c00b9720 0x7fa4c00a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4c66af640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c00a2440 0x7fa4c01e4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4c66af640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c00a3050 con 0x7fa4ac0041c0 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4c66af640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c00a2ed0 con 0x7fa4c00b9720 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4c66af640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c006de40 con 0x7fa4c00a2440 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4c00b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4c00b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46426/0 (socket says 172.21.15.5:46426) 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 -- 172.21.15.5:0/3229500872 learned_addr learned my addr 172.21.15.5:0/3229500872 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bf7fe640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4c00b9720 0x7fa4c00a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4c4c4c640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c00a2440 0x7fa4c01e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 -- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c00a2440 msgr2=0x7fa4c01e4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c00a2440 0x7fa4c01e4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 -- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4c00b9720 msgr2=0x7fa4c00a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4c00b9720 0x7fa4c00a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 -- 172.21.15.5:0/3229500872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c00b8cf0 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bffff640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4c00b87b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00119a0 tx=0x7fa4b0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bcff9640 1 -- 172.21.15.5:0/3229500872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000faf0 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bcff9640 1 -- 172.21.15.5:0/3229500872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b000fc90 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c014dff0 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.106+0000 7fa4bcff9640 1 -- 172.21.15.5:0/3229500872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0014440 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.107+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c00b74d0 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.108+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c0050940 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.108+0000 7fa4bcff9640 1 -- 172.21.15.5:0/3229500872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa4b0012040 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.108+0000 7fa4bcff9640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa4a00762d0 0x7fa4a00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.109+0000 7fa4bcff9640 1 -- 172.21.15.5:0/3229500872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fa4b0097cd0 con 0x7fa4ac0041c0 2024-05-16T21:33:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.109+0000 7fa4bf7fe640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa4a00762d0 0x7fa4a00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.109+0000 7fa4bf7fe640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa4a00762d0 0x7fa4a00787e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8031000 tx=0x7fa4a802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.113+0000 7fa4bcff9640 1 -- 172.21.15.5:0/3229500872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa4b0019030 con 0x7fa4ac0041c0 2024-05-16T21:33:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.299+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4c006eb40 con 0x7fa4a00762d0 2024-05-16T21:33:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.305+0000 7fa4bcff9640 1 -- 172.21.15.5:0/3229500872 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7fa4c006eb40 con 0x7fa4a00762d0 2024-05-16T21:33:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T21:33:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa4a00762d0 msgr2=0x7fa4a00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa4a00762d0 0x7fa4a00787e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8031000 tx=0x7fa4a802e000 comp rx=0 tx=0).stop 2024-05-16T21:33:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 msgr2=0x7fa4c00b87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4c00b87b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00119a0 tx=0x7fa4b0011e60 comp rx=0 tx=0).stop 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 shutdown_connections 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa4a00762d0 0x7fa4a00787e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4c00a2440 0x7fa4c01e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4c00b9720 0x7fa4c00a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 --2- 172.21.15.5:0/3229500872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0041c0 0x7fa4c00b87b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 >> 172.21.15.5:0/3229500872 conn(0x7fa4c00c3d20 msgr2=0x7fa4c00c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 shutdown_connections 2024-05-16T21:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.308+0000 7fa4c66af640 1 -- 172.21.15.5:0/3229500872 wait complete. 2024-05-16T21:33:37.321 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-05-16T21:33:36.380958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254384,"kb_used_data":4896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720336,"statfs":{"total":773094113280,"available":772833624064,"internally_reserved":0,"allocated":5013504,"data_stored":2682756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.528637"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.882094+0000","last_change":"2024-05-16T21:33:32.874450+0000","last_active":"2024-05-16T21:33:33.882094+0000","last_peered":"2024-05-16T21:33:33.882094+0000","last_clean":"2024-05-16T21:33:33.882094+0000","last_became_active":"2024-05-16T21:33:32.874157+0000","last_became_peered":"2024-05-16T21:33:32.874157+0000","last_unstale":"2024-05-16T21:33:33.882094+0000","last_undegraded":"2024-05-16T21:33:33.882094+0000","last_fullsized":"2024-05-16T21:33:33.882094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:41:21.820435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881695+0000","last_change":"2024-05-16T21:33:32.883288+0000","last_active":"2024-05-16T21:33:33.881695+0000","last_peered":"2024-05-16T21:33:33.881695+0000","last_clean":"2024-05-16T21:33:33.881695+0000","last_became_active":"2024-05-16T21:33:32.882959+0000","last_became_peered":"2024-05-16T21:33:32.882959+0000","last_unstale":"2024-05-16T21:33:33.881695+0000","last_undegraded":"2024-05-16T21:33:33.881695+0000","last_fullsized":"2024-05-16T21:33:33.881695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:23:00.840173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898859+0000","last_change":"2024-05-16T21:33:32.882357+0000","last_active":"2024-05-16T21:33:33.898859+0000","last_peered":"2024-05-16T21:33:33.898859+0000","last_clean":"2024-05-16T21:33:33.898859+0000","last_became_active":"2024-05-16T21:33:32.881939+0000","last_became_peered":"2024-05-16T21:33:32.881939+0000","last_unstale":"2024-05-16T21:33:33.898859+0000","last_undegraded":"2024-05-16T21:33:33.898859+0000","last_fullsized":"2024-05-16T21:33:33.898859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:42:11.877138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304548+0000","last_change":"2024-05-16T21:33:32.891006+0000","last_active":"2024-05-16T21:33:34.304548+0000","last_peered":"2024-05-16T21:33:34.304548+0000","last_clean":"2024-05-16T21:33:34.304548+0000","last_became_active":"2024-05-16T21:33:32.890648+0000","last_became_peered":"2024-05-16T21:33:32.890648+0000","last_unstale":"2024-05-16T21:33:34.304548+0000","last_undegraded":"2024-05-16T21:33:34.304548+0000","last_fullsized":"2024-05-16T21:33:34.304548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:05:31.733731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880992+0000","last_change":"2024-05-16T21:33:32.883325+0000","last_active":"2024-05-16T21:33:33.880992+0000","last_peered":"2024-05-16T21:33:33.880992+0000","last_clean":"2024-05-16T21:33:33.880992+0000","last_became_active":"2024-05-16T21:33:32.882992+0000","last_became_peered":"2024-05-16T21:33:32.882992+0000","last_unstale":"2024-05-16T21:33:33.880992+0000","last_undegraded":"2024-05-16T21:33:33.880992+0000","last_fullsized":"2024-05-16T21:33:33.880992+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:20:43.978009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896488+0000","last_change":"2024-05-16T21:33:32.887003+0000","last_active":"2024-05-16T21:33:33.896488+0000","last_peered":"2024-05-16T21:33:33.896488+0000","last_clean":"2024-05-16T21:33:33.896488+0000","last_became_active":"2024-05-16T21:33:32.886265+0000","last_became_peered":"2024-05-16T21:33:32.886265+0000","last_unstale":"2024-05-16T21:33:33.896488+0000","last_undegraded":"2024-05-16T21:33:33.896488+0000","last_fullsized":"2024-05-16T21:33:33.896488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:28:26.193644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880796+0000","last_change":"2024-05-16T21:33:32.879834+0000","last_active":"2024-05-16T21:33:33.880796+0000","last_peered":"2024-05-16T21:33:33.880796+0000","last_clean":"2024-05-16T21:33:33.880796+0000","last_became_active":"2024-05-16T21:33:32.879346+0000","last_became_peered":"2024-05-16T21:33:32.879346+0000","last_unstale":"2024-05-16T21:33:33.880796+0000","last_undegraded":"2024-05-16T21:33:33.880796+0000","last_fullsized":"2024-05-16T21:33:33.880796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:25:28.050094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303924+0000","last_change":"2024-05-16T21:33:32.890280+0000","last_active":"2024-05-16T21:33:34.303924+0000","last_peered":"2024-05-16T21:33:34.303924+0000","last_clean":"2024-05-16T21:33:34.303924+0000","last_became_active":"2024-05-16T21:33:32.889951+0000","last_became_peered":"2024-05-16T21:33:32.889951+0000","last_unstale":"2024-05-16T21:33:34.303924+0000","last_undegraded":"2024-05-16T21:33:34.303924+0000","last_fullsized":"2024-05-16T21:33:34.303924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:21.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304487+0000","last_change":"2024-05-16T21:33:32.876524+0000","last_active":"2024-05-16T21:33:34.304487+0000","last_peered":"2024-05-16T21:33:34.304487+0000","last_clean":"2024-05-16T21:33:34.304487+0000","last_became_active":"2024-05-16T21:33:32.876153+0000","last_became_peered":"2024-05-16T21:33:32.876153+0000","last_unstale":"2024-05-16T21:33:34.304487+0000","last_undegraded":"2024-05-16T21:33:34.304487+0000","last_fullsized":"2024-05-16T21:33:34.304487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:28.368999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304973+0000","last_change":"2024-05-16T21:33:32.890829+0000","last_active":"2024-05-16T21:33:34.304973+0000","last_peered":"2024-05-16T21:33:34.304973+0000","last_clean":"2024-05-16T21:33:34.304973+0000","last_became_active":"2024-05-16T21:33:32.889897+0000","last_became_peered":"2024-05-16T21:33:32.889897+0000","last_unstale":"2024-05-16T21:33:34.304973+0000","last_undegraded":"2024-05-16T21:33:34.304973+0000","last_fullsized":"2024-05-16T21:33:34.304973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:25:28.050094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304447+0000","last_change":"2024-05-16T21:33:32.878061+0000","last_active":"2024-05-16T21:33:34.304447+0000","last_peered":"2024-05-16T21:33:34.304447+0000","last_clean":"2024-05-16T21:33:34.304447+0000","last_became_active":"2024-05-16T21:33:32.877723+0000","last_became_peered":"2024-05-16T21:33:32.877723+0000","last_unstale":"2024-05-16T21:33:34.304447+0000","last_undegraded":"2024-05-16T21:33:34.304447+0000","last_fullsized":"2024-05-16T21:33:34.304447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:03:30.530147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880963+0000","last_change":"2024-05-16T21:33:32.884260+0000","last_active":"2024-05-16T21:33:33.880963+0000","last_peered":"2024-05-16T21:33:33.880963+0000","last_clean":"2024-05-16T21:33:33.880963+0000","last_became_active":"2024-05-16T21:33:32.883917+0000","last_became_peered":"2024-05-16T21:33:32.883917+0000","last_unstale":"2024-05-16T21:33:33.880963+0000","last_undegraded":"2024-05-16T21:33:33.880963+0000","last_fullsized":"2024-05-16T21:33:33.880963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:05:31.733731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304784+0000","last_change":"2024-05-16T21:33:32.889040+0000","last_active":"2024-05-16T21:33:34.304784+0000","last_peered":"2024-05-16T21:33:34.304784+0000","last_clean":"2024-05-16T21:33:34.304784+0000","last_became_active":"2024-05-16T21:33:32.888717+0000","last_became_peered":"2024-05-16T21:33:32.888717+0000","last_unstale":"2024-05-16T21:33:34.304784+0000","last_undegraded":"2024-05-16T21:33:34.304784+0000","last_fullsized":"2024-05-16T21:33:34.304784+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:26:59.916487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304765+0000","last_change":"2024-05-16T21:33:32.875298+0000","last_active":"2024-05-16T21:33:34.304765+0000","last_peered":"2024-05-16T21:33:34.304765+0000","last_clean":"2024-05-16T21:33:34.304765+0000","last_became_active":"2024-05-16T21:33:32.874961+0000","last_became_peered":"2024-05-16T21:33:32.874961+0000","last_unstale":"2024-05-16T21:33:34.304765+0000","last_undegraded":"2024-05-16T21:33:34.304765+0000","last_fullsized":"2024-05-16T21:33:34.304765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:40:46.466193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896348+0000","last_change":"2024-05-16T21:33:32.886253+0000","last_active":"2024-05-16T21:33:33.896348+0000","last_peered":"2024-05-16T21:33:33.896348+0000","last_clean":"2024-05-16T21:33:33.896348+0000","last_became_active":"2024-05-16T21:33:32.885099+0000","last_became_peered":"2024-05-16T21:33:32.885099+0000","last_unstale":"2024-05-16T21:33:33.896348+0000","last_undegraded":"2024-05-16T21:33:33.896348+0000","last_fullsized":"2024-05-16T21:33:33.896348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:57:07.066325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303760+0000","last_change":"2024-05-16T21:33:32.889926+0000","last_active":"2024-05-16T21:33:34.303760+0000","last_peered":"2024-05-16T21:33:34.303760+0000","last_clean":"2024-05-16T21:33:34.303760+0000","last_became_active":"2024-05-16T21:33:32.889523+0000","last_became_peered":"2024-05-16T21:33:32.889523+0000","last_unstale":"2024-05-16T21:33:34.303760+0000","last_undegraded":"2024-05-16T21:33:34.303760+0000","last_fullsized":"2024-05-16T21:33:34.303760+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:54:57.175421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899062+0000","last_change":"2024-05-16T21:33:32.873518+0000","last_active":"2024-05-16T21:33:33.899062+0000","last_peered":"2024-05-16T21:33:33.899062+0000","last_clean":"2024-05-16T21:33:33.899062+0000","last_became_active":"2024-05-16T21:33:32.873177+0000","last_became_peered":"2024-05-16T21:33:32.873177+0000","last_unstale":"2024-05-16T21:33:33.899062+0000","last_undegraded":"2024-05-16T21:33:33.899062+0000","last_fullsized":"2024-05-16T21:33:33.899062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:53.371881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899131+0000","last_change":"2024-05-16T21:33:32.889675+0000","last_active":"2024-05-16T21:33:33.899131+0000","last_peered":"2024-05-16T21:33:33.899131+0000","last_clean":"2024-05-16T21:33:33.899131+0000","last_became_active":"2024-05-16T21:33:32.889335+0000","last_became_peered":"2024-05-16T21:33:32.889335+0000","last_unstale":"2024-05-16T21:33:33.899131+0000","last_undegraded":"2024-05-16T21:33:33.899131+0000","last_fullsized":"2024-05-16T21:33:33.899131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:49.390033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304282+0000","last_change":"2024-05-16T21:33:32.878342+0000","last_active":"2024-05-16T21:33:34.304282+0000","last_peered":"2024-05-16T21:33:34.304282+0000","last_clean":"2024-05-16T21:33:34.304282+0000","last_became_active":"2024-05-16T21:33:32.877881+0000","last_became_peered":"2024-05-16T21:33:32.877881+0000","last_unstale":"2024-05-16T21:33:34.304282+0000","last_undegraded":"2024-05-16T21:33:34.304282+0000","last_fullsized":"2024-05-16T21:33:34.304282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:11.384815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304708+0000","last_change":"2024-05-16T21:33:32.882442+0000","last_active":"2024-05-16T21:33:34.304708+0000","last_peered":"2024-05-16T21:33:34.304708+0000","last_clean":"2024-05-16T21:33:34.304708+0000","last_became_active":"2024-05-16T21:33:32.880171+0000","last_became_peered":"2024-05-16T21:33:32.880171+0000","last_unstale":"2024-05-16T21:33:34.304708+0000","last_undegraded":"2024-05-16T21:33:34.304708+0000","last_fullsized":"2024-05-16T21:33:34.304708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:50:45.299794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896454+0000","last_change":"2024-05-16T21:33:32.885091+0000","last_active":"2024-05-16T21:33:33.896454+0000","last_peered":"2024-05-16T21:33:33.896454+0000","last_clean":"2024-05-16T21:33:33.896454+0000","last_became_active":"2024-05-16T21:33:32.884696+0000","last_became_peered":"2024-05-16T21:33:32.884696+0000","last_unstale":"2024-05-16T21:33:33.896454+0000","last_undegraded":"2024-05-16T21:33:33.896454+0000","last_fullsized":"2024-05-16T21:33:33.896454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:57:12.907639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304329+0000","last_change":"2024-05-16T21:33:32.890266+0000","last_active":"2024-05-16T21:33:34.304329+0000","last_peered":"2024-05-16T21:33:34.304329+0000","last_clean":"2024-05-16T21:33:34.304329+0000","last_became_active":"2024-05-16T21:33:32.889801+0000","last_became_peered":"2024-05-16T21:33:32.889801+0000","last_unstale":"2024-05-16T21:33:34.304329+0000","last_undegraded":"2024-05-16T21:33:34.304329+0000","last_fullsized":"2024-05-16T21:33:34.304329+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:56:56.377242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303927+0000","last_change":"2024-05-16T21:33:32.880797+0000","last_active":"2024-05-16T21:33:34.303927+0000","last_peered":"2024-05-16T21:33:34.303927+0000","last_clean":"2024-05-16T21:33:34.303927+0000","last_became_active":"2024-05-16T21:33:32.880259+0000","last_became_peered":"2024-05-16T21:33:32.880259+0000","last_unstale":"2024-05-16T21:33:34.303927+0000","last_undegraded":"2024-05-16T21:33:34.303927+0000","last_fullsized":"2024-05-16T21:33:34.303927+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:44:40.826278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303836+0000","last_change":"2024-05-16T21:33:32.879090+0000","last_active":"2024-05-16T21:33:34.303836+0000","last_peered":"2024-05-16T21:33:34.303836+0000","last_clean":"2024-05-16T21:33:34.303836+0000","last_became_active":"2024-05-16T21:33:32.878646+0000","last_became_peered":"2024-05-16T21:33:32.878646+0000","last_unstale":"2024-05-16T21:33:34.303836+0000","last_undegraded":"2024-05-16T21:33:34.303836+0000","last_fullsized":"2024-05-16T21:33:34.303836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:53:25.064910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304280+0000","last_change":"2024-05-16T21:33:32.887436+0000","last_active":"2024-05-16T21:33:34.304280+0000","last_peered":"2024-05-16T21:33:34.304280+0000","last_clean":"2024-05-16T21:33:34.304280+0000","last_became_active":"2024-05-16T21:33:32.887116+0000","last_became_peered":"2024-05-16T21:33:32.887116+0000","last_unstale":"2024-05-16T21:33:34.304280+0000","last_undegraded":"2024-05-16T21:33:34.304280+0000","last_fullsized":"2024-05-16T21:33:34.304280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:04:50.979272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304350+0000","last_change":"2024-05-16T21:33:32.889005+0000","last_active":"2024-05-16T21:33:34.304350+0000","last_peered":"2024-05-16T21:33:34.304350+0000","last_clean":"2024-05-16T21:33:34.304350+0000","last_became_active":"2024-05-16T21:33:32.888679+0000","last_became_peered":"2024-05-16T21:33:32.888679+0000","last_unstale":"2024-05-16T21:33:34.304350+0000","last_undegraded":"2024-05-16T21:33:34.304350+0000","last_fullsized":"2024-05-16T21:33:34.304350+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:14:09.010239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899049+0000","last_change":"2024-05-16T21:33:32.872953+0000","last_active":"2024-05-16T21:33:33.899049+0000","last_peered":"2024-05-16T21:33:33.899049+0000","last_clean":"2024-05-16T21:33:33.899049+0000","last_became_active":"2024-05-16T21:33:32.872631+0000","last_became_peered":"2024-05-16T21:33:32.872631+0000","last_unstale":"2024-05-16T21:33:33.899049+0000","last_undegraded":"2024-05-16T21:33:33.899049+0000","last_fullsized":"2024-05-16T21:33:33.899049+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:56:56.377242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881327+0000","last_change":"2024-05-16T21:33:32.884825+0000","last_active":"2024-05-16T21:33:33.881327+0000","last_peered":"2024-05-16T21:33:33.881327+0000","last_clean":"2024-05-16T21:33:33.881327+0000","last_became_active":"2024-05-16T21:33:32.884496+0000","last_became_peered":"2024-05-16T21:33:32.884496+0000","last_unstale":"2024-05-16T21:33:33.881327+0000","last_undegraded":"2024-05-16T21:33:33.881327+0000","last_fullsized":"2024-05-16T21:33:33.881327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:40:46.466193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303871+0000","last_change":"2024-05-16T21:33:32.875345+0000","last_active":"2024-05-16T21:33:34.303871+0000","last_peered":"2024-05-16T21:33:34.303871+0000","last_clean":"2024-05-16T21:33:34.303871+0000","last_became_active":"2024-05-16T21:33:32.875030+0000","last_became_peered":"2024-05-16T21:33:32.875030+0000","last_unstale":"2024-05-16T21:33:34.303871+0000","last_undegraded":"2024-05-16T21:33:34.303871+0000","last_fullsized":"2024-05-16T21:33:34.303871+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:36:15.829862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898825+0000","last_change":"2024-05-16T21:33:32.873320+0000","last_active":"2024-05-16T21:33:33.898825+0000","last_peered":"2024-05-16T21:33:33.898825+0000","last_clean":"2024-05-16T21:33:33.898825+0000","last_became_active":"2024-05-16T21:33:32.872372+0000","last_became_peered":"2024-05-16T21:33:32.872372+0000","last_unstale":"2024-05-16T21:33:33.898825+0000","last_undegraded":"2024-05-16T21:33:33.898825+0000","last_fullsized":"2024-05-16T21:33:33.898825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:55.605989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896439+0000","last_change":"2024-05-16T21:33:32.886016+0000","last_active":"2024-05-16T21:33:33.896439+0000","last_peered":"2024-05-16T21:33:33.896439+0000","last_clean":"2024-05-16T21:33:33.896439+0000","last_became_active":"2024-05-16T21:33:32.885507+0000","last_became_peered":"2024-05-16T21:33:32.885507+0000","last_unstale":"2024-05-16T21:33:33.896439+0000","last_undegraded":"2024-05-16T21:33:33.896439+0000","last_fullsized":"2024-05-16T21:33:33.896439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:32:52.755735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304207+0000","last_change":"2024-05-16T21:33:32.880770+0000","last_active":"2024-05-16T21:33:34.304207+0000","last_peered":"2024-05-16T21:33:34.304207+0000","last_clean":"2024-05-16T21:33:34.304207+0000","last_became_active":"2024-05-16T21:33:32.880454+0000","last_became_peered":"2024-05-16T21:33:32.880454+0000","last_unstale":"2024-05-16T21:33:34.304207+0000","last_undegraded":"2024-05-16T21:33:34.304207+0000","last_fullsized":"2024-05-16T21:33:34.304207+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:50:16.663853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.879932+0000","last_change":"2024-05-16T21:33:32.886405+0000","last_active":"2024-05-16T21:33:33.879932+0000","last_peered":"2024-05-16T21:33:33.879932+0000","last_clean":"2024-05-16T21:33:33.879932+0000","last_became_active":"2024-05-16T21:33:32.886064+0000","last_became_peered":"2024-05-16T21:33:32.886064+0000","last_unstale":"2024-05-16T21:33:33.879932+0000","last_undegraded":"2024-05-16T21:33:33.879932+0000","last_fullsized":"2024-05-16T21:33:33.879932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:34:21.861374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896859+0000","last_change":"2024-05-16T21:33:31.869058+0000","last_active":"2024-05-16T21:33:33.896859+0000","last_peered":"2024-05-16T21:33:33.896859+0000","last_clean":"2024-05-16T21:33:33.896859+0000","last_became_active":"2024-05-16T21:33:31.868567+0000","last_became_peered":"2024-05-16T21:33:31.868567+0000","last_unstale":"2024-05-16T21:33:33.896859+0000","last_undegraded":"2024-05-16T21:33:33.896859+0000","last_fullsized":"2024-05-16T21:33:33.896859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:20:27.363650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304293+0000","last_change":"2024-05-16T21:33:32.883463+0000","last_active":"2024-05-16T21:33:34.304293+0000","last_peered":"2024-05-16T21:33:34.304293+0000","last_clean":"2024-05-16T21:33:34.304293+0000","last_became_active":"2024-05-16T21:33:32.883134+0000","last_became_peered":"2024-05-16T21:33:32.883134+0000","last_unstale":"2024-05-16T21:33:34.304293+0000","last_undegraded":"2024-05-16T21:33:34.304293+0000","last_fullsized":"2024-05-16T21:33:34.304293+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:34:21.861374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899173+0000","last_change":"2024-05-16T21:33:31.872862+0000","last_active":"2024-05-16T21:33:33.899173+0000","last_peered":"2024-05-16T21:33:33.899173+0000","last_clean":"2024-05-16T21:33:33.899173+0000","last_became_active":"2024-05-16T21:33:31.872177+0000","last_became_peered":"2024-05-16T21:33:31.872177+0000","last_unstale":"2024-05-16T21:33:33.899173+0000","last_undegraded":"2024-05-16T21:33:33.899173+0000","last_fullsized":"2024-05-16T21:33:33.899173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:51:51.826886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881546+0000","last_change":"2024-05-16T21:33:32.892233+0000","last_active":"2024-05-16T21:33:33.881546+0000","last_peered":"2024-05-16T21:33:33.881546+0000","last_clean":"2024-05-16T21:33:33.881546+0000","last_became_active":"2024-05-16T21:33:32.891850+0000","last_became_peered":"2024-05-16T21:33:32.891850+0000","last_unstale":"2024-05-16T21:33:33.881546+0000","last_undegraded":"2024-05-16T21:33:33.881546+0000","last_fullsized":"2024-05-16T21:33:33.881546+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:25:28.050094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880137+0000","last_change":"2024-05-16T21:33:31.873183+0000","last_active":"2024-05-16T21:33:33.880137+0000","last_peered":"2024-05-16T21:33:33.880137+0000","last_clean":"2024-05-16T21:33:33.880137+0000","last_became_active":"2024-05-16T21:33:31.872235+0000","last_became_peered":"2024-05-16T21:33:31.872235+0000","last_unstale":"2024-05-16T21:33:33.880137+0000","last_undegraded":"2024-05-16T21:33:33.880137+0000","last_fullsized":"2024-05-16T21:33:33.880137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:52:24.982666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880200+0000","last_change":"2024-05-16T21:33:32.881300+0000","last_active":"2024-05-16T21:33:33.880200+0000","last_peered":"2024-05-16T21:33:33.880200+0000","last_clean":"2024-05-16T21:33:33.880200+0000","last_became_active":"2024-05-16T21:33:32.880825+0000","last_became_peered":"2024-05-16T21:33:32.880825+0000","last_unstale":"2024-05-16T21:33:33.880200+0000","last_undegraded":"2024-05-16T21:33:33.880200+0000","last_fullsized":"2024-05-16T21:33:33.880200+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:21.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881777+0000","last_change":"2024-05-16T21:33:31.879734+0000","last_active":"2024-05-16T21:33:33.881777+0000","last_peered":"2024-05-16T21:33:33.881777+0000","last_clean":"2024-05-16T21:33:33.881777+0000","last_became_active":"2024-05-16T21:33:31.879373+0000","last_became_peered":"2024-05-16T21:33:31.879373+0000","last_unstale":"2024-05-16T21:33:33.881777+0000","last_undegraded":"2024-05-16T21:33:33.881777+0000","last_fullsized":"2024-05-16T21:33:33.881777+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:20.728570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898828+0000","last_change":"2024-05-16T21:33:32.882138+0000","last_active":"2024-05-16T21:33:33.898828+0000","last_peered":"2024-05-16T21:33:33.898828+0000","last_clean":"2024-05-16T21:33:33.898828+0000","last_became_active":"2024-05-16T21:33:32.881708+0000","last_became_peered":"2024-05-16T21:33:32.881708+0000","last_unstale":"2024-05-16T21:33:33.898828+0000","last_undegraded":"2024-05-16T21:33:33.898828+0000","last_fullsized":"2024-05-16T21:33:33.898828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:21.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896722+0000","last_change":"2024-05-16T21:33:31.877999+0000","last_active":"2024-05-16T21:33:33.896722+0000","last_peered":"2024-05-16T21:33:33.896722+0000","last_clean":"2024-05-16T21:33:33.896722+0000","last_became_active":"2024-05-16T21:33:31.877481+0000","last_became_peered":"2024-05-16T21:33:31.877481+0000","last_unstale":"2024-05-16T21:33:33.896722+0000","last_undegraded":"2024-05-16T21:33:33.896722+0000","last_fullsized":"2024-05-16T21:33:33.896722+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:20:42.972660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304221+0000","last_change":"2024-05-16T21:33:32.883634+0000","last_active":"2024-05-16T21:33:34.304221+0000","last_peered":"2024-05-16T21:33:34.304221+0000","last_clean":"2024-05-16T21:33:34.304221+0000","last_became_active":"2024-05-16T21:33:32.883298+0000","last_became_peered":"2024-05-16T21:33:32.883298+0000","last_unstale":"2024-05-16T21:33:34.304221+0000","last_undegraded":"2024-05-16T21:33:34.304221+0000","last_fullsized":"2024-05-16T21:33:34.304221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:53.371881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898938+0000","last_change":"2024-05-16T21:33:31.876983+0000","last_active":"2024-05-16T21:33:33.898938+0000","last_peered":"2024-05-16T21:33:33.898938+0000","last_clean":"2024-05-16T21:33:33.898938+0000","last_became_active":"2024-05-16T21:33:31.876044+0000","last_became_peered":"2024-05-16T21:33:31.876044+0000","last_unstale":"2024-05-16T21:33:33.898938+0000","last_undegraded":"2024-05-16T21:33:33.898938+0000","last_fullsized":"2024-05-16T21:33:33.898938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:34:35.638011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303998+0000","last_change":"2024-05-16T21:33:32.890107+0000","last_active":"2024-05-16T21:33:34.303998+0000","last_peered":"2024-05-16T21:33:34.303998+0000","last_clean":"2024-05-16T21:33:34.303998+0000","last_became_active":"2024-05-16T21:33:32.889781+0000","last_became_peered":"2024-05-16T21:33:32.889781+0000","last_unstale":"2024-05-16T21:33:34.303998+0000","last_undegraded":"2024-05-16T21:33:34.303998+0000","last_fullsized":"2024-05-16T21:33:34.303998+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:18:04.578132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880630+0000","last_change":"2024-05-16T21:33:31.871567+0000","last_active":"2024-05-16T21:33:33.880630+0000","last_peered":"2024-05-16T21:33:33.880630+0000","last_clean":"2024-05-16T21:33:33.880630+0000","last_became_active":"2024-05-16T21:33:31.870838+0000","last_became_peered":"2024-05-16T21:33:31.870838+0000","last_unstale":"2024-05-16T21:33:33.880630+0000","last_undegraded":"2024-05-16T21:33:33.880630+0000","last_fullsized":"2024-05-16T21:33:33.880630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.379466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303679+0000","last_change":"2024-05-16T21:33:32.882023+0000","last_active":"2024-05-16T21:33:34.303679+0000","last_peered":"2024-05-16T21:33:34.303679+0000","last_clean":"2024-05-16T21:33:34.303679+0000","last_became_active":"2024-05-16T21:33:32.880691+0000","last_became_peered":"2024-05-16T21:33:32.880691+0000","last_unstale":"2024-05-16T21:33:34.303679+0000","last_undegraded":"2024-05-16T21:33:34.303679+0000","last_fullsized":"2024-05-16T21:33:34.303679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:34:36.643360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304044+0000","last_change":"2024-05-16T21:33:31.880424+0000","last_active":"2024-05-16T21:33:34.304044+0000","last_peered":"2024-05-16T21:33:34.304044+0000","last_clean":"2024-05-16T21:33:34.304044+0000","last_became_active":"2024-05-16T21:33:31.879864+0000","last_became_peered":"2024-05-16T21:33:31.879864+0000","last_unstale":"2024-05-16T21:33:34.304044+0000","last_undegraded":"2024-05-16T21:33:34.304044+0000","last_fullsized":"2024-05-16T21:33:34.304044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:42:35.253243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899030+0000","last_change":"2024-05-16T21:33:32.881605+0000","last_active":"2024-05-16T21:33:33.899030+0000","last_peered":"2024-05-16T21:33:33.899030+0000","last_clean":"2024-05-16T21:33:33.899030+0000","last_became_active":"2024-05-16T21:33:32.881201+0000","last_became_peered":"2024-05-16T21:33:32.881201+0000","last_unstale":"2024-05-16T21:33:33.899030+0000","last_undegraded":"2024-05-16T21:33:33.899030+0000","last_fullsized":"2024-05-16T21:33:33.899030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:18:04.578132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899071+0000","last_change":"2024-05-16T21:33:31.876589+0000","last_active":"2024-05-16T21:33:33.899071+0000","last_peered":"2024-05-16T21:33:33.899071+0000","last_clean":"2024-05-16T21:33:33.899071+0000","last_became_active":"2024-05-16T21:33:31.876244+0000","last_became_peered":"2024-05-16T21:33:31.876244+0000","last_unstale":"2024-05-16T21:33:33.899071+0000","last_undegraded":"2024-05-16T21:33:33.899071+0000","last_fullsized":"2024-05-16T21:33:33.899071+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:18.465547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.882275+0000","last_change":"2024-05-16T21:33:32.873325+0000","last_active":"2024-05-16T21:33:33.882275+0000","last_peered":"2024-05-16T21:33:33.882275+0000","last_clean":"2024-05-16T21:33:33.882275+0000","last_became_active":"2024-05-16T21:33:32.872876+0000","last_became_peered":"2024-05-16T21:33:32.872876+0000","last_unstale":"2024-05-16T21:33:33.882275+0000","last_undegraded":"2024-05-16T21:33:33.882275+0000","last_fullsized":"2024-05-16T21:33:33.882275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:02:14.691919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.305051+0000","last_change":"2024-05-16T21:33:31.882172+0000","last_active":"2024-05-16T21:33:34.305051+0000","last_peered":"2024-05-16T21:33:34.305051+0000","last_clean":"2024-05-16T21:33:34.305051+0000","last_became_active":"2024-05-16T21:33:31.881868+0000","last_became_peered":"2024-05-16T21:33:31.881868+0000","last_unstale":"2024-05-16T21:33:34.305051+0000","last_undegraded":"2024-05-16T21:33:34.305051+0000","last_fullsized":"2024-05-16T21:33:34.305051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:51:51.826886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896725+0000","last_change":"2024-05-16T21:33:32.887206+0000","last_active":"2024-05-16T21:33:33.896725+0000","last_peered":"2024-05-16T21:33:33.896725+0000","last_clean":"2024-05-16T21:33:33.896725+0000","last_became_active":"2024-05-16T21:33:32.886706+0000","last_became_peered":"2024-05-16T21:33:32.886706+0000","last_unstale":"2024-05-16T21:33:33.896725+0000","last_undegraded":"2024-05-16T21:33:33.896725+0000","last_fullsized":"2024-05-16T21:33:33.896725+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:31:22.170564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.882084+0000","last_change":"2024-05-16T21:33:31.881075+0000","last_active":"2024-05-16T21:33:33.882084+0000","last_peered":"2024-05-16T21:33:33.882084+0000","last_clean":"2024-05-16T21:33:33.882084+0000","last_became_active":"2024-05-16T21:33:31.879388+0000","last_became_peered":"2024-05-16T21:33:31.879388+0000","last_unstale":"2024-05-16T21:33:33.882084+0000","last_undegraded":"2024-05-16T21:33:33.882084+0000","last_fullsized":"2024-05-16T21:33:33.882084+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:18:03.572784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881958+0000","last_change":"2024-05-16T21:33:32.886213+0000","last_active":"2024-05-16T21:33:33.881958+0000","last_peered":"2024-05-16T21:33:33.881958+0000","last_clean":"2024-05-16T21:33:33.881958+0000","last_became_active":"2024-05-16T21:33:32.885904+0000","last_became_peered":"2024-05-16T21:33:32.885904+0000","last_unstale":"2024-05-16T21:33:33.881958+0000","last_undegraded":"2024-05-16T21:33:33.881958+0000","last_fullsized":"2024-05-16T21:33:33.881958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:43:31.689055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304899+0000","last_change":"2024-05-16T21:33:31.879584+0000","last_active":"2024-05-16T21:33:34.304899+0000","last_peered":"2024-05-16T21:33:34.304899+0000","last_clean":"2024-05-16T21:33:34.304899+0000","last_became_active":"2024-05-16T21:33:31.879224+0000","last_became_peered":"2024-05-16T21:33:31.879224+0000","last_unstale":"2024-05-16T21:33:34.304899+0000","last_undegraded":"2024-05-16T21:33:34.304899+0000","last_fullsized":"2024-05-16T21:33:34.304899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:44:28.213463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303934+0000","last_change":"2024-05-16T21:33:32.879098+0000","last_active":"2024-05-16T21:33:34.303934+0000","last_peered":"2024-05-16T21:33:34.303934+0000","last_clean":"2024-05-16T21:33:34.303934+0000","last_became_active":"2024-05-16T21:33:32.878713+0000","last_became_peered":"2024-05-16T21:33:32.878713+0000","last_unstale":"2024-05-16T21:33:34.303934+0000","last_undegraded":"2024-05-16T21:33:34.303934+0000","last_fullsized":"2024-05-16T21:33:34.303934+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:52:25.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896839+0000","last_change":"2024-05-16T21:33:31.877679+0000","last_active":"2024-05-16T21:33:33.896839+0000","last_peered":"2024-05-16T21:33:33.896839+0000","last_clean":"2024-05-16T21:33:33.896839+0000","last_became_active":"2024-05-16T21:33:31.877027+0000","last_became_peered":"2024-05-16T21:33:31.877027+0000","last_unstale":"2024-05-16T21:33:33.896839+0000","last_undegraded":"2024-05-16T21:33:33.896839+0000","last_fullsized":"2024-05-16T21:33:33.896839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:40:45.460844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304418+0000","last_change":"2024-05-16T21:33:32.881502+0000","last_active":"2024-05-16T21:33:34.304418+0000","last_peered":"2024-05-16T21:33:34.304418+0000","last_clean":"2024-05-16T21:33:34.304418+0000","last_became_active":"2024-05-16T21:33:32.877547+0000","last_became_peered":"2024-05-16T21:33:32.877547+0000","last_unstale":"2024-05-16T21:33:34.304418+0000","last_undegraded":"2024-05-16T21:33:34.304418+0000","last_fullsized":"2024-05-16T21:33:34.304418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:49.390033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881346+0000","last_change":"2024-05-16T21:33:31.880867+0000","last_active":"2024-05-16T21:33:33.881346+0000","last_peered":"2024-05-16T21:33:33.881346+0000","last_clean":"2024-05-16T21:33:33.881346+0000","last_became_active":"2024-05-16T21:33:31.879408+0000","last_became_peered":"2024-05-16T21:33:31.879408+0000","last_unstale":"2024-05-16T21:33:33.881346+0000","last_undegraded":"2024-05-16T21:33:33.881346+0000","last_fullsized":"2024-05-16T21:33:33.881346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:56:55.371893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896348+0000","last_change":"2024-05-16T21:33:32.880315+0000","last_active":"2024-05-16T21:33:33.896348+0000","last_peered":"2024-05-16T21:33:33.896348+0000","last_clean":"2024-05-16T21:33:33.896348+0000","last_became_active":"2024-05-16T21:33:32.879976+0000","last_became_peered":"2024-05-16T21:33:32.879976+0000","last_unstale":"2024-05-16T21:33:33.896348+0000","last_undegraded":"2024-05-16T21:33:33.896348+0000","last_fullsized":"2024-05-16T21:33:33.896348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:48.989694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896499+0000","last_change":"2024-05-16T21:33:31.878577+0000","last_active":"2024-05-16T21:33:33.896499+0000","last_peered":"2024-05-16T21:33:33.896499+0000","last_clean":"2024-05-16T21:33:33.896499+0000","last_became_active":"2024-05-16T21:33:31.876096+0000","last_became_peered":"2024-05-16T21:33:31.876096+0000","last_unstale":"2024-05-16T21:33:33.896499+0000","last_undegraded":"2024-05-16T21:33:33.896499+0000","last_fullsized":"2024-05-16T21:33:33.896499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:05:30.728382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880938+0000","last_change":"2024-05-16T21:33:32.881491+0000","last_active":"2024-05-16T21:33:33.880938+0000","last_peered":"2024-05-16T21:33:33.880938+0000","last_clean":"2024-05-16T21:33:33.880938+0000","last_became_active":"2024-05-16T21:33:32.881187+0000","last_became_peered":"2024-05-16T21:33:32.881187+0000","last_unstale":"2024-05-16T21:33:33.880938+0000","last_undegraded":"2024-05-16T21:33:33.880938+0000","last_fullsized":"2024-05-16T21:33:33.880938+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:23:00.840173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304144+0000","last_change":"2024-05-16T21:33:31.880658+0000","last_active":"2024-05-16T21:33:34.304144+0000","last_peered":"2024-05-16T21:33:34.304144+0000","last_clean":"2024-05-16T21:33:34.304144+0000","last_became_active":"2024-05-16T21:33:31.880322+0000","last_became_peered":"2024-05-16T21:33:31.880322+0000","last_unstale":"2024-05-16T21:33:34.304144+0000","last_undegraded":"2024-05-16T21:33:34.304144+0000","last_fullsized":"2024-05-16T21:33:34.304144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T21:36:16.069465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304538+0000","last_change":"2024-05-16T21:33:32.879619+0000","last_active":"2024-05-16T21:33:34.304538+0000","last_peered":"2024-05-16T21:33:34.304538+0000","last_clean":"2024-05-16T21:33:34.304538+0000","last_became_active":"2024-05-16T21:33:32.879281+0000","last_became_peered":"2024-05-16T21:33:32.879281+0000","last_unstale":"2024-05-16T21:33:34.304538+0000","last_undegraded":"2024-05-16T21:33:34.304538+0000","last_fullsized":"2024-05-16T21:33:34.304538+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:04:14.195670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304746+0000","last_change":"2024-05-16T21:33:31.877949+0000","last_active":"2024-05-16T21:33:34.304746+0000","last_peered":"2024-05-16T21:33:34.304746+0000","last_clean":"2024-05-16T21:33:34.304746+0000","last_became_active":"2024-05-16T21:33:31.877507+0000","last_became_peered":"2024-05-16T21:33:31.877507+0000","last_unstale":"2024-05-16T21:33:34.304746+0000","last_undegraded":"2024-05-16T21:33:34.304746+0000","last_fullsized":"2024-05-16T21:33:34.304746+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:45:55.837861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304681+0000","last_change":"2024-05-16T21:33:32.892527+0000","last_active":"2024-05-16T21:33:34.304681+0000","last_peered":"2024-05-16T21:33:34.304681+0000","last_clean":"2024-05-16T21:33:34.304681+0000","last_became_active":"2024-05-16T21:33:32.892060+0000","last_became_peered":"2024-05-16T21:33:32.892060+0000","last_unstale":"2024-05-16T21:33:34.304681+0000","last_undegraded":"2024-05-16T21:33:34.304681+0000","last_fullsized":"2024-05-16T21:33:34.304681+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:20:43.978009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.899206+0000","last_change":"2024-05-16T21:33:31.872581+0000","last_active":"2024-05-16T21:33:33.899206+0000","last_peered":"2024-05-16T21:33:33.899206+0000","last_clean":"2024-05-16T21:33:33.899206+0000","last_became_active":"2024-05-16T21:33:31.871825+0000","last_became_peered":"2024-05-16T21:33:31.871825+0000","last_unstale":"2024-05-16T21:33:33.899206+0000","last_undegraded":"2024-05-16T21:33:33.899206+0000","last_fullsized":"2024-05-16T21:33:33.899206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:52:13.849468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304128+0000","last_change":"2024-05-16T21:33:32.887740+0000","last_active":"2024-05-16T21:33:34.304128+0000","last_peered":"2024-05-16T21:33:34.304128+0000","last_clean":"2024-05-16T21:33:34.304128+0000","last_became_active":"2024-05-16T21:33:32.887453+0000","last_became_peered":"2024-05-16T21:33:32.887453+0000","last_unstale":"2024-05-16T21:33:34.304128+0000","last_undegraded":"2024-05-16T21:33:34.304128+0000","last_fullsized":"2024-05-16T21:33:34.304128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:21:14.017935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881757+0000","last_change":"2024-05-16T21:33:31.877158+0000","last_active":"2024-05-16T21:33:33.881757+0000","last_peered":"2024-05-16T21:33:33.881757+0000","last_clean":"2024-05-16T21:33:33.881757+0000","last_became_active":"2024-05-16T21:33:31.876862+0000","last_became_peered":"2024-05-16T21:33:31.876862+0000","last_unstale":"2024-05-16T21:33:33.881757+0000","last_undegraded":"2024-05-16T21:33:33.881757+0000","last_fullsized":"2024-05-16T21:33:33.881757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:33:20.728570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304142+0000","last_change":"2024-05-16T21:33:32.884238+0000","last_active":"2024-05-16T21:33:34.304142+0000","last_peered":"2024-05-16T21:33:34.304142+0000","last_clean":"2024-05-16T21:33:34.304142+0000","last_became_active":"2024-05-16T21:33:32.883276+0000","last_became_peered":"2024-05-16T21:33:32.883276+0000","last_unstale":"2024-05-16T21:33:34.304142+0000","last_undegraded":"2024-05-16T21:33:34.304142+0000","last_fullsized":"2024-05-16T21:33:34.304142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:55:55.769898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896727+0000","last_change":"2024-05-16T21:33:31.870715+0000","last_active":"2024-05-16T21:33:33.896727+0000","last_peered":"2024-05-16T21:33:33.896727+0000","last_clean":"2024-05-16T21:33:33.896727+0000","last_became_active":"2024-05-16T21:33:31.870294+0000","last_became_peered":"2024-05-16T21:33:31.870294+0000","last_unstale":"2024-05-16T21:33:33.896727+0000","last_undegraded":"2024-05-16T21:33:33.896727+0000","last_fullsized":"2024-05-16T21:33:33.896727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:55.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896700+0000","last_change":"2024-05-16T21:33:32.886654+0000","last_active":"2024-05-16T21:33:33.896700+0000","last_peered":"2024-05-16T21:33:33.896700+0000","last_clean":"2024-05-16T21:33:33.896700+0000","last_became_active":"2024-05-16T21:33:32.884977+0000","last_became_peered":"2024-05-16T21:33:32.884977+0000","last_unstale":"2024-05-16T21:33:33.896700+0000","last_undegraded":"2024-05-16T21:33:33.896700+0000","last_fullsized":"2024-05-16T21:33:33.896700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:31:32.288578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896923+0000","last_change":"2024-05-16T21:33:31.877818+0000","last_active":"2024-05-16T21:33:33.896923+0000","last_peered":"2024-05-16T21:33:33.896923+0000","last_clean":"2024-05-16T21:33:33.896923+0000","last_became_active":"2024-05-16T21:33:31.877325+0000","last_became_peered":"2024-05-16T21:33:31.877325+0000","last_unstale":"2024-05-16T21:33:33.896923+0000","last_undegraded":"2024-05-16T21:33:33.896923+0000","last_fullsized":"2024-05-16T21:33:33.896923+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:25:27.044745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.879970+0000","last_change":"2024-05-16T21:33:32.873090+0000","last_active":"2024-05-16T21:33:33.879970+0000","last_peered":"2024-05-16T21:33:33.879970+0000","last_clean":"2024-05-16T21:33:33.879970+0000","last_became_active":"2024-05-16T21:33:32.872740+0000","last_became_peered":"2024-05-16T21:33:32.872740+0000","last_unstale":"2024-05-16T21:33:33.879970+0000","last_undegraded":"2024-05-16T21:33:33.879970+0000","last_fullsized":"2024-05-16T21:33:33.879970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:55.605989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880797+0000","last_change":"2024-05-16T21:33:31.876560+0000","last_active":"2024-05-16T21:33:33.880797+0000","last_peered":"2024-05-16T21:33:33.880797+0000","last_clean":"2024-05-16T21:33:33.880797+0000","last_became_active":"2024-05-16T21:33:31.875662+0000","last_became_peered":"2024-05-16T21:33:31.875662+0000","last_unstale":"2024-05-16T21:33:33.880797+0000","last_undegraded":"2024-05-16T21:33:33.880797+0000","last_fullsized":"2024-05-16T21:33:33.880797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:54.600640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304391+0000","last_change":"2024-05-16T21:33:32.879576+0000","last_active":"2024-05-16T21:33:34.304391+0000","last_peered":"2024-05-16T21:33:34.304391+0000","last_clean":"2024-05-16T21:33:34.304391+0000","last_became_active":"2024-05-16T21:33:32.879231+0000","last_became_peered":"2024-05-16T21:33:32.879231+0000","last_unstale":"2024-05-16T21:33:34.304391+0000","last_undegraded":"2024-05-16T21:33:34.304391+0000","last_fullsized":"2024-05-16T21:33:34.304391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:57:03.843689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303994+0000","last_change":"2024-05-16T21:33:31.876761+0000","last_active":"2024-05-16T21:33:34.303994+0000","last_peered":"2024-05-16T21:33:34.303994+0000","last_clean":"2024-05-16T21:33:34.303994+0000","last_became_active":"2024-05-16T21:33:31.875779+0000","last_became_peered":"2024-05-16T21:33:31.875779+0000","last_unstale":"2024-05-16T21:33:34.303994+0000","last_undegraded":"2024-05-16T21:33:34.303994+0000","last_fullsized":"2024-05-16T21:33:34.303994+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:38:14.918688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.303987+0000","last_change":"2024-05-16T21:33:32.876602+0000","last_active":"2024-05-16T21:33:34.303987+0000","last_peered":"2024-05-16T21:33:34.303987+0000","last_clean":"2024-05-16T21:33:34.303987+0000","last_became_active":"2024-05-16T21:33:32.876230+0000","last_became_peered":"2024-05-16T21:33:32.876230+0000","last_unstale":"2024-05-16T21:33:34.303987+0000","last_undegraded":"2024-05-16T21:33:34.303987+0000","last_fullsized":"2024-05-16T21:33:34.303987+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:42:11.877138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.880607+0000","last_change":"2024-05-16T21:33:31.880592+0000","last_active":"2024-05-16T21:33:33.880607+0000","last_peered":"2024-05-16T21:33:33.880607+0000","last_clean":"2024-05-16T21:33:33.880607+0000","last_became_active":"2024-05-16T21:33:31.879418+0000","last_became_peered":"2024-05-16T21:33:31.879418+0000","last_unstale":"2024-05-16T21:33:33.880607+0000","last_undegraded":"2024-05-16T21:33:33.880607+0000","last_fullsized":"2024-05-16T21:33:33.880607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:54.600640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304466+0000","last_change":"2024-05-16T21:33:32.889853+0000","last_active":"2024-05-16T21:33:34.304466+0000","last_peered":"2024-05-16T21:33:34.304466+0000","last_clean":"2024-05-16T21:33:34.304466+0000","last_became_active":"2024-05-16T21:33:32.889509+0000","last_became_peered":"2024-05-16T21:33:32.889509+0000","last_unstale":"2024-05-16T21:33:34.304466+0000","last_undegraded":"2024-05-16T21:33:34.304466+0000","last_fullsized":"2024-05-16T21:33:34.304466+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:55.605989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898214+0000","last_change":"2024-05-16T21:33:31.879138+0000","last_active":"2024-05-16T21:33:33.898214+0000","last_peered":"2024-05-16T21:33:33.898214+0000","last_clean":"2024-05-16T21:33:33.898214+0000","last_became_active":"2024-05-16T21:33:31.878467+0000","last_became_peered":"2024-05-16T21:33:31.878467+0000","last_unstale":"2024-05-16T21:33:33.898214+0000","last_undegraded":"2024-05-16T21:33:33.898214+0000","last_fullsized":"2024-05-16T21:33:33.898214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:22:59.834824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304709+0000","last_change":"2024-05-16T21:33:32.876609+0000","last_active":"2024-05-16T21:33:34.304709+0000","last_peered":"2024-05-16T21:33:34.304709+0000","last_clean":"2024-05-16T21:33:34.304709+0000","last_became_active":"2024-05-16T21:33:32.876208+0000","last_became_peered":"2024-05-16T21:33:32.876208+0000","last_unstale":"2024-05-16T21:33:34.304709+0000","last_undegraded":"2024-05-16T21:33:34.304709+0000","last_fullsized":"2024-05-16T21:33:34.304709+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:56.433513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.882081+0000","last_change":"2024-05-16T21:33:31.881385+0000","last_active":"2024-05-16T21:33:33.882081+0000","last_peered":"2024-05-16T21:33:33.882081+0000","last_clean":"2024-05-16T21:33:33.882081+0000","last_became_active":"2024-05-16T21:33:31.880839+0000","last_became_peered":"2024-05-16T21:33:31.880839+0000","last_unstale":"2024-05-16T21:33:33.882081+0000","last_undegraded":"2024-05-16T21:33:33.882081+0000","last_fullsized":"2024-05-16T21:33:33.882081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:22:52.366532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881964+0000","last_change":"2024-05-16T21:33:32.881418+0000","last_active":"2024-05-16T21:33:33.881964+0000","last_peered":"2024-05-16T21:33:33.881964+0000","last_clean":"2024-05-16T21:33:33.881964+0000","last_became_active":"2024-05-16T21:33:32.880375+0000","last_became_peered":"2024-05-16T21:33:32.880375+0000","last_unstale":"2024-05-16T21:33:33.881964+0000","last_undegraded":"2024-05-16T21:33:33.881964+0000","last_fullsized":"2024-05-16T21:33:33.881964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:17:32.098362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.879901+0000","last_change":"2024-05-16T21:33:31.872634+0000","last_active":"2024-05-16T21:33:33.879901+0000","last_peered":"2024-05-16T21:33:33.879901+0000","last_clean":"2024-05-16T21:33:33.879901+0000","last_became_active":"2024-05-16T21:33:31.872148+0000","last_became_peered":"2024-05-16T21:33:31.872148+0000","last_unstale":"2024-05-16T21:33:33.879901+0000","last_undegraded":"2024-05-16T21:33:33.879901+0000","last_fullsized":"2024-05-16T21:33:33.879901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:44:39.820929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896711+0000","last_change":"2024-05-16T21:33:32.885941+0000","last_active":"2024-05-16T21:33:33.896711+0000","last_peered":"2024-05-16T21:33:33.896711+0000","last_clean":"2024-05-16T21:33:33.896711+0000","last_became_active":"2024-05-16T21:33:32.884608+0000","last_became_peered":"2024-05-16T21:33:32.884608+0000","last_unstale":"2024-05-16T21:33:33.896711+0000","last_undegraded":"2024-05-16T21:33:33.896711+0000","last_fullsized":"2024-05-16T21:33:33.896711+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:04:49.947660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881669+0000","last_change":"2024-05-16T21:33:31.881262+0000","last_active":"2024-05-16T21:33:33.881669+0000","last_peered":"2024-05-16T21:33:33.881669+0000","last_clean":"2024-05-16T21:33:33.881669+0000","last_became_active":"2024-05-16T21:33:31.880947+0000","last_became_peered":"2024-05-16T21:33:31.880947+0000","last_unstale":"2024-05-16T21:33:33.881669+0000","last_undegraded":"2024-05-16T21:33:33.881669+0000","last_fullsized":"2024-05-16T21:33:33.881669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:42:10.871789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.896702+0000","last_change":"2024-05-16T21:33:32.883549+0000","last_active":"2024-05-16T21:33:33.896702+0000","last_peered":"2024-05-16T21:33:33.896702+0000","last_clean":"2024-05-16T21:33:33.896702+0000","last_became_active":"2024-05-16T21:33:32.883198+0000","last_became_peered":"2024-05-16T21:33:32.883198+0000","last_unstale":"2024-05-16T21:33:33.896702+0000","last_undegraded":"2024-05-16T21:33:33.896702+0000","last_fullsized":"2024-05-16T21:33:33.896702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:58:02.917081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898980+0000","last_change":"2024-05-16T21:33:31.879474+0000","last_active":"2024-05-16T21:33:33.898980+0000","last_peered":"2024-05-16T21:33:33.898980+0000","last_clean":"2024-05-16T21:33:33.898980+0000","last_became_active":"2024-05-16T21:33:31.879088+0000","last_became_peered":"2024-05-16T21:33:31.879088+0000","last_unstale":"2024-05-16T21:33:33.898980+0000","last_undegraded":"2024-05-16T21:33:33.898980+0000","last_fullsized":"2024-05-16T21:33:33.898980+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:54:56.170072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881141+0000","last_change":"2024-05-16T21:33:32.876257+0000","last_active":"2024-05-16T21:33:33.881141+0000","last_peered":"2024-05-16T21:33:33.881141+0000","last_clean":"2024-05-16T21:33:33.881141+0000","last_became_active":"2024-05-16T21:33:32.875954+0000","last_became_peered":"2024-05-16T21:33:32.875954+0000","last_unstale":"2024-05-16T21:33:33.881141+0000","last_undegraded":"2024-05-16T21:33:33.881141+0000","last_fullsized":"2024-05-16T21:33:33.881141+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:56.433513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.879754+0000","last_change":"2024-05-16T21:33:31.871490+0000","last_active":"2024-05-16T21:33:33.879754+0000","last_peered":"2024-05-16T21:33:33.879754+0000","last_clean":"2024-05-16T21:33:33.879754+0000","last_became_active":"2024-05-16T21:33:31.871051+0000","last_became_peered":"2024-05-16T21:33:31.871051+0000","last_unstale":"2024-05-16T21:33:33.879754+0000","last_undegraded":"2024-05-16T21:33:33.879754+0000","last_fullsized":"2024-05-16T21:33:33.879754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:36:14.824513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.898772+0000","last_change":"2024-05-16T21:33:32.891847+0000","last_active":"2024-05-16T21:33:33.898772+0000","last_peered":"2024-05-16T21:33:33.898772+0000","last_clean":"2024-05-16T21:33:33.898772+0000","last_became_active":"2024-05-16T21:33:32.891425+0000","last_became_peered":"2024-05-16T21:33:32.891425+0000","last_unstale":"2024-05-16T21:33:33.898772+0000","last_undegraded":"2024-05-16T21:33:33.898772+0000","last_fullsized":"2024-05-16T21:33:33.898772+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:34:21.861374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.304181+0000","last_change":"2024-05-16T21:33:31.875526+0000","last_active":"2024-05-16T21:33:34.304181+0000","last_peered":"2024-05-16T21:33:34.304181+0000","last_clean":"2024-05-16T21:33:34.304181+0000","last_became_active":"2024-05-16T21:33:31.875184+0000","last_became_peered":"2024-05-16T21:33:31.875184+0000","last_unstale":"2024-05-16T21:33:34.304181+0000","last_undegraded":"2024-05-16T21:33:34.304181+0000","last_fullsized":"2024-05-16T21:33:34.304181+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:25:34.894892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:34.305079+0000","last_change":"2024-05-16T21:33:32.879417+0000","last_active":"2024-05-16T21:33:34.305079+0000","last_peered":"2024-05-16T21:33:34.305079+0000","last_clean":"2024-05-16T21:33:34.305079+0000","last_became_active":"2024-05-16T21:33:32.877892+0000","last_became_peered":"2024-05-16T21:33:32.877892+0000","last_unstale":"2024-05-16T21:33:34.305079+0000","last_undegraded":"2024-05-16T21:33:34.305079+0000","last_fullsized":"2024-05-16T21:33:34.305079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:31.851952+0000","last_clean_scrub_stamp":"2024-05-16T21:33:31.851952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:23:00.840173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881743+0000","last_change":"2024-05-16T21:33:31.872970+0000","last_active":"2024-05-16T21:33:33.881743+0000","last_peered":"2024-05-16T21:33:33.881743+0000","last_clean":"2024-05-16T21:33:33.881743+0000","last_became_active":"2024-05-16T21:33:31.872659+0000","last_became_peered":"2024-05-16T21:33:31.872659+0000","last_unstale":"2024-05-16T21:33:33.881743+0000","last_undegraded":"2024-05-16T21:33:33.881743+0000","last_fullsized":"2024-05-16T21:33:33.881743+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:33:30.846603+0000","last_clean_scrub_stamp":"2024-05-16T21:33:30.846603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:34:20.856025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":148,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-16T21:33:33.881013+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T21:33:33.881013+0000","last_peered":"2024-05-16T21:33:33.881013+0000","last_clean":"2024-05-16T21:33:33.881013+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T21:33:33.881013+0000","last_undegraded":"2024-05-16T21:33:33.881013+0000","last_fullsized":"2024-05-16T21:33:33.881013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":782333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":475136,"data_stored":186247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":185645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":479232,"data_stored":187187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":479232,"data_stored":186213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":495616,"data_stored":193509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":185645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1064960,"data_stored":775977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T21:33:37.325 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T21:33:37.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-16T21:33:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.478+0000 7f1e7c73f640 1 Processor -- start 2024-05-16T21:33:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.478+0000 7f1e7c73f640 1 -- start start 2024-05-16T21:33:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.479+0000 7f1e7c73f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e74151fc0 0x7f1e740bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.479+0000 7f1e7c73f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1e740bf050 0x7f1e74158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7c73f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e740c36f0 con 0x7f1e7406da30 2024-05-16T21:33:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7c73f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1e740bdc10 con 0x7f1e74151fc0 2024-05-16T21:33:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7c73f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1e74152530 con 0x7f1e740bf050 2024-05-16T21:33:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7a4db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e74151fc0 0x7f1e740bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e79cda640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e7406da30 0x7f1e740be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44228/0 (socket says 172.21.15.5:44228) 2024-05-16T21:33:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e79cda640 1 -- 172.21.15.5:0/2967544301 learned_addr learned my addr 172.21.15.5:0/2967544301 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7acdc640 1 --2- 172.21.15.5:0/2967544301 >> v2:172.21.15.157:3300/0 conn(0x7f1e740bf050 0x7f1e74158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7a4db640 1 -- 172.21.15.5:0/2967544301 >> v2:172.21.15.157:3300/0 conn(0x7f1e740bf050 msgr2=0x7f1e74158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7a4db640 1 --2- 172.21.15.5:0/2967544301 >> v2:172.21.15.157:3300/0 conn(0x7f1e740bf050 0x7f1e74158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7a4db640 1 -- 172.21.15.5:0/2967544301 >> v1:172.21.15.5:6789/0 conn(0x7f1e7406da30 legacy=0x7f1e740be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7a4db640 1 -- 172.21.15.5:0/2967544301 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e74152810 con 0x7f1e74151fc0 2024-05-16T21:33:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.480+0000 7f1e7acdc640 1 --2- 172.21.15.5:0/2967544301 >> v2:172.21.15.157:3300/0 conn(0x7f1e740bf050 0x7f1e74158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.481+0000 7f1e7a4db640 1 --2- 172.21.15.5:0/2967544301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74151fc0 0x7f1e740bd6d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1e740bf8f0 tx=0x7f1e6c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc8f79272c7e80d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.481+0000 7f1e794d9640 1 -- 172.21.15.5:0/2967544301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c037070 con 0x7f1e74151fc0 2024-05-16T21:33:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.481+0000 7f1e794d9640 1 -- 172.21.15.5:0/2967544301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e6c032440 con 0x7f1e74151fc0 2024-05-16T21:33:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.481+0000 7f1e794d9640 1 -- 172.21.15.5:0/2967544301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c032810 con 0x7f1e74151fc0 2024-05-16T21:33:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.481+0000 7f1e7c73f640 1 -- 172.21.15.5:0/2967544301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74151fc0 msgr2=0x7f1e740bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.481+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/2967544301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74151fc0 0x7f1e740bd6d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1e740bf8f0 tx=0x7f1e6c02a1a0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.482+0000 7f1e7c73f640 1 -- 172.21.15.5:0/2967544301 shutdown_connections 2024-05-16T21:33:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.482+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/2967544301 >> v2:172.21.15.157:3300/0 conn(0x7f1e740bf050 0x7f1e74158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.482+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/2967544301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74151fc0 0x7f1e740bd6d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.482+0000 7f1e7c73f640 1 -- 172.21.15.5:0/2967544301 >> 172.21.15.5:0/2967544301 conn(0x7f1e740c3d20 msgr2=0x7f1e740c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.482+0000 7f1e7c73f640 1 -- 172.21.15.5:0/2967544301 shutdown_connections 2024-05-16T21:33:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.482+0000 7f1e7c73f640 1 -- 172.21.15.5:0/2967544301 wait complete. 2024-05-16T21:33:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.483+0000 7f1e7c73f640 1 Processor -- start 2024-05-16T21:33:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.483+0000 7f1e7c73f640 1 -- start start 2024-05-16T21:33:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7c73f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7406da30 0x7f1e740b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7c73f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e740bf050 0x7f1e741e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7c73f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e74151fc0 0x7f1e7414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7c73f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1e740a3050 con 0x7f1e7406da30 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7c73f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1e740a2ed0 con 0x7f1e740bf050 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7c73f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1e7406de40 con 0x7f1e74151fc0 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7a4db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7406da30 0x7f1e740b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7a4db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7406da30 0x7f1e740b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46436/0 (socket says 172.21.15.5:46436) 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.484+0000 7f1e7a4db640 1 -- 172.21.15.5:0/753895249 learned_addr learned my addr 172.21.15.5:0/753895249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e7a4db640 1 -- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e74151fc0 msgr2=0x7f1e7414b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e7a4db640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e74151fc0 0x7f1e7414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e79cda640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e740bf050 0x7f1e741e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e7a4db640 1 -- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e740bf050 msgr2=0x7f1e741e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e7a4db640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e740bf050 0x7f1e741e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e7a4db640 1 -- 172.21.15.5:0/753895249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e740b7e00 con 0x7f1e7406da30 2024-05-16T21:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e79cda640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e740bf050 0x7f1e741e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e7a4db640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7406da30 0x7f1e740b78c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c000c00 tx=0x7f1e6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e72ffd640 1 -- 172.21.15.5:0/753895249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c037040 con 0x7f1e7406da30 2024-05-16T21:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e72ffd640 1 -- 172.21.15.5:0/753895249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e6c042070 con 0x7f1e7406da30 2024-05-16T21:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e72ffd640 1 -- 172.21.15.5:0/753895249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c030a50 con 0x7f1e7406da30 2024-05-16T21:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e741e7ff0 con 0x7f1e7406da30 2024-05-16T21:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.485+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e740b8ca0 con 0x7f1e7406da30 2024-05-16T21:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.486+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e74050940 con 0x7f1e7406da30 2024-05-16T21:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.487+0000 7f1e72ffd640 1 -- 172.21.15.5:0/753895249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e6c030bf0 con 0x7f1e7406da30 2024-05-16T21:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.487+0000 7f1e72ffd640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1e60076300 0x7f1e60078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.487+0000 7f1e72ffd640 1 -- 172.21.15.5:0/753895249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7f1e6c0b80a0 con 0x7f1e7406da30 2024-05-16T21:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.487+0000 7f1e79cda640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1e60076300 0x7f1e60078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.488+0000 7f1e79cda640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1e60076300 0x7f1e60078810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e740a4c00 tx=0x7f1e68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.492+0000 7f1e72ffd640 1 -- 172.21.15.5:0/753895249 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1e6c081a00 con 0x7f1e7406da30 2024-05-16T21:33:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.761+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1e7406eb40 con 0x7f1e7406da30 2024-05-16T21:33:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.764+0000 7f1e72ffd640 1 -- 172.21.15.5:0/753895249 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f1e6c081300 con 0x7f1e7406da30 2024-05-16T21:33:37.766 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-05-16T21:33:37.766 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAxe0ZmPwp5BBAApGZXcUeCgiYeu7NGIhsvXg== 2024-05-16T21:33:37.766 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-05-16T21:33:37.766 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-05-16T21:33:37.766 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-16T21:33:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-05-16T21:33:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1e60076300 msgr2=0x7f1e60078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1e60076300 0x7f1e60078810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e740a4c00 tx=0x7f1e68009040 comp rx=0 tx=0).stop 2024-05-16T21:33:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7406da30 msgr2=0x7f1e740b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7406da30 0x7f1e740b78c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c000c00 tx=0x7f1e6c0046c0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 shutdown_connections 2024-05-16T21:33:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1e60076300 0x7f1e60078810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e74151fc0 0x7f1e7414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e740bf050 0x7f1e741e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 --2- 172.21.15.5:0/753895249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7406da30 0x7f1e740b78c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 >> 172.21.15.5:0/753895249 conn(0x7f1e740c3d20 msgr2=0x7f1e740be840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 shutdown_connections 2024-05-16T21:33:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.766+0000 7f1e7c73f640 1 -- 172.21.15.5:0/753895249 wait complete. 2024-05-16T21:33:37.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:37.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.889+0000 7fb41ee5a640 1 Processor -- start 2024-05-16T21:33:37.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.890+0000 7fb41ee5a640 1 -- start start 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb41ee5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4180be4f0 0x7fb4180bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb41ee5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4180720d0 con 0x7fb41814cce0 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb41ee5a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4180bf6f0 con 0x7fb41814d0f0 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb41ee5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb4180bfa60 con 0x7fb4180be4f0 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb41cbf6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4180be4f0 0x7fb4180bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb417fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb41814cce0 0x7fb4180716a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44232/0 (socket says 172.21.15.5:44232) 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb417fff640 1 -- 172.21.15.5:0/3013816685 learned_addr learned my addr 172.21.15.5:0/3013816685 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb41cbf6640 1 -- 172.21.15.5:0/3013816685 >> v1:172.21.15.157:6789/0 conn(0x7fb41814d0f0 legacy=0x7fb418156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb41cbf6640 1 -- 172.21.15.5:0/3013816685 >> v1:172.21.15.5:6789/0 conn(0x7fb41814cce0 legacy=0x7fb4180716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.891+0000 7fb41cbf6640 1 -- 172.21.15.5:0/3013816685 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4180be900 con 0x7fb4180be4f0 2024-05-16T21:33:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.892+0000 7fb41cbf6640 1 --2- 172.21.15.5:0/3013816685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb4180bfef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb4180bfbe0 tx=0x7fb40002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25df14bb1a185933 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.892+0000 7fb4177fe640 1 -- 172.21.15.5:0/3013816685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400037070 con 0x7fb4180be4f0 2024-05-16T21:33:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.892+0000 7fb4177fe640 1 -- 172.21.15.5:0/3013816685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb400032440 con 0x7fb4180be4f0 2024-05-16T21:33:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.892+0000 7fb4177fe640 1 -- 172.21.15.5:0/3013816685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400032810 con 0x7fb4180be4f0 2024-05-16T21:33:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.893+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3013816685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 msgr2=0x7fb4180bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.893+0000 7fb41ee5a640 1 --2- 172.21.15.5:0/3013816685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb4180bfef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb4180bfbe0 tx=0x7fb40002a180 comp rx=0 tx=0).stop 2024-05-16T21:33:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.893+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3013816685 shutdown_connections 2024-05-16T21:33:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.893+0000 7fb41ee5a640 1 --2- 172.21.15.5:0/3013816685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb4180bfef0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.893+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3013816685 >> 172.21.15.5:0/3013816685 conn(0x7fb4180c17c0 msgr2=0x7fb4180c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.893+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3013816685 shutdown_connections 2024-05-16T21:33:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.893+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3013816685 wait complete. 2024-05-16T21:33:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.895+0000 7fb41ee5a640 1 Processor -- start 2024-05-16T21:33:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.895+0000 7fb41ee5a640 1 -- start start 2024-05-16T21:33:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41ee5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb41813f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41ee5a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb41814cce0 0x7fb418143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41ee5a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb41814d0f0 0x7fb41813e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41ee5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb4180723b0 con 0x7fb4180be4f0 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41ee5a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb418071310 con 0x7fb41814cce0 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41ee5a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb4180c0430 con 0x7fb41814d0f0 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41cbf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb41813f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41cbf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb41813f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46446/0 (socket says 172.21.15.5:46446) 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41cbf6640 1 -- 172.21.15.5:0/3854693047 learned_addr learned my addr 172.21.15.5:0/3854693047 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb417fff640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb41814cce0 0x7fb418143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.896+0000 7fb41d3f7640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb41814d0f0 0x7fb41813e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41cbf6640 1 -- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb41814d0f0 msgr2=0x7fb41813e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41cbf6640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb41814d0f0 0x7fb41813e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41cbf6640 1 -- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb41814cce0 msgr2=0x7fb418143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41cbf6640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb41814cce0 0x7fb418143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41cbf6640 1 -- 172.21.15.5:0/3854693047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb418143e70 con 0x7fb4180be4f0 2024-05-16T21:33:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41d3f7640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb41814d0f0 0x7fb41813e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41cbf6640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb41813f720 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb400000c00 tx=0x7fb4000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb4157fa640 1 -- 172.21.15.5:0/3854693047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400037040 con 0x7fb4180be4f0 2024-05-16T21:33:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb4157fa640 1 -- 172.21.15.5:0/3854693047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb400042070 con 0x7fb4180be4f0 2024-05-16T21:33:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41813ece0 con 0x7fb4180be4f0 2024-05-16T21:33:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb4157fa640 1 -- 172.21.15.5:0/3854693047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400030bd0 con 0x7fb4180be4f0 2024-05-16T21:33:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.897+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4180a3100 con 0x7fb4180be4f0 2024-05-16T21:33:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.898+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb41814be80 con 0x7fb4180be4f0 2024-05-16T21:33:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.899+0000 7fb4157fa640 1 -- 172.21.15.5:0/3854693047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb400047460 con 0x7fb4180be4f0 2024-05-16T21:33:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.899+0000 7fb4157fa640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb3f8076300 0x7fb3f8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.899+0000 7fb4157fa640 1 -- 172.21.15.5:0/3854693047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fb4000b8180 con 0x7fb4180be4f0 2024-05-16T21:33:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.900+0000 7fb417fff640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb3f8076300 0x7fb3f8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.900+0000 7fb417fff640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb3f8076300 0x7fb3f8078810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb4180a1300 tx=0x7fb408009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:37.904+0000 7fb4157fa640 1 -- 172.21.15.5:0/3854693047 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb41814be80 con 0x7fb4180be4f0 2024-05-16T21:33:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.137+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4180a2ef0 con 0x7fb4180be4f0 2024-05-16T21:33:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.138+0000 7fb4157fa640 1 -- 172.21.15.5:0/3854693047 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+4353 (secure 0 0 0) 0x7fb400032e20 con 0x7fb4180be4f0 2024-05-16T21:33:38.140 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:38.140 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:35.268817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1584346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1584346239},{"type":"v1","addr":"172.21.15.5:6835","nonce":1584346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5013,"qdb_cluster":[5013]},"id":3}]} 2024-05-16T21:33:38.140 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb3f8076300 msgr2=0x7fb3f8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb3f8076300 0x7fb3f8078810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb4180a1300 tx=0x7fb408009040 comp rx=0 tx=0).stop 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 msgr2=0x7fb41813f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb41813f720 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb400000c00 tx=0x7fb4000046c0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 shutdown_connections 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb3f8076300 0x7fb3f8078810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb41814d0f0 0x7fb41813e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb41814cce0 0x7fb418143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 --2- 172.21.15.5:0/3854693047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4180be4f0 0x7fb41813f720 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 >> 172.21.15.5:0/3854693047 conn(0x7fb4180c17c0 msgr2=0x7fb41814b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 shutdown_connections 2024-05-16T21:33:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.140+0000 7fb41ee5a640 1 -- 172.21.15.5:0/3854693047 wait complete. 2024-05-16T21:33:38.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T21:33:32.258682+0000', 'modified': '2024-05-16T21:33:35.268817+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5013}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5013': {'gid': 5013, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1584346239', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1584346239}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1584346239}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5013, 'qdb_cluster': [5013]} 2024-05-16T21:33:38.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-16T21:33:38.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-16T21:33:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.570+0000 7fb55d5ce640 1 Processor -- start 2024-05-16T21:33:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.570+0000 7fb55d5ce640 1 -- start start 2024-05-16T21:33:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb55d5ce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb558070f70 0x7fb558071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb55d5ce640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb5581519e0 0x7fb558151df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb55d5ce640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5580c01a0 con 0x7fb558148700 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb55d5ce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb55814f3b0 con 0x7fb558070f70 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb55d5ce640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb55814e5f0 con 0x7fb5581519e0 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb5567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb558070f70 0x7fb558071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb5567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb558070f70 0x7fb558071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46458/0 (socket says 172.21.15.5:46458) 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb5567fc640 1 -- 172.21.15.5:0/1542310366 learned_addr learned my addr 172.21.15.5:0/1542310366 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb5577fe640 1 --2- 172.21.15.5:0/1542310366 >> v2:172.21.15.157:3300/0 conn(0x7fb5581519e0 0x7fb558151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb5567fc640 1 -- 172.21.15.5:0/1542310366 >> v2:172.21.15.157:3300/0 conn(0x7fb5581519e0 msgr2=0x7fb558151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb5567fc640 1 --2- 172.21.15.5:0/1542310366 >> v2:172.21.15.157:3300/0 conn(0x7fb5581519e0 0x7fb558151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb5567fc640 1 -- 172.21.15.5:0/1542310366 >> v1:172.21.15.157:6789/0 conn(0x7fb558148700 legacy=0x7fb5580bfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.571+0000 7fb5567fc640 1 -- 172.21.15.5:0/1542310366 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55814e8d0 con 0x7fb558070f70 2024-05-16T21:33:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.572+0000 7fb5567fc640 1 --2- 172.21.15.5:0/1542310366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558070f70 0x7fb558071380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb5580bf620 tx=0x7fb54002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d848e0fbd3f504 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.572+0000 7fb555ffb640 1 -- 172.21.15.5:0/1542310366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540037070 con 0x7fb558070f70 2024-05-16T21:33:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.572+0000 7fb555ffb640 1 -- 172.21.15.5:0/1542310366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb540032440 con 0x7fb558070f70 2024-05-16T21:33:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.572+0000 7fb555ffb640 1 -- 172.21.15.5:0/1542310366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540032810 con 0x7fb558070f70 2024-05-16T21:33:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.573+0000 7fb55d5ce640 1 -- 172.21.15.5:0/1542310366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558070f70 msgr2=0x7fb558071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.573+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/1542310366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558070f70 0x7fb558071380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb5580bf620 tx=0x7fb54002a270 comp rx=0 tx=0).stop 2024-05-16T21:33:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.573+0000 7fb55d5ce640 1 -- 172.21.15.5:0/1542310366 shutdown_connections 2024-05-16T21:33:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.573+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/1542310366 >> v2:172.21.15.157:3300/0 conn(0x7fb5581519e0 0x7fb558151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.573+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/1542310366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558070f70 0x7fb558071380 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.573+0000 7fb55d5ce640 1 -- 172.21.15.5:0/1542310366 >> 172.21.15.5:0/1542310366 conn(0x7fb5580c1750 msgr2=0x7fb5580c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.573+0000 7fb55d5ce640 1 -- 172.21.15.5:0/1542310366 shutdown_connections 2024-05-16T21:33:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.573+0000 7fb55d5ce640 1 -- 172.21.15.5:0/1542310366 wait complete. 2024-05-16T21:33:38.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.575+0000 7fb55d5ce640 1 Processor -- start 2024-05-16T21:33:38.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.575+0000 7fb55d5ce640 1 -- start start 2024-05-16T21:33:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb55d5ce640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb558070f70 0x7fb5581e5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb55d5ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558148700 0x7fb5580bd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb55d5ce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5581519e0 0x7fb5580a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb55d5ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb558148b10 con 0x7fb558148700 2024-05-16T21:33:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb55d5ce640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb55814ee90 con 0x7fb558070f70 2024-05-16T21:33:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb55d5ce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb558071970 con 0x7fb5581519e0 2024-05-16T21:33:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558148700 0x7fb5580bd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558148700 0x7fb5580bd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46462/0 (socket says 172.21.15.5:46462) 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 -- 172.21.15.5:0/3633735163 learned_addr learned my addr 172.21.15.5:0/3633735163 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb558070f70 0x7fb5581e5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5577fe640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5581519e0 0x7fb5580a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 -- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5581519e0 msgr2=0x7fb5580a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5581519e0 0x7fb5580a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 -- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb558070f70 msgr2=0x7fb5581e5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb558070f70 0x7fb5581e5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 -- 172.21.15.5:0/3633735163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5580bd5b0 con 0x7fb558148700 2024-05-16T21:33:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb558070f70 0x7fb5581e5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558148700 0x7fb5580bd070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb540000c00 tx=0x7fb5400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb54f7fe640 1 -- 172.21.15.5:0/3633735163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540041020 con 0x7fb558148700 2024-05-16T21:33:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb54f7fe640 1 -- 172.21.15.5:0/3633735163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5400306c0 con 0x7fb558148700 2024-05-16T21:33:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb54f7fe640 1 -- 172.21.15.5:0/3633735163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540037040 con 0x7fb558148700 2024-05-16T21:33:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb55d5ce640 1 -- 172.21.15.5:0/3633735163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5580a7770 con 0x7fb558148700 2024-05-16T21:33:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.576+0000 7fb55d5ce640 1 -- 172.21.15.5:0/3633735163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5581e4720 con 0x7fb558148700 2024-05-16T21:33:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.578+0000 7fb54f7fe640 1 -- 172.21.15.5:0/3633735163 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb540044020 con 0x7fb558148700 2024-05-16T21:33:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.579+0000 7fb54f7fe640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb538076300 0x7fb538078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.579+0000 7fb54f7fe640 1 -- 172.21.15.5:0/3633735163 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fb5400b7d30 con 0x7fb558148700 2024-05-16T21:33:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.579+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb538076300 0x7fb538078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.579+0000 7fb564481740 1 Processor -- start 2024-05-16T21:33:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.580+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb538076300 0x7fb538078810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb550007fd0 tx=0x7fb550009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.580+0000 7fb564481740 1 -- start start 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb564481740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f7901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb564481740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 0x55bc4f754670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb564481740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f7852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb564481740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bc4f6caf10 con 0x55bc4f396590 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb564481740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55bc4f6baab0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb564481740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55bc4f6beaf0 con 0x55bc4f3b7270 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f7852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f7852a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46478/0 (socket says 172.21.15.5:46478) 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 -- 172.21.15.5:0/2204236390 learned_addr learned my addr 172.21.15.5:0/2204236390 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5567fc640 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 0x55bc4f754670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb556ffd640 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f7901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 -- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 msgr2=0x55bc4f7901b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f7901b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 -- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 msgr2=0x55bc4f754670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 0x55bc4f754670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 -- 172.21.15.5:0/2204236390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc4f67e5d0 con 0x55bc4f396590 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb556ffd640 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f7901b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb5577fe640 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f7852a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb548009fc0 tx=0x7fb5480077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c277b1297644ca76 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb54cff9640 1 -- 172.21.15.5:0/2204236390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5480147e0 con 0x55bc4f396590 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb54cff9640 1 -- 172.21.15.5:0/2204236390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54801a070 con 0x55bc4f396590 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.581+0000 7fb54cff9640 1 -- 172.21.15.5:0/2204236390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548014b80 con 0x55bc4f396590 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 -- 172.21.15.5:0/2204236390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 msgr2=0x55bc4f7852a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f7852a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb548009fc0 tx=0x7fb5480077c0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 -- 172.21.15.5:0/2204236390 shutdown_connections 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f7852a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 0x55bc4f754670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 --2- 172.21.15.5:0/2204236390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f7901b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 -- 172.21.15.5:0/2204236390 >> 172.21.15.5:0/2204236390 conn(0x55bc4f3ab3c0 msgr2=0x55bc4f78f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 -- 172.21.15.5:0/2204236390 shutdown_connections 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.582+0000 7fb564481740 1 -- 172.21.15.5:0/2204236390 wait complete. 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.583+0000 7fb564481740 1 -- start start 2024-05-16T21:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.583+0000 7fb564481740 1 Processor -- start 2024-05-16T21:33:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb564481740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 0x55bc4f777f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb564481740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f776920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb564481740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f776e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb564481740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bc4f3a0850 con 0x55bc4f396590 2024-05-16T21:33:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb564481740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55bc4f676c10 con 0x55bc4f38e3b0 2024-05-16T21:33:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb564481740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55bc4f755080 con 0x55bc4f3b7270 2024-05-16T21:33:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f776920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb564481740 10 client.0 _ll_register_callbacks cb 0x55bc4f67a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T21:33:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f776920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46490/0 (socket says 172.21.15.5:46490) 2024-05-16T21:33:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.584+0000 7fb5567fc640 1 -- 172.21.15.5:0/2943619535 learned_addr learned my addr 172.21.15.5:0/2943619535 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb556ffd640 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 0x55bc4f777f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb5577fe640 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f776e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb5567fc640 1 -- 172.21.15.5:0/2943619535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 msgr2=0x55bc4f776e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb5567fc640 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f776e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb5567fc640 1 -- 172.21.15.5:0/2943619535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 msgr2=0x55bc4f777f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb5567fc640 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 0x55bc4f777f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb5567fc640 1 -- 172.21.15.5:0/2943619535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc4f3cf2d0 con 0x55bc4f396590 2024-05-16T21:33:38.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb5567fc640 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f776920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb540080d20 tx=0x7fb5400815c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67dbf5f994aff14 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-05-16T21:33:38.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb535ffb640 1 -- 172.21.15.5:0/2943619535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540081020 con 0x55bc4f396590 2024-05-16T21:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb535ffb640 1 -- 172.21.15.5:0/2943619535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fb54007c990 con 0x55bc4f396590 2024-05-16T21:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb564481740 1 -- 172.21.15.5:0/2943619535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb54801a070 con 0x55bc4f396590 2024-05-16T21:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb535ffb640 1 -- 172.21.15.5:0/2943619535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5400853d0 con 0x55bc4f396590 2024-05-16T21:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb564481740 10 client.5136 fetch_fsmap learned FSMap version 25 2024-05-16T21:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb564481740 1 -- 172.21.15.5:0/2943619535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55bc4f4996b0 con 0x55bc4f396590 2024-05-16T21:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb535ffb640 1 -- 172.21.15.5:0/2943619535 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54801a070 con 0x55bc4f396590 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.585+0000 7fb535ffb640 1 -- 172.21.15.5:0/2943619535 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 2889+0+0 (secure 0 0 0) 0x7fb54003a030 con 0x55bc4f396590 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb564481740 10 client.5136 fetch_fsmap finished waiting for FSMap version 25 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb564481740 10 client.5136 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb564481740 20 client.5136 populate_metadata read hostname 'smithi005' 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb564481740 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] conn(0x55bc4f375e40 0x55bc4f786dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb564481740 4 client.5136 mds_command: new command op to 5013 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb564481740 1 -- 172.21.15.5:0/2943619535 --> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc4f6cce60 con 0x55bc4f375e40 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb556ffd640 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] conn(0x55bc4f375e40 0x55bc4f786dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb535ffb640 10 client.5136 ms_handle_connect on v2:172.21.15.5:6834/1584346239 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.586+0000 7fb556ffd640 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] conn(0x55bc4f375e40 0x55bc4f786dd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc8e27c9ff77511d server_cookie=4b125cfb98e4e6cd in_seq=0 out_seq=0 2024-05-16T21:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb535ffb640 1 -- 172.21.15.5:0/2943619535 <== mds.0 v2:172.21.15.5:6834/1584346239 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bc4f6cce60 con 0x55bc4f375e40 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb535ffb640 10 client.5136 handle_command_reply: tid=0 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 client.5136 shutdown 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 -- 172.21.15.5:0/2943619535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 msgr2=0x55bc4f776920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f776920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb540080d20 tx=0x7fb5400815c0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 -- 172.21.15.5:0/2943619535 shutdown_connections 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f776e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] conn(0x55bc4f375e40 0x55bc4f786dd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f396590 0x55bc4f776920 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 --2- 172.21.15.5:0/2943619535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f38e3b0 0x55bc4f777f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb535ffb640 0 client.5136 ms_handle_reset on v2:172.21.15.5:6834/1584346239 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 -- 172.21.15.5:0/2943619535 >> 172.21.15.5:0/2943619535 conn(0x55bc4f3ab3c0 msgr2=0x55bc4f758170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 -- 172.21.15.5:0/2943619535 shutdown_connections 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 1 -- 172.21.15.5:0/2943619535 wait complete. 2024-05-16T21:33:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.587+0000 7fb564481740 20 client.5136 trim_cache size 0 max 16384 2024-05-16T21:33:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.606+0000 7fb564481740 1 Processor -- start 2024-05-16T21:33:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.606+0000 7fb564481740 1 -- start start 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.607+0000 7fb564481740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f74f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.607+0000 7fb564481740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f396590 0x55bc4f7994e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.607+0000 7fb564481740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f78e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.607+0000 7fb564481740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581f11e0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.607+0000 7fb564481740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581e86b0 con 0x55bc4f396590 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.607+0000 7fb564481740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb5581f0290 con 0x55bc4f3b7270 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f74f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f74f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46504/0 (socket says 172.21.15.5:46504) 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 -- 172.21.15.5:0/4072601639 learned_addr learned my addr 172.21.15.5:0/4072601639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb5567fc640 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f396590 0x55bc4f7994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 -- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 msgr2=0x55bc4f78e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb5577fe640 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f78e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f78e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 -- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f396590 msgr2=0x55bc4f7994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f396590 0x55bc4f7994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 -- 172.21.15.5:0/4072601639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc4f6711d0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb5567fc640 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f396590 0x55bc4f7994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb556ffd640 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f74f360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb550005560 tx=0x7fb550012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01a480b3a7a2c30 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb537fff640 1 -- 172.21.15.5:0/4072601639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55002c070 con 0x55bc4f38e3b0 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb537fff640 1 -- 172.21.15.5:0/4072601639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5500035f0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.608+0000 7fb537fff640 1 -- 172.21.15.5:0/4072601639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5500037a0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 -- 172.21.15.5:0/4072601639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 msgr2=0x55bc4f74f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f74f360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb550005560 tx=0x7fb550012000 comp rx=0 tx=0).stop 2024-05-16T21:33:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 -- 172.21.15.5:0/4072601639 shutdown_connections 2024-05-16T21:33:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f3b7270 0x55bc4f78e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f396590 0x55bc4f7994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 --2- 172.21.15.5:0/4072601639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f74f360 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 -- 172.21.15.5:0/4072601639 >> 172.21.15.5:0/4072601639 conn(0x55bc4f3ab3c0 msgr2=0x55bc4f758110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 -- 172.21.15.5:0/4072601639 shutdown_connections 2024-05-16T21:33:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.609+0000 7fb564481740 1 -- 172.21.15.5:0/4072601639 wait complete. 2024-05-16T21:33:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.610+0000 7fb564481740 1 -- start start 2024-05-16T21:33:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.610+0000 7fb564481740 1 Processor -- start 2024-05-16T21:33:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb564481740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f79c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb564481740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f396590 0x55bc4f803000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb564481740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f3b7270 0x55bc4f803540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb564481740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bc4f777940 con 0x55bc4f38e3b0 2024-05-16T21:33:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb564481740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55bc4f7773a0 con 0x55bc4f3b7270 2024-05-16T21:33:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb564481740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55bc4f785e70 con 0x55bc4f396590 2024-05-16T21:33:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb564481740 10 client.0 _ll_register_callbacks cb 0x7fb540080970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T21:33:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f79c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f79c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46520/0 (socket says 172.21.15.5:46520) 2024-05-16T21:33:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 -- 172.21.15.5:0/3406325920 learned_addr learned my addr 172.21.15.5:0/3406325920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb5577fe640 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f3b7270 0x55bc4f803540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f396590 0x55bc4f803000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 -- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f396590 msgr2=0x55bc4f803000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f396590 0x55bc4f803000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 -- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f3b7270 msgr2=0x55bc4f803540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f3b7270 0x55bc4f803540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 -- 172.21.15.5:0/3406325920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc4f773d80 con 0x55bc4f38e3b0 2024-05-16T21:33:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f396590 0x55bc4f803000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f79c6d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb550007e60 tx=0x7fb550000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20813dcd87fcaa8b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.611+0000 7fb535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-05-16T21:33:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb535ffb640 1 -- 172.21.15.5:0/3406325920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550035060 con 0x55bc4f38e3b0 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb535ffb640 1 -- 172.21.15.5:0/3406325920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fb550010040 con 0x55bc4f38e3b0 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 1 -- 172.21.15.5:0/3406325920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5500035f0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb535ffb640 1 -- 172.21.15.5:0/3406325920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb55002c040 con 0x55bc4f38e3b0 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 10 client.5142 fetch_fsmap learned FSMap version 25 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 1 -- 172.21.15.5:0/3406325920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55bc4f7702b0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb535ffb640 1 -- 172.21.15.5:0/3406325920 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5500035f0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb535ffb640 1 -- 172.21.15.5:0/3406325920 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 2889+0+0 (secure 0 0 0) 0x7fb5500270e0 con 0x55bc4f38e3b0 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 10 client.5142 fetch_fsmap finished waiting for FSMap version 25 2024-05-16T21:33:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 10 client.5142 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-16T21:33:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 20 client.5142 populate_metadata read hostname 'smithi005' 2024-05-16T21:33:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] conn(0x55bc4f752cb0 0x55bc4f7530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 4 client.5142 mds_command: new command op to 5013 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-16T21:33:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb564481740 1 -- 172.21.15.5:0/3406325920 --> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] -- command(tid 0: {"prefix": "status"}) -- 0x55bc4f6c6640 con 0x55bc4f752cb0 2024-05-16T21:33:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] conn(0x55bc4f752cb0 0x55bc4f7530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.612+0000 7fb535ffb640 10 client.5142 ms_handle_connect on v2:172.21.15.5:6834/1584346239 2024-05-16T21:33:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] conn(0x55bc4f752cb0 0x55bc4f7530c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0d51c288b058f5f server_cookie=fafb24399025b8b3 in_seq=0 out_seq=0 2024-05-16T21:33:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb535ffb640 1 -- 172.21.15.5:0/3406325920 <== mds.0 v2:172.21.15.5:6834/1584346239 1 ==== command_reply(tid 0: 0 ) ==== 8+0+316 (crc 0 0 0) 0x55bc4f6c6640 con 0x55bc4f752cb0 2024-05-16T21:33:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb535ffb640 10 client.5142 handle_command_reply: tid=0 2024-05-16T21:33:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 client.5142 shutdown 2024-05-16T21:33:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 -- 172.21.15.5:0/3406325920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 msgr2=0x55bc4f79c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f79c6d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb550007e60 tx=0x7fb550000bc0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 -- 172.21.15.5:0/3406325920 shutdown_connections 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc4f3b7270 0x55bc4f803540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55bc4f396590 0x55bc4f803000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.5:6834/1584346239,v1:172.21.15.5:6835/1584346239] conn(0x55bc4f752cb0 0x55bc4f7530c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 --2- 172.21.15.5:0/3406325920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bc4f38e3b0 0x55bc4f79c6d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb535ffb640 0 client.5142 ms_handle_reset on v2:172.21.15.5:6834/1584346239 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 -- 172.21.15.5:0/3406325920 >> 172.21.15.5:0/3406325920 conn(0x55bc4f3ab3c0 msgr2=0x55bc4f7764c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 -- 172.21.15.5:0/3406325920 shutdown_connections 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 1 -- 172.21.15.5:0/3406325920 wait complete. 2024-05-16T21:33:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.613+0000 7fb564481740 20 client.5142 trim_cache size 0 max 16384 2024-05-16T21:33:38.625 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T21:33:38.625 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "4223c61e-038a-4696-b0eb-6b69d601e381", 2024-05-16T21:33:38.625 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-05-16T21:33:38.625 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5013, 2024-05-16T21:33:38.625 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-05-16T21:33:38.625 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-05-16T21:33:38.625 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-05-16T21:33:38.625 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.739617763, 2024-05-16T21:33:38.626 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 25, 2024-05-16T21:33:38.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 41, 2024-05-16T21:33:38.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 41, 2024-05-16T21:33:38.626 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.5534895 2024-05-16T21:33:38.626 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T21:33:38.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 -- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb538076300 msgr2=0x7fb538078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb538076300 0x7fb538078810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb550007fd0 tx=0x7fb550009040 comp rx=0 tx=0).stop 2024-05-16T21:33:38.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 -- 172.21.15.5:0/3633735163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558148700 msgr2=0x7fb5580bd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558148700 0x7fb5580bd070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb540000c00 tx=0x7fb5400046c0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 -- 172.21.15.5:0/3633735163 shutdown_connections 2024-05-16T21:33:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb538076300 0x7fb538078810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5581519e0 0x7fb5580a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb558148700 0x7fb5580bd070 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 --2- 172.21.15.5:0/3633735163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb558070f70 0x7fb5581e5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 -- 172.21.15.5:0/3633735163 >> 172.21.15.5:0/3633735163 conn(0x7fb5580c1750 msgr2=0x7fb558150e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 -- 172.21.15.5:0/3633735163 shutdown_connections 2024-05-16T21:33:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.614+0000 7fb55d5ce640 1 -- 172.21.15.5:0/3633735163 wait complete. 2024-05-16T21:33:38.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-16T21:33:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.738+0000 7fdee0786640 1 Processor -- start 2024-05-16T21:33:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.738+0000 7fdee0786640 1 -- start start 2024-05-16T21:33:38.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdee0786640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fded814e530 0x7fded80ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdee0786640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded80bd440 0x7fded80bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdee0786640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded80ba860 con 0x7fded80b8d70 2024-05-16T21:33:38.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdee0786640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fded80b88e0 con 0x7fded814e530 2024-05-16T21:33:38.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdee0786640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fded814ece0 con 0x7fded80bd440 2024-05-16T21:33:38.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdeddd21640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded80bd440 0x7fded80bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdede522640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fded814e530 0x7fded80ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdeddd21640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded80bd440 0x7fded80bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:47586/0 (socket says 172.21.15.5:47586) 2024-05-16T21:33:38.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.739+0000 7fdeddd21640 1 -- 172.21.15.5:0/2409323056 learned_addr learned my addr 172.21.15.5:0/2409323056 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:38.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.740+0000 7fdede522640 1 -- 172.21.15.5:0/2409323056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded80bd440 msgr2=0x7fded80bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:38.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.740+0000 7fdede522640 1 --2- 172.21.15.5:0/2409323056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded80bd440 0x7fded80bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.740+0000 7fdede522640 1 -- 172.21.15.5:0/2409323056 >> v1:172.21.15.157:6789/0 conn(0x7fded80b8d70 legacy=0x7fded80b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.740+0000 7fdede522640 1 -- 172.21.15.5:0/2409323056 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded80bdd90 con 0x7fded814e530 2024-05-16T21:33:38.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.740+0000 7fdeddd21640 1 --2- 172.21.15.5:0/2409323056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded80bd440 0x7fded80bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:33:38.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdede522640 1 --2- 172.21.15.5:0/2409323056 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded814e530 0x7fded80ba320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009de0 tx=0x7fdec802a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62f406e07a108c24 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdedd520640 1 -- 172.21.15.5:0/2409323056 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8007740 con 0x7fded814e530 2024-05-16T21:33:38.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdedd520640 1 -- 172.21.15.5:0/2409323056 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec80078e0 con 0x7fded814e530 2024-05-16T21:33:38.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdedd520640 1 -- 172.21.15.5:0/2409323056 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8007cb0 con 0x7fded814e530 2024-05-16T21:33:38.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdee0786640 1 -- 172.21.15.5:0/2409323056 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded814e530 msgr2=0x7fded80ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdee0786640 1 --2- 172.21.15.5:0/2409323056 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded814e530 0x7fded80ba320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009de0 tx=0x7fdec802a5b0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdee0786640 1 -- 172.21.15.5:0/2409323056 shutdown_connections 2024-05-16T21:33:38.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdee0786640 1 --2- 172.21.15.5:0/2409323056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded80bd440 0x7fded80bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdee0786640 1 --2- 172.21.15.5:0/2409323056 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded814e530 0x7fded80ba320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.741+0000 7fdee0786640 1 -- 172.21.15.5:0/2409323056 >> 172.21.15.5:0/2409323056 conn(0x7fded80c0570 msgr2=0x7fded80c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.742+0000 7fdee0786640 1 -- 172.21.15.5:0/2409323056 shutdown_connections 2024-05-16T21:33:38.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.742+0000 7fdee0786640 1 -- 172.21.15.5:0/2409323056 wait complete. 2024-05-16T21:33:38.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.743+0000 7fdee0786640 1 Processor -- start 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.743+0000 7fdee0786640 1 -- start start 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdee0786640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded80b8d70 0x7fded81467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdee0786640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded80bd440 0x7fded81e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdee0786640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded814e530 0x7fded814af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdee0786640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fded80bbb70 con 0x7fded80bd440 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdee0786640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fded814f2a0 con 0x7fded80b8d70 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdee0786640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fded814e940 con 0x7fded814e530 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdeddd21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded80bd440 0x7fded81e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdeddd21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded80bd440 0x7fded81e4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46528/0 (socket says 172.21.15.5:46528) 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdeddd21640 1 -- 172.21.15.5:0/3054425217 learned_addr learned my addr 172.21.15.5:0/3054425217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdede522640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded80b8d70 0x7fded81467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.744+0000 7fdeded23640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded814e530 0x7fded814af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdeddd21640 1 -- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded814e530 msgr2=0x7fded814af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdeddd21640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded814e530 0x7fded814af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdeddd21640 1 -- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded80b8d70 msgr2=0x7fded81467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdeddd21640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded80b8d70 0x7fded81467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdeddd21640 1 -- 172.21.15.5:0/3054425217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded8146d30 con 0x7fded80bd440 2024-05-16T21:33:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdeded23640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded814e530 0x7fded814af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdede522640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded80b8d70 0x7fded81467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdeddd21640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded80bd440 0x7fded81e4300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00e9e0 tx=0x7fdecc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fded6ffd640 1 -- 172.21.15.5:0/3054425217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc017070 con 0x7fded80bd440 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fded6ffd640 1 -- 172.21.15.5:0/3054425217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdecc00c9d0 con 0x7fded80bd440 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded81e4840 con 0x7fded80bd440 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fded6ffd640 1 -- 172.21.15.5:0/3054425217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00cd80 con 0x7fded80bd440 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.745+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded814a760 con 0x7fded80bd440 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.746+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded8050940 con 0x7fded80bd440 2024-05-16T21:33:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.747+0000 7fded6ffd640 1 -- 172.21.15.5:0/3054425217 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdecc01a070 con 0x7fded80bd440 2024-05-16T21:33:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.747+0000 7fded6ffd640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdec40762d0 0x7fdec40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.747+0000 7fded6ffd640 1 -- 172.21.15.5:0/3054425217 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fdecc0974d0 con 0x7fded80bd440 2024-05-16T21:33:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.747+0000 7fdede522640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdec40762d0 0x7fdec40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.748+0000 7fdede522640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdec40762d0 0x7fdec40787e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdec8034000 tx=0x7fdec802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.752+0000 7fded6ffd640 1 -- 172.21.15.5:0/3054425217 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fded8146d30 con 0x7fded80bd440 2024-05-16T21:33:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.982+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fded80c20b0 con 0x7fded80bd440 2024-05-16T21:33:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.982+0000 7fded6ffd640 1 -- 172.21.15.5:0/3054425217 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7fdecc060e30 con 0x7fded80bd440 2024-05-16T21:33:38.984 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-16T21:33:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdec40762d0 msgr2=0x7fdec40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdec40762d0 0x7fdec40787e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdec8034000 tx=0x7fdec802f000 comp rx=0 tx=0).stop 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded80bd440 msgr2=0x7fded81e4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded80bd440 0x7fded81e4300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00e9e0 tx=0x7fdecc00eea0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 shutdown_connections 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdec40762d0 0x7fdec40787e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fded814e530 0x7fded814af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded80bd440 0x7fded81e4300 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 --2- 172.21.15.5:0/3054425217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fded80b8d70 0x7fded81467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 >> 172.21.15.5:0/3054425217 conn(0x7fded80c0570 msgr2=0x7fded80a8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 shutdown_connections 2024-05-16T21:33:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:38.984+0000 7fdee0786640 1 -- 172.21.15.5:0/3054425217 wait complete. 2024-05-16T21:33:38.997 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-16T21:33:38.997 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-16T21:33:38.997 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-05-16T21:33:38.998 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-16T21:33:38.998 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:38.998 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-16T21:33:38.998 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-16T21:33:38.998 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-16T21:33:38.998 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T21:33:38.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:38.998 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-05-16T21:33:39.056 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-16T21:33:39.057 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-16T21:33:39.057 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-05-16T21:33:39.057 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:39.057 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-05-16T21:33:39.057 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:39.057 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:33:39.058 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:39.058 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-05-16T21:33:39.058 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:33:39.058 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:39.058 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-05-16T21:33:39.059 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T21:33:39.059 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:39.059 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-16T21:33:39.059 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:39.059 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-16T21:33:39.059 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42551sec preferred_lft 42551sec 2024-05-16T21:33:39.060 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-05-16T21:33:39.060 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:39.060 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-16T21:33:39.060 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 1e:b3:75:33:8c:51 brd ff:ff:ff:ff:ff:ff 2024-05-16T21:33:39.060 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-16T21:33:39.061 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:39.061 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::50bb:f9ff:fed5:1762/64 scope link 2024-05-16T21:33:39.061 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:39.061 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-16T21:33:39.061 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 1e:b3:75:33:8c:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-16T21:33:39.062 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::1cb3:75ff:fe33:8c51/64 scope link 2024-05-16T21:33:39.062 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-05-16T21:33:39.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:39.064 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-16T21:33:39.139 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-05-16T21:33:39.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:39.144 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-05-16T21:33:39.193 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-05-16T21:33:39.193 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-16T21:33:39.193 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-16T21:33:39.193 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-16T21:33:39.193 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-16T21:33:39.194 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T21:33:39.194 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-05-16T21:33:39.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-16T21:33:39.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-16T21:33:39.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-16T21:33:39.194 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-05-16T21:33:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T21:33:39.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:39.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:39.406 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-05-16T21:33:39.451 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-16T21:33:39.452 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T21:33:39.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:39.453 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-05-16T21:33:39.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T21:33:39.578 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:39.631 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-16T21:33:39.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T21:33:39.631 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:39.682 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-16T21:33:39.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:39.683 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:33:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:33:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:33:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:33:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:33:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:33:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:33:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-05-16T21:33:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T21:33:39.948 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T21:33:39.948 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T21:33:39.948 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-05-16T21:33:39.948 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-05-16T21:33:39.948 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T21:33:39.948 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.157:6789,172.21.15.157:6790" 2024-05-16T21:33:39.948 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.157:6789,172.21.15.157:6790:/ 2024-05-16T21:33:39.948 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4223c61e-038a-4696-b0eb-6b69d601e381" will pass to kernel 2024-05-16T21:33:39.950 INFO:teuthology.orchestra.run.smithi181.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-16T21:33:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: You just mounted a file system that supports labels which does not 2024-05-16T21:33:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-16T21:33:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: applications will generate AVC messages and not be allowed access to 2024-05-16T21:33:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-16T21:33:39.954 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-16T21:33:39.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:39.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:40.027 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T21:33:40.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:40.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:40.148 INFO:teuthology.orchestra.run.smithi181.stdout:client4799 2024-05-16T21:33:40.148 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:33:40.148 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:33:40.200 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt --help') 2024-05-16T21:33:40.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:40.401 INFO:teuthology.orchestra.run.smithi181.stdout:fscrypt - A tool for managing Linux native filesystem encryption 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout:Usage: 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: fscrypt COMMAND [arguments] [options] 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout:Commands: 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: setup - perform global setup or filesystem setup 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: encrypt - enable filesystem encryption for a directory 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: unlock - unlock an encrypted directory 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: lock - lock an encrypted directory 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: purge - Remove a filesystem's keys 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: status - print the global, filesystem, or file status 2024-05-16T21:33:40.402 INFO:teuthology.orchestra.run.smithi181.stdout: metadata - [ADVANCED] manipulate the policy or protector metadata 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout:Options: 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: --verbose Prints additional debug messages to standard 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: output. 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: --quiet Prints nothing to standard output except for 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: errors. Selects the default for any options that 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: would normally show a prompt. 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: --help Prints help screen for commands and subcommands. 2024-05-16T21:33:40.403 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:40.415 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --help') 2024-05-16T21:33:40.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout:fscrypt setup - perform global setup or filesystem setup 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout:Usage: 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout: fscrypt setup [MOUNTPOINT] [options] 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout:Description: 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout: This command creates fscrypt's global config file and/or prepares a filesystem 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout: for use with fscrypt. 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.560 INFO:teuthology.orchestra.run.smithi181.stdout: (1) When used without MOUNTPOINT, this command creates the global config file 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: /etc/fscrypt.conf and the fscrypt metadata directory for the root filesystem 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: (i.e. /.fscrypt). This requires root privileges. The passphrase hashing 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: parameters in /etc/fscrypt.conf are automatically set to an appropriate 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: hardness, as determined by --time=TIME. The root filesystem's metadata 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: directory is created even if the root filesystem doesn't support encryption 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: itself, since it's where login passphrase protectors are stored. 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: (2) When used with MOUNTPOINT, this command creates the fscrypt metadata 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: directory for the filesystem mounted at MOUNTPOINT. This allows fscrypt to be 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: used on that filesystem, provided that any kernel and filesystem-specific 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: prerequisites are also met (see the README). This may require root privileges. 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout:Options: 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: --time=TIME Set the global options so that passphrase hashing 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: takes TIME long. TIME should be formatted as a 2024-05-16T21:33:40.561 INFO:teuthology.orchestra.run.smithi181.stdout: sequence of decimal numbers, each with optional 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: fraction and a unit suffix, such as "300ms", 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: "1.5s" or "2h45m". Valid time units are "ms", 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: "s", "m", and "h". (default: 1s) 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: --force Suppresses all confirmation prompts and warnings, 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: causing any action to automatically proceed. 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: WARNING: This bypasses confirmations for 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: protective operations, use with care. 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: --all-users When setting up a filesystem for fscrypt, allow 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: users other than the calling user (typically 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: root) to create fscrypt policies and protectors 2024-05-16T21:33:40.562 INFO:teuthology.orchestra.run.smithi181.stdout: on the filesystem. Note that this will create a 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: world-writable directory, which users could use 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: to fill up the entire filesystem. Hence, this 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: option may not be appropriate for some systems. 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: --verbose Prints additional debug messages to standard 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: output. 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: --quiet Prints nothing to standard output except for 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: errors. Selects the default for any options that 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: would normally show a prompt. 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: --help Prints help screen for commands and subcommands. 2024-05-16T21:33:40.563 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:40.572 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --force --quiet') 2024-05-16T21:33:40.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:43.732 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-16T21:33:43.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:43.857 INFO:teuthology.orchestra.run.smithi181.stdout:filesystems supporting encryption: 0 2024-05-16T21:33:43.857 INFO:teuthology.orchestra.run.smithi181.stdout:filesystems with fscrypt metadata: 1 2024-05-16T21:33:43.858 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:43.858 INFO:teuthology.orchestra.run.smithi181.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-16T21:33:43.858 INFO:teuthology.orchestra.run.smithi181.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-16T21:33:43.858 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-16T21:33:43.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:43.869 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-16T21:33:43.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:44.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:44.020 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-16T21:33:44.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:44.156 INFO:teuthology.orchestra.run.smithi181.stdout:filesystems supporting encryption: 1 2024-05-16T21:33:44.156 INFO:teuthology.orchestra.run.smithi181.stdout:filesystems with fscrypt metadata: 2 2024-05-16T21:33:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-16T21:33:44.156 INFO:teuthology.orchestra.run.smithi181.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-16T21:33:44.157 INFO:teuthology.orchestra.run.smithi181.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-16T21:33:44.157 INFO:teuthology.orchestra.run.smithi181.stdout:/home/ubuntu/cephtest/mnt.0 ceph supported Yes 2024-05-16T21:33:44.157 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-16T21:33:44.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:44.169 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo dd if=/dev/urandom of=/tmp/key bs=32 count=1') 2024-05-16T21:33:44.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:44.292 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-16T21:33:44.292 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-16T21:33:44.292 INFO:teuthology.orchestra.run.smithi181.stderr:32 bytes copied, 0.000197519 s, 162 kB/s 2024-05-16T21:33:44.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:44.304 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p dir/') 2024-05-16T21:33:44.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:44.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:44.415 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt encrypt --quiet --source=raw_key --name=zPMgkEcn --no-recovery --skip-unlock --key=/tmp/key dir/') 2024-05-16T21:33:44.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:44.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:44.600 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt unlock --quiet --key=/tmp/key dir/') 2024-05-16T21:33:44.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:44.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:44.748 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'cd dir/ && dd if=/dev/urandom of=wwlHWmKjTiURobIdNjLZvhTDFnljUgHaSBCvRppADROOquZoOiGyoAkyUDRVdRitDKFCgyUHNXhFnRBZzqMgXTaxXjWOXoWrBNydjqaACcQBeFsmbqzcaHbghjvecRcZdUBfTsRqHaQzlPWoEuVqtFcjotqzQonBthahzWHGegBewbpjvIZcjlHlxHHhJexnmNhFruhLINcUDdfffkqcPHYTvrfRUixUYEYPKYhwHKFbdtARFrEwmZOImqoqeqU bs=512 count=1 && stat wwlHWmKjTiURobIdNjLZvhTDFnljUgHaSBCvRppADROOquZoOiGyoAkyUDRVdRitDKFCgyUHNXhFnRBZzqMgXTaxXjWOXoWrBNydjqaACcQBeFsmbqzcaHbghjvecRcZdUBfTsRqHaQzlPWoEuVqtFcjotqzQonBthahzWHGegBewbpjvIZcjlHlxHHhJexnmNhFruhLINcUDdfffkqcPHYTvrfRUixUYEYPKYhwHKFbdtARFrEwmZOImqoqeqU') 2024-05-16T21:33:44.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:44.850 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-16T21:33:44.850 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-16T21:33:44.850 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000162434 s, 3.2 MB/s 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout: File: wwlHWmKjTiURobIdNjLZvhTDFnljUgHaSBCvRppADROOquZoOiGyoAkyUDRVdRitDKFCgyUHNXhFnRBZzqMgXTaxXjWOXoWrBNydjqaACcQBeFsmbqzcaHbghjvecRcZdUBfTsRqHaQzlPWoEuVqtFcjotqzQonBthahzWHGegBewbpjvIZcjlHlxHHhJexnmNhFruhLINcUDdfffkqcPHYTvrfRUixUYEYPKYhwHKFbdtARFrEwmZOImqoqeqU 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 512 Blocks: 1 IO Block: 4096 regular file 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 28h/40d Inode: 1099511628283 Links: 1 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0644/-rw-r--r--) Uid: ( 1000/ ubuntu) Gid: ( 1316/ ubuntu) 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout:Context: unconfined_u:object_r:unlabeled_t:s0 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-16 21:33:44.847081320 +0000 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-16 21:33:44.849081282 +0000 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-16 21:33:44.849081282 +0000 2024-05-16T21:33:44.853 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-05-16 21:33:44.847081320 +0000 2024-05-16T21:33:44.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:44.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:44.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.986+0000 7fb90ba9f640 1 Processor -- start 2024-05-16T21:33:44.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.987+0000 7fb90ba9f640 1 -- start start 2024-05-16T21:33:44.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90ba9f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a2820 0x7fb9040bb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:44.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90ba9f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9041462b0 0x7fb90414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:44.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90ba9f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9040a40b0 con 0x7fb9040a3bd0 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90ba9f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb9040a49e0 con 0x7fb9041462b0 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90ba9f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb9040a4390 con 0x7fb9040a2820 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90a03c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9041462b0 0x7fb90414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90903a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb9040a3bd0 0x7fb9040bc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44240/0 (socket says 172.21.15.5:44240) 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90903a640 1 -- 172.21.15.5:0/3014824105 learned_addr learned my addr 172.21.15.5:0/3014824105 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90983b640 1 --2- 172.21.15.5:0/3014824105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a2820 0x7fb9040bb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90a03c640 1 -- 172.21.15.5:0/3014824105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a2820 msgr2=0x7fb9040bb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90a03c640 1 --2- 172.21.15.5:0/3014824105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a2820 0x7fb9040bb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90a03c640 1 -- 172.21.15.5:0/3014824105 >> v1:172.21.15.5:6789/0 conn(0x7fb9040a3bd0 legacy=0x7fb9040bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb90a03c640 1 -- 172.21.15.5:0/3014824105 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9040a4670 con 0x7fb9041462b0 2024-05-16T21:33:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.988+0000 7fb908839640 1 -- 172.21.15.5:0/3014824105 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2697689699 0 0) 0x7fb9040a40b0 con 0x7fb9040a3bd0 2024-05-16T21:33:44.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.989+0000 7fb90a03c640 1 --2- 172.21.15.5:0/3014824105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9041462b0 0x7fb90414fa20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009d90 tx=0x7fb8f402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4ab26510e29613 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.989+0000 7fb908839640 1 -- 172.21.15.5:0/3014824105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4007740 con 0x7fb9041462b0 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.989+0000 7fb908839640 1 -- 172.21.15.5:0/3014824105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f40078e0 con 0x7fb9041462b0 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.989+0000 7fb908839640 1 -- 172.21.15.5:0/3014824105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4007cb0 con 0x7fb9041462b0 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.990+0000 7fb90ba9f640 1 -- 172.21.15.5:0/3014824105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9041462b0 msgr2=0x7fb90414fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.990+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/3014824105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9041462b0 0x7fb90414fa20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009d90 tx=0x7fb8f402a680 comp rx=0 tx=0).stop 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.990+0000 7fb90ba9f640 1 -- 172.21.15.5:0/3014824105 shutdown_connections 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.990+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/3014824105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9041462b0 0x7fb90414fa20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.990+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/3014824105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a2820 0x7fb9040bb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.990+0000 7fb90ba9f640 1 -- 172.21.15.5:0/3014824105 >> 172.21.15.5:0/3014824105 conn(0x7fb9040a1ac0 msgr2=0x7fb9040bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.990+0000 7fb90ba9f640 1 -- 172.21.15.5:0/3014824105 shutdown_connections 2024-05-16T21:33:44.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.990+0000 7fb90ba9f640 1 -- 172.21.15.5:0/3014824105 wait complete. 2024-05-16T21:33:44.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.992+0000 7fb90ba9f640 1 Processor -- start 2024-05-16T21:33:44.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.992+0000 7fb90ba9f640 1 -- start start 2024-05-16T21:33:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90ba9f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9040a2820 0x7fb9041e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90ba9f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a3bd0 0x7fb9040b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90ba9f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9041462b0 0x7fb90413b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90ba9f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9041468d0 con 0x7fb9040a2820 2024-05-16T21:33:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90ba9f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb90414ff60 con 0x7fb9041462b0 2024-05-16T21:33:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90ba9f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb9041e7fb0 con 0x7fb9040a3bd0 2024-05-16T21:33:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90983b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9040a2820 0x7fb9041e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90983b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9040a2820 0x7fb9041e75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46548/0 (socket says 172.21.15.5:46548) 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90983b640 1 -- 172.21.15.5:0/4241484060 learned_addr learned my addr 172.21.15.5:0/4241484060 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90903a640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a3bd0 0x7fb9040b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90a03c640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9041462b0 0x7fb90413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90983b640 1 -- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a3bd0 msgr2=0x7fb9040b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90983b640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a3bd0 0x7fb9040b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90983b640 1 -- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9041462b0 msgr2=0x7fb90413b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90983b640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9041462b0 0x7fb90413b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90983b640 1 -- 172.21.15.5:0/4241484060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9040b6f00 con 0x7fb9040a2820 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90903a640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a3bd0 0x7fb9040b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.993+0000 7fb90a03c640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9041462b0 0x7fb90413b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.994+0000 7fb90983b640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9040a2820 0x7fb9041e75e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00e870 tx=0x7fb8fc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.994+0000 7fb9027fc640 1 -- 172.21.15.5:0/4241484060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc017070 con 0x7fb9040a2820 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.994+0000 7fb9027fc640 1 -- 172.21.15.5:0/4241484060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc00c940 con 0x7fb9040a2820 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.994+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9040b4ff0 con 0x7fb9040a2820 2024-05-16T21:33:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.994+0000 7fb9027fc640 1 -- 172.21.15.5:0/4241484060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00cd30 con 0x7fb9040a2820 2024-05-16T21:33:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.994+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9040b55b0 con 0x7fb9040a2820 2024-05-16T21:33:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.995+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9040bbc60 con 0x7fb9040a2820 2024-05-16T21:33:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.996+0000 7fb9027fc640 1 -- 172.21.15.5:0/4241484060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8fc01a070 con 0x7fb9040a2820 2024-05-16T21:33:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.996+0000 7fb9027fc640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb8f0076300 0x7fb8f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.996+0000 7fb9027fc640 1 -- 172.21.15.5:0/4241484060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fb8fc097460 con 0x7fb9040a2820 2024-05-16T21:33:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.997+0000 7fb90903a640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb8f0076300 0x7fb8f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:44.997+0000 7fb90903a640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb8f0076300 0x7fb8f0078810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000f60 tx=0x7fb8f8007d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.001+0000 7fb9027fc640 1 -- 172.21.15.5:0/4241484060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb8fc060dc0 con 0x7fb9040a2820 2024-05-16T21:33:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.233+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb904050940 con 0x7fb9040a2820 2024-05-16T21:33:45.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.234+0000 7fb9027fc640 1 -- 172.21.15.5:0/4241484060 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+4353 (secure 0 0 0) 0x7fb8fc0606c0 con 0x7fb9040a2820 2024-05-16T21:33:45.236 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:45.237 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:35.268817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1584346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1584346239},{"type":"v1","addr":"172.21.15.5:6835","nonce":1584346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5013,"qdb_cluster":[5013]},"id":3}]} 2024-05-16T21:33:45.237 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-05-16T21:33:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb8f0076300 msgr2=0x7fb8f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb8f0076300 0x7fb8f0078810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000f60 tx=0x7fb8f8007d00 comp rx=0 tx=0).stop 2024-05-16T21:33:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9040a2820 msgr2=0x7fb9041e75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9040a2820 0x7fb9041e75e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00e870 tx=0x7fb8fc00ed30 comp rx=0 tx=0).stop 2024-05-16T21:33:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 shutdown_connections 2024-05-16T21:33:45.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb8f0076300 0x7fb8f0078810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9041462b0 0x7fb90413b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9040a3bd0 0x7fb9040b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 --2- 172.21.15.5:0/4241484060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9040a2820 0x7fb9041e75e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 >> 172.21.15.5:0/4241484060 conn(0x7fb9040a1ac0 msgr2=0x7fb90406e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 shutdown_connections 2024-05-16T21:33:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.236+0000 7fb90ba9f640 1 -- 172.21.15.5:0/4241484060 wait complete. 2024-05-16T21:33:45.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:45.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.360+0000 7fb535015640 1 Processor -- start 2024-05-16T21:33:45.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.360+0000 7fb535015640 1 -- start start 2024-05-16T21:33:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb535015640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5300bd440 0x7fb5300bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb535015640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 0x7fb5300b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb535015640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5300bdd90 con 0x7fb53014e530 2024-05-16T21:33:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb535015640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb5300b88e0 con 0x7fb5300bd440 2024-05-16T21:33:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb535015640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb53014ece0 con 0x7fb5300b8d70 2024-05-16T21:33:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5300bd440 0x7fb5300bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb53014e530 0x7fb5300ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44254/0 (socket says 172.21.15.5:44254) 2024-05-16T21:33:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5300bd440 0x7fb5300bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46556/0 (socket says 172.21.15.5:46556) 2024-05-16T21:33:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52ed9d640 1 -- 172.21.15.5:0/2884501913 learned_addr learned my addr 172.21.15.5:0/2884501913 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52f59e640 1 --2- 172.21.15.5:0/2884501913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 0x7fb5300b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52e59c640 1 -- 172.21.15.5:0/2884501913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 msgr2=0x7fb5300b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52e59c640 1 --2- 172.21.15.5:0/2884501913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 0x7fb5300b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52e59c640 1 -- 172.21.15.5:0/2884501913 >> v1:172.21.15.5:6789/0 conn(0x7fb53014e530 legacy=0x7fb5300ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52e59c640 1 -- 172.21.15.5:0/2884501913 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53014efc0 con 0x7fb5300bd440 2024-05-16T21:33:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.361+0000 7fb52dd9b640 1 -- 172.21.15.5:0/2884501913 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274706957 0 0) 0x7fb5300bdd90 con 0x7fb53014e530 2024-05-16T21:33:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.362+0000 7fb52e59c640 1 --2- 172.21.15.5:0/2884501913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5300bd440 0x7fb5300bd850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb5240097a0 tx=0x7fb52402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808176b9652f4bd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.362+0000 7fb52dd9b640 1 -- 172.21.15.5:0/2884501913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524037070 con 0x7fb5300bd440 2024-05-16T21:33:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.362+0000 7fb52dd9b640 1 -- 172.21.15.5:0/2884501913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb524032440 con 0x7fb5300bd440 2024-05-16T21:33:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.362+0000 7fb52dd9b640 1 -- 172.21.15.5:0/2884501913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524032810 con 0x7fb5300bd440 2024-05-16T21:33:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.363+0000 7fb535015640 1 -- 172.21.15.5:0/2884501913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5300bd440 msgr2=0x7fb5300bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.363+0000 7fb535015640 1 --2- 172.21.15.5:0/2884501913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5300bd440 0x7fb5300bd850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb5240097a0 tx=0x7fb52402a180 comp rx=0 tx=0).stop 2024-05-16T21:33:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.363+0000 7fb535015640 1 -- 172.21.15.5:0/2884501913 shutdown_connections 2024-05-16T21:33:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.363+0000 7fb535015640 1 --2- 172.21.15.5:0/2884501913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 0x7fb5300b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.363+0000 7fb535015640 1 --2- 172.21.15.5:0/2884501913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5300bd440 0x7fb5300bd850 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.363+0000 7fb535015640 1 -- 172.21.15.5:0/2884501913 >> 172.21.15.5:0/2884501913 conn(0x7fb5300c0570 msgr2=0x7fb5300c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:45.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.363+0000 7fb535015640 1 -- 172.21.15.5:0/2884501913 shutdown_connections 2024-05-16T21:33:45.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.363+0000 7fb535015640 1 -- 172.21.15.5:0/2884501913 wait complete. 2024-05-16T21:33:45.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.365+0000 7fb535015640 1 Processor -- start 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.365+0000 7fb535015640 1 -- start start 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb535015640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 0x7fb5301e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb535015640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5300bd440 0x7fb530151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb535015640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb53014e530 0x7fb53013dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb535015640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300b96c0 con 0x7fb53014e530 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb535015640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300bbb70 con 0x7fb5300bd440 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb535015640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb53014e940 con 0x7fb5300b8d70 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb53014e530 0x7fb53013dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb53014e530 0x7fb53013dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46564/0 (socket says 172.21.15.5:46564) 2024-05-16T21:33:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52f59e640 1 -- 172.21.15.5:0/3840777686 learned_addr learned my addr 172.21.15.5:0/3840777686 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52e59c640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5300bd440 0x7fb530151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52ed9d640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 0x7fb5301e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52f59e640 1 -- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 msgr2=0x7fb5301e4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52f59e640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 0x7fb5301e4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52f59e640 1 -- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5300bd440 msgr2=0x7fb530151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52f59e640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5300bd440 0x7fb530151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52f59e640 1 -- 172.21.15.5:0/3840777686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5301e40a0 con 0x7fb53014e530 2024-05-16T21:33:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.366+0000 7fb52e59c640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5300bd440 0x7fb530151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.367+0000 7fb52f59e640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb53014e530 0x7fb53013dbc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb52800ef90 tx=0x7fb52800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.367+0000 7fb5177fe640 1 -- 172.21.15.5:0/3840777686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528018020 con 0x7fb53014e530 2024-05-16T21:33:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.367+0000 7fb5177fe640 1 -- 172.21.15.5:0/3840777686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb528014480 con 0x7fb53014e530 2024-05-16T21:33:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.367+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb530150200 con 0x7fb53014e530 2024-05-16T21:33:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.367+0000 7fb5177fe640 1 -- 172.21.15.5:0/3840777686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528009e60 con 0x7fb53014e530 2024-05-16T21:33:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.367+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb530147a20 con 0x7fb53014e530 2024-05-16T21:33:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.368+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53013e710 con 0x7fb53014e530 2024-05-16T21:33:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.368+0000 7fb5177fe640 1 -- 172.21.15.5:0/3840777686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb528005d10 con 0x7fb53014e530 2024-05-16T21:33:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.369+0000 7fb5177fe640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb51c076300 0x7fb51c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.369+0000 7fb5177fe640 1 -- 172.21.15.5:0/3840777686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fb528098430 con 0x7fb53014e530 2024-05-16T21:33:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.369+0000 7fb52ed9d640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb51c076300 0x7fb51c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.370+0000 7fb52ed9d640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb51c076300 0x7fb51c078810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb520001580 tx=0x7fb520009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:45.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.374+0000 7fb5177fe640 1 -- 172.21.15.5:0/3840777686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb528022030 con 0x7fb53014e530 2024-05-16T21:33:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.602+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb53014ff90 con 0x7fb53014e530 2024-05-16T21:33:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.603+0000 7fb5177fe640 1 -- 172.21.15.5:0/3840777686 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+4353 (secure 0 0 0) 0x7fb528010040 con 0x7fb53014e530 2024-05-16T21:33:45.605 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:45.605 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:35.268817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1584346239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1584346239},{"type":"v1","addr":"172.21.15.5:6835","nonce":1584346239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5013,"qdb_cluster":[5013]},"id":3}]} 2024-05-16T21:33:45.605 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb51c076300 msgr2=0x7fb51c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb51c076300 0x7fb51c078810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb520001580 tx=0x7fb520009040 comp rx=0 tx=0).stop 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb53014e530 msgr2=0x7fb53013dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb53014e530 0x7fb53013dbc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb52800ef90 tx=0x7fb52800c490 comp rx=0 tx=0).stop 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 shutdown_connections 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb51c076300 0x7fb51c078810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb53014e530 0x7fb53013dbc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5300bd440 0x7fb530151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 --2- 172.21.15.5:0/3840777686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5300b8d70 0x7fb5301e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 >> 172.21.15.5:0/3840777686 conn(0x7fb5300c0570 msgr2=0x7fb530068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 shutdown_connections 2024-05-16T21:33:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.605+0000 7fb535015640 1 -- 172.21.15.5:0/3840777686 wait complete. 2024-05-16T21:33:45.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /dir 0 2024-05-16T21:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:[{"ino":1099511627780,"rdev":0,"ctime":"2024-05-16T21:33:44.402089+0000","btime":"2024-05-16T21:33:44.402089+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-05-16T21:33:44.402089+0000","atime":"2024-05-16T21:33:44.402089+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":16,"file_data_version":0,"xattr_version":1,"backtrace_version":14,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":3,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":1,"lock":7,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":13,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":2,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","type":"isnap","is_leased":false,"num_rdlocks":2,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{"gather_set":[],"state":"sync","type":"ipolicy","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":2,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4799,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":5}],"loner":4799,"want_loner":4799,"mds_caps_wanted":[],"dirfrags":[{"path":"/dir","dirfrag":"0x10000000004","snapid_first":2,"projected_version":"3","version":"1","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":1},"nref":3,"dentries":[{"path":"dir/,UJ3QOBRlPDBWmwmFzZClQH6lt08omFv7vAY,Hty0qptAZ6Ukw2RZDgvZyxkOfbSIjjkAsFKgVWGg7rGo3AAep+ZxZD3nZPL9QBH1Y1MRpFqrHfxZWIwAFUSdsf1swu6hOi1Fx0UTM+IbDndD5dG20hLYv0CxS5XMC+nI4t64+FDkPANiVRue1ZD72O1CStyLgAEDBDa1,ObAQFrN+e+3DrFhPrjtwr7+qw50BjBdcmrBQXL","alternate_name":"/UJ3QOBRlPDBWmwmFzZClQH6lt08omFv7vAY/Hty0qptAZ6Ukw2RZDgvZyxkOfbSIjjkAsFKgVWGg7rGo3AAep+ZxZD3nZPL9QBH1Y1MRpFqrHfxZWIwAFUSdsf1swu6hOi1Fx0UTM+IbDndD5dG20hLYv0CxS5XMC+nI4t64+FDkPANiVRue1ZD72O1CStyLgAEDGCDNZ1MLuhlim9BhyMxDHntD6CPJp6OgK7MSnwiXG5oMgE+4TN4BDeKR4/X2X9Q8VhJeXAqt4BsGjRl3p0mqeMkHzpHu9fXVu0Cb0fuKo35i90KlMqsu+2jnQivzOK30H+SXrzNH2oqds5A","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":false,"is_remote":false,"is_null":true,"is_new":false,"inode":0,"remote_type":"","version":1,"projected_version":2,"auth_pins":2,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":2,"authpin":1},"nref":4,"lock":{"gather_set":[],"state":"xlockdone","type":"dn","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"states":["auth"]}]}],"is_subvolume":false}] 2024-05-16T21:33:45.745 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-05-16T21:33:44.402089+0000", "auth_pins": 3, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "type": "iauth", "xlock_by": {} }, "backtrace_version": 14, "btime": "2024-05-16T21:33:44.402089+0000", "change_attr": 1, "client_caps": [ { "client_id": 4799, "issued": "pAsLsXsFsx", "last_sent": 5, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-05-16T21:33:44.402089+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "alternate_name": "/UJ3QOBRlPDBWmwmFzZClQH6lt08omFv7vAY/Hty0qptAZ6Ukw2RZDgvZyxkOfbSIjjkAsFKgVWGg7rGo3AAep+ZxZD3nZPL9QBH1Y1MRpFqrHfxZWIwAFUSdsf1swu6hOi1Fx0UTM+IbDndD5dG20hLYv0CxS5XMC+nI4t64+FDkPANiVRue1ZD72O1CStyLgAEDGCDNZ1MLuhlim9BhyMxDHntD6CPJp6OgK7MSnwiXG5oMgE+4TN4BDeKR4/X2X9Q8VhJeXAqt4BsGjRl3p0mqeMkHzpHu9fXVu0Cb0fuKo35i90KlMqsu+2jnQivzOK30H+SXrzNH2oqds5A", "auth_pins": 2, "auth_state": { "replicas": {} }, "inode": 0, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": true, "is_primary": false, "is_remote": false, "lock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "type": "dn", "xlock_by": {} }, "nref": 4, "path": "dir/,UJ3QOBRlPDBWmwmFzZClQH6lt08omFv7vAY,Hty0qptAZ6Ukw2RZDgvZyxkOfbSIjjkAsFKgVWGg7rGo3AAep+ZxZD3nZPL9QBH1Y1MRpFqrHfxZWIwAFUSdsf1swu6hOi1Fx0UTM+IbDndD5dG20hLYv0CxS5XMC+nI4t64+FDkPANiVRue1ZD72O1CStyLgAEDBDa1,ObAQFrN+e+3DrFhPrjtwr7+qw50BjBdcmrBQXL", "path_ino": 1, "pins": { "authpin": 1, "lock": 2, "request": 1 }, "projected_version": 2, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth" ], "version": 1, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000004", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/dir", "pins": { "authpin": 1, "child": 1, "dirty": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "1" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511627780, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4799, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-05-16T21:33:44.402089+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 13, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 7, "ptrwaiter": 0, "request": 1 }, "policylock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "type": "ipolicy", "xlock_by": {} }, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 2, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 2, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "type": "isnap", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 16, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 2, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4799, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-05-16T21:33:45.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-16T21:33:45.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.856+0000 7fdda4908640 1 Processor -- start 2024-05-16T21:33:45.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.856+0000 7fdda4908640 1 -- start start 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdda4908640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda00b8d70 0x7fdda00b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdda4908640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda014ece0 con 0x7fdda014e530 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdda4908640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda014efc0 con 0x7fdda00bd440 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdda4908640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00b88e0 con 0x7fdda00b8d70 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdda014e530 0x7fdda00ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44264/0 (socket says 172.21.15.5:44264) 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9e59c640 1 -- 172.21.15.5:0/3584239883 learned_addr learned my addr 172.21.15.5:0/3584239883 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9ed9d640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda00b8d70 0x7fdda00b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080946003 0 0) 0x7fdda014ece0 con 0x7fdda014e530 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd8c003520 con 0x7fdda014e530 2024-05-16T21:33:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3085392855 0 0) 0x7fdd8c003520 con 0x7fdda014e530 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda00b8d70 msgr2=0x7fdda00b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9dd9b640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda00b8d70 0x7fdda00b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 >> v1:172.21.15.157:6789/0 conn(0x7fdda00bd440 legacy=0x7fdda00bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda014f2a0 con 0x7fdda014e530 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.857+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fdd90001870 con 0x7fdda014e530 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 >> v1:172.21.15.5:6789/0 conn(0x7fdda014e530 legacy=0x7fdda00ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9dd9b640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c003a30 0x7fdd8c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9dd9b640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd8c004800 0x7fdd8c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9dd9b640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda00b8d70 0x7fdd8c0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdda00b88e0 con 0x7fdd8c004800 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c00bb80 con 0x7fdd8c003a30 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8c00bd80 con 0x7fdda00b8d70 2024-05-16T21:33:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd97fff640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd8c004800 0x7fdd8c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9e59c640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c003a30 0x7fdd8c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd9ed9d640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda00b8d70 0x7fdd8c0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd97fff640 1 -- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda00b8d70 msgr2=0x7fdd8c0052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd97fff640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda00b8d70 0x7fdd8c0052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd97fff640 1 -- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c003a30 msgr2=0x7fdd8c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd97fff640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c003a30 0x7fdd8c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.858+0000 7fdd97fff640 1 -- 172.21.15.5:0/3584239883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c003520 con 0x7fdd8c004800 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.859+0000 7fdd97fff640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd8c004800 0x7fdd8c004c10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd88001790 tx=0x7fdd8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576d219b9dbfa9b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.859+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd880013b0 con 0x7fdd8c004800 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.859+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd880052d0 con 0x7fdd8c004800 2024-05-16T21:33:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.859+0000 7fdd9dd9b640 1 -- 172.21.15.5:0/3584239883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8802aae0 con 0x7fdd8c004800 2024-05-16T21:33:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.859+0000 7fdda4908640 1 -- 172.21.15.5:0/3584239883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd8c004800 msgr2=0x7fdd8c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.859+0000 7fdda4908640 1 --2- 172.21.15.5:0/3584239883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd8c004800 0x7fdd8c004c10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd88001790 tx=0x7fdd8c005830 comp rx=0 tx=0).stop 2024-05-16T21:33:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.859+0000 7fdd9ed9d640 1 -- 172.21.15.5:0/3584239883 reap_dead start 2024-05-16T21:33:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.860+0000 7fdda4908640 1 -- 172.21.15.5:0/3584239883 shutdown_connections 2024-05-16T21:33:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.860+0000 7fdda4908640 1 -- 172.21.15.5:0/3584239883 >> 172.21.15.5:0/3584239883 conn(0x7fdda00c0570 msgr2=0x7fdda00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.860+0000 7fdda4908640 1 -- 172.21.15.5:0/3584239883 shutdown_connections 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.860+0000 7fdda4908640 1 -- 172.21.15.5:0/3584239883 wait complete. 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.861+0000 7fdda4908640 1 Processor -- start 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.861+0000 7fdda4908640 1 -- start start 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.862+0000 7fdda4908640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdda01e4b10 0x7fdda0141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.862+0000 7fdda4908640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda0142920 0x7fdda0142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.862+0000 7fdda4908640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda0143480 0x7fdda0143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.862+0000 7fdda4908640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdda014eac0 con 0x7fdda0142920 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.862+0000 7fdda4908640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdda014e940 con 0x7fdda01e4b10 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.862+0000 7fdda4908640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00bb6d0 con 0x7fdda0143480 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda0142920 0x7fdda0142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda0142920 0x7fdda0142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46586/0 (socket says 172.21.15.5:46586) 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 -- 172.21.15.5:0/633979662 learned_addr learned my addr 172.21.15.5:0/633979662 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd9e59c640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdda01e4b10 0x7fdda0141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd9ed9d640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda0143480 0x7fdda0143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 -- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda0143480 msgr2=0x7fdda0143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda0143480 0x7fdda0143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 -- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdda01e4b10 msgr2=0x7fdda0141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdda01e4b10 0x7fdda0141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 -- 172.21.15.5:0/633979662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda01424b0 con 0x7fdda0142920 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd97fff640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda0142920 0x7fdda0142d30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdd88005040 tx=0x7fdd88001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd96ffd640 1 -- 172.21.15.5:0/633979662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8803f030 con 0x7fdda0142920 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd96ffd640 1 -- 172.21.15.5:0/633979662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd88005480 con 0x7fdda0142920 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdd96ffd640 1 -- 172.21.15.5:0/633979662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd880050d0 con 0x7fdda0142920 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda01e4030 con 0x7fdda0142920 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.863+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda01e45f0 con 0x7fdda0142920 2024-05-16T21:33:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.864+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda0050940 con 0x7fdda0142920 2024-05-16T21:33:45.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.865+0000 7fdd96ffd640 1 -- 172.21.15.5:0/633979662 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd88042070 con 0x7fdda0142920 2024-05-16T21:33:45.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.866+0000 7fdd96ffd640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdd800762d0 0x7fdd800787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:45.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.866+0000 7fdd96ffd640 1 -- 172.21.15.5:0/633979662 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5709+0+0 (secure 0 0 0) 0x7fdd880b6d40 con 0x7fdda0142920 2024-05-16T21:33:45.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.866+0000 7fdd9e59c640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdd800762d0 0x7fdd800787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:45.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.867+0000 7fdd9e59c640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdd800762d0 0x7fdd800787e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdd900013a0 tx=0x7fdd90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:45.870+0000 7fdd96ffd640 1 -- 172.21.15.5:0/633979662 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdd880800e0 con 0x7fdda0142920 2024-05-16T21:33:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.104+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdda0050940 con 0x7fdda0142920 2024-05-16T21:33:46.106 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-05-16T21:33:46.105+0000 7fcd599bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-16T21:33:46.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.106+0000 7fdd96ffd640 1 -- 172.21.15.5:0/633979662 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7fdd880843e0 con 0x7fdda0142920 2024-05-16T21:33:46.108 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-16T21:33:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdd800762d0 msgr2=0x7fdd800787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdd800762d0 0x7fdd800787e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdd900013a0 tx=0x7fdd90009040 comp rx=0 tx=0).stop 2024-05-16T21:33:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda0142920 msgr2=0x7fdda0142d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda0142920 0x7fdda0142d30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdd88005040 tx=0x7fdd88001120 comp rx=0 tx=0).stop 2024-05-16T21:33:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 shutdown_connections 2024-05-16T21:33:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdd800762d0 0x7fdd800787e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdda0143480 0x7fdda0143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda0142920 0x7fdda0142d30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 --2- 172.21.15.5:0/633979662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdda01e4b10 0x7fdda0141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 >> 172.21.15.5:0/633979662 conn(0x7fdda00c0570 msgr2=0x7fdda00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 shutdown_connections 2024-05-16T21:33:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.110+0000 7fdda4908640 1 -- 172.21.15.5:0/633979662 wait complete. 2024-05-16T21:33:46.115 INFO:tasks.ceph.mds.c.smithi005.stderr: -9054> 2024-05-16T21:33:34.850+0000 7f3405bc7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T21:33:46.124 DEBUG:teuthology.orchestra.run.smithi005:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries list 2024-05-16T21:33:46.176 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-05-16T21:33:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.177+0000 7fc738909280 1 -- start start 2024-05-16T21:33:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.177+0000 7fc738909280 1 Processor -- start 2024-05-16T21:33:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc738909280 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e064480 0x55b23d274000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc738909280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e064900 0x55b23d274580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc738909280 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e064d80 0x55b23d274b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc738909280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b23e06c000 con 0x55b23e064900 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc738909280 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b23e06c180 con 0x55b23e064d80 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc738909280 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55b23e06c300 con 0x55b23e064480 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc7368b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e064900 0x55b23d274580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc7368b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e064900 0x55b23d274580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46618/0 (socket says 172.21.15.5:46618) 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc7368b6640 1 -- 172.21.15.5:0/2843808085 learned_addr learned my addr 172.21.15.5:0/2843808085 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc7370b7640 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e064480 0x55b23d274000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.178+0000 7fc7378b8640 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e064d80 0x55b23d274b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7368b6640 1 -- 172.21.15.5:0/2843808085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e064480 msgr2=0x55b23d274000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7368b6640 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e064480 0x55b23d274000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7368b6640 1 -- 172.21.15.5:0/2843808085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e064d80 msgr2=0x55b23d274b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7368b6640 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e064d80 0x55b23d274b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7368b6640 1 -- 172.21.15.5:0/2843808085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2391c6780 con 0x55b23e064900 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7368b6640 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e064900 0x55b23d274580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55b23dfc7560 tx=0x55b23d2bbe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750dd31fe90a2790 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7348b2640 1 -- 172.21.15.5:0/2843808085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b2391b6680 con 0x55b23e064900 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7348b2640 1 -- 172.21.15.5:0/2843808085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b2391bce00 con 0x55b23e064900 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc738909280 1 -- 172.21.15.5:0/2843808085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2391c63c0 con 0x55b23e064900 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc738909280 1 -- 172.21.15.5:0/2843808085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b2391c7680 con 0x55b23e064900 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc738909280 4 waiting for MDS map... 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7348b2640 1 -- 172.21.15.5:0/2843808085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b2391b69c0 con 0x55b23e064900 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7348b2640 1 -- 172.21.15.5:0/2843808085 <== mon.0 v2:172.21.15.5:3300/0 4 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x55b23e096400 con 0x55b23e064900 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc7348b2640 1 -- 172.21.15.5:0/2843808085 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 2280+0+0 (secure 0 0 0) 0x55b23d21b180 con 0x55b23e064900 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc738909280 4 Got MDS map 26 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.179+0000 7fc738909280 10 main: JournalTool::main 2024-05-16T21:33:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.180+0000 7fc738909280 4 main: JournalTool: connecting to RADOS... 2024-05-16T21:33:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.180+0000 7fc738909280 1 Processor -- start 2024-05-16T21:33:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.180+0000 7fc738909280 1 -- start start 2024-05-16T21:33:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc738909280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e065680 0x55b23d275080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc738909280 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e065b00 0x55b23d275600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc738909280 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 0x55b23d275b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc738909280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b23e06c480 con 0x55b23e065680 2024-05-16T21:33:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc738909280 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b23e06c600 con 0x55b23e065b00 2024-05-16T21:33:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc738909280 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55b23e06c780 con 0x55b23e065f80 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc7378b8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e065680 0x55b23d275080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc7378b8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e065680 0x55b23d275080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46622/0 (socket says 172.21.15.5:46622) 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc7378b8640 1 -- 172.21.15.5:0/2802131479 learned_addr learned my addr 172.21.15.5:0/2802131479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc7368b6640 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 0x55b23d275b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.181+0000 7fc7370b7640 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e065b00 0x55b23d275600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7378b8640 1 -- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 msgr2=0x55b23d275b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7378b8640 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 0x55b23d275b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7378b8640 1 -- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e065b00 msgr2=0x55b23d275600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7378b8640 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e065b00 0x55b23d275600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7378b8640 1 -- 172.21.15.5:0/2802131479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2391c6960 con 0x55b23e065680 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7368b6640 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 0x55b23d275b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7378b8640 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e065680 0x55b23d275080 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55b23dfc70b0 tx=0x55b23d2bbbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81fac5fce5f6bbf server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7328ae640 1 -- 172.21.15.5:0/2802131479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b2391b6680 con 0x55b23e065680 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7328ae640 1 -- 172.21.15.5:0/2802131479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b2391bc1c0 con 0x55b23e065680 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc7328ae640 1 -- 172.21.15.5:0/2802131479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b2391b69c0 con 0x55b23e065680 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc738909280 1 -- 172.21.15.5:0/2802131479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e065680 msgr2=0x55b23d275080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.182+0000 7fc738909280 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e065680 0x55b23d275080 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55b23dfc70b0 tx=0x55b23d2bbbc0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 -- 172.21.15.5:0/2802131479 shutdown_connections 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 0x55b23d275b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e065b00 0x55b23d275600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 --2- 172.21.15.5:0/2802131479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e065680 0x55b23d275080 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 -- 172.21.15.5:0/2802131479 >> 172.21.15.5:0/2802131479 conn(0x55b23e065200 msgr2=0x55b23d2a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 -- 172.21.15.5:0/2802131479 shutdown_connections 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 -- 172.21.15.5:0/2802131479 wait complete. 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 Processor -- start 2024-05-16T21:33:46.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.183+0000 7fc738909280 1 -- start start 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc738909280 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 0x55b23d275080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc738909280 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e066400 0x55b23d275600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc738909280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e066880 0x55b23d275b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc738909280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b23e06dc80 con 0x55b23e066880 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc738909280 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b23e06db00 con 0x55b23e066400 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc738909280 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55b23e06d980 con 0x55b23e065f80 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc7368b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e066880 0x55b23d275b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc7368b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e066880 0x55b23d275b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46628/0 (socket says 172.21.15.5:46628) 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 learned_addr learned my addr 172.21.15.5:0/3197620445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc7370b7640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e066400 0x55b23d275600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.184+0000 7fc7378b8640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 0x55b23d275080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 msgr2=0x55b23d275080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7368b6640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e065f80 0x55b23d275080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e066400 msgr2=0x55b23d275600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7368b6640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e066400 0x55b23d275600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2391c74a0 con 0x55b23e066880 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7368b6640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e066880 0x55b23d275b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b23e09e6f0 tx=0x55b23d2bb860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7310ab640 1 -- 172.21.15.5:0/3197620445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b2391b6680 con 0x55b23e066880 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7310ab640 1 -- 172.21.15.5:0/3197620445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b2391bcc40 con 0x55b23e066880 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2391c6780 con 0x55b23e066880 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc7310ab640 1 -- 172.21.15.5:0/3197620445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b2391b69c0 con 0x55b23e066880 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2391c63c0 con 0x55b23e066880 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.185+0000 7fc738909280 4 main: JournalTool: resolving pool 6 2024-05-16T21:33:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.186+0000 7fc7310ab640 1 -- 172.21.15.5:0/3197620445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55b23e0e8c00 con 0x55b23e066880 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc7310ab640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x55b23e065680 0x55b23d276100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc7310ab640 1 -- 172.21.15.5:0/3197620445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x55b23e0f2800 con 0x55b23e066880 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc738909280 4 main: JournalTool: creating IoCtx.. 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc738909280 4 main: Executing for rank 0 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x55b23e066d00 0x55b23d276680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e066d00 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc7370b7640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x55b23e066d00 0x55b23d276680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc7378b8640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x55b23e065680 0x55b23d276100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.187+0000 7fc7370b7640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x55b23e066d00 0x55b23d276680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc7378b8640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x55b23e065680 0x55b23d276100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55b23dfc70b0 tx=0x55b23d2bbb00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc738909280 4 Pointer 400.00000000 is readable 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc738909280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e066d00 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv3 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc738909280 10 Header 0x400000 0x400000 0x400000 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc738909280 10 Starting journal scan from offset 0x400000 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.188+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e066d00 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 3 ==== osd_op_reply(3 200.00000001 [read 0~35968 out=35968b] v0'0 uv19 ondisk = 0) ==== 156+0+35968 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 4 Read 0x8c80 bytes from 200.00000001 gap=0 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Parsing data, 0x8c80 bytes available 2024-05-16T21:33:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x400000 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x30 bytes 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x400000 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x400030 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x37c bytes 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x400030 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x4003ac 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x102 bytes 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x4003ac 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x4004ae 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0xac bytes 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x4004ae 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x40055a 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x32f bytes 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x40055a 2024-05-16T21:33:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x400889 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x823 bytes 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x400889 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x4010ac 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x95a bytes 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x4010ac 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x401a06 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x954 bytes 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x401a06 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x40235a 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x956 bytes 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x40235a 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x402cb0 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0xa7f bytes 2024-05-16T21:33:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x402cb0 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x40372f 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0xba8 bytes 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x40372f 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x4042d7 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x472 bytes 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x4042d7 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x404749 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x808 bytes 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x404749 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x404f51 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x82e bytes 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x404f51 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x40577f 2024-05-16T21:33:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x83b bytes 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x40577f 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x405fba 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0xaac bytes 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x405fba 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x406a66 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x83c bytes 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x406a66 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x4072a2 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x839 bytes 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x4072a2 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x407adb 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0xab8 bytes 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x407adb 2024-05-16T21:33:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Attempting decode at 0x408593 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Consumed 0x6ed bytes 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 10 Valid entry at 0x408593 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x55b23e067180 0x55b23d276c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e067180 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc7378b8640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x55b23e067180 0x55b23d276c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc7378b8640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x55b23e067180 0x55b23d276c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 4 Reached end of journal objects 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 4 Scanned objects, 0 missing, 1 valid 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 4 Events scanned, 0 gaps 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 4 Found 20 valid events 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 4 Selected 20 events events for processing 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.189+0000 7fc738909280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T21:33:46.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:5 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504800 con 0x55b23e067180 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 2 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc738909280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v1 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:6 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504c00 con 0x55b23e067180 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 3 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc738909280 4 recover_dentries: inspecting lump 100.00000000 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:7 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e067180 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 4 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc738909280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v1 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.190+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:8 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e067180 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 5 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc738909280 4 recover_dentries: updating root 0x0x1 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc738909280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T21:33:46.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:9 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e066d00 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 4 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc738909280 4 recover_dentries: root exists, will modify (582) 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc738909280 4 recover_dentries: magic ok 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc738909280 4 recover_dentries: writing root ino 1.00000000.inode version 2 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.191+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:10 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e066d00 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.193+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 5 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v42'21 uv21 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.193+0000 7fc738909280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.193+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:11 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504800 con 0x55b23e067180 2024-05-16T21:33:46.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.193+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 6 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.193+0000 7fc738909280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v3 2024-05-16T21:33:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.193+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.193+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:12 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504c00 con 0x55b23e067180 2024-05-16T21:33:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.194+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 7 ==== osd_op_reply(12 1.00000000 [omap-set-header] v42'5 uv5 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.195+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:13 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e067180 2024-05-16T21:33:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.195+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 8 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.195+0000 7fc738909280 4 recover_dentries: inspecting fullbit 1.00000000/.tmp4248767462 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.195+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.195+0000 7fc738909280 4 recover_dentries: writing I dentry .tmp4248767462_head into frag 1.00000000 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.195+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:14 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=576b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e067180 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.196+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 9 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v42'6 uv6 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.196+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.196+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x55b23e065200 0x55b23d277180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.196+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:15 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e065200 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.196+0000 7fc7370b7640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x55b23e065200 0x55b23d277180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.197+0000 7fc7370b7640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x55b23e065200 0x55b23d277180 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.198+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 1 ==== osd_op_reply(15 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.199+0000 7fc738909280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000000.00000000 (2) No such file or directory 2024-05-16T21:33:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.199+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.199+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:16 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e065200 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.200+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 2 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v42'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.200+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:17 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e065200 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 3 ==== osd_op_reply(17 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc738909280 4 recover_dentries: updating root 0x0x1 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc738909280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:18 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505c00 con 0x55b23e066d00 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 6 ==== osd_op_reply(18 1.00000000.inode [read 0~582 out=582b] v0'0 uv21 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc738909280 4 recover_dentries: root exists, will modify (582) 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc738909280 4 recover_dentries: magic ok 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc738909280 4 recover_dentries: writing root ino 1.00000000.inode version 3 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.201+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:19 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e066d00 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.202+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 7 ==== osd_op_reply(19 1.00000000.inode [writefull 0~582] v42'22 uv22 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.202+0000 7fc738909280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.202+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:20 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e067180 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.203+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 10 ==== osd_op_reply(20 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.203+0000 7fc738909280 4 recover_dentries: frag 1.00000000 fnode old v3 vs new v5 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.203+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.203+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:21 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e067180 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 11 ==== osd_op_reply(21 1.00000000 [omap-set-header] v42'7 uv7 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:22 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505c00 con 0x55b23e067180 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 12 ==== osd_op_reply(22 1.00000000 [omap-get-vals-by-keys out=576b] v0'0 uv7 ondisk = 0) ==== 154+0+576 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc738909280 4 recover_dentries: inspecting fullbit 1.00000000/.tmp4248767462 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc738909280 4 recover_dentries: dentry .tmp4248767462_head existed already 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc738909280 4 recover_dentries: writing I dentry .tmp4248767462_head into frag 1.00000000 2024-05-16T21:33:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.204+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:23 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=576b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504800 con 0x55b23e067180 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.205+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 13 ==== osd_op_reply(23 1.00000000 [omap-set-vals] v42'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.205+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.205+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:24 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504c00 con 0x55b23e065200 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.206+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 4 ==== osd_op_reply(24 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.206+0000 7fc738909280 4 recover_dentries: frag 10000000000.00000000 fnode old v1 vs new v3 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.206+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.206+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:25 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e065200 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.207+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 5 ==== osd_op_reply(25 10000000000.00000000 [omap-set-header] v42'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.207+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:26 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e065200 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.207+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 6 ==== osd_op_reply(26 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.207+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000000.00000000/.fscrypt 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.207+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.207+0000 7fc738909280 4 recover_dentries: writing I dentry .fscrypt_head into frag 10000000000.00000000 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.207+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:27 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e065200 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.208+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 7 ==== osd_op_reply(27 10000000000.00000000 [omap-set-vals] v42'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.208+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.208+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x55b23e067600 0x55b23d277700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.208+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:28 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e067600 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.208+0000 7fc7368b6640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x55b23e067600 0x55b23d277700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.209+0000 7fc7368b6640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x55b23e067600 0x55b23d277700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.209+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 1 ==== osd_op_reply(28 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.209+0000 7fc738909280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000001.00000000 (2) No such file or directory 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.209+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.209+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:29 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e067600 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.210+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 2 ==== osd_op_reply(29 10000000001.00000000 [omap-set-header] v42'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.210+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:30 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504c00 con 0x55b23e067600 2024-05-16T21:33:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.211+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 3 ==== osd_op_reply(30 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.211+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.211+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:31 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e065200 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.211+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 8 ==== osd_op_reply(31 10000000000.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.211+0000 7fc738909280 4 recover_dentries: frag 10000000000.00000000 fnode old v3 vs new v5 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.211+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.211+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:32 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e065200 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 9 ==== osd_op_reply(32 10000000000.00000000 [omap-set-header] v42'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:33 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e065200 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 10 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv13 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000000.00000000/.fscrypt 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc738909280 4 recover_dentries: dentry .fscrypt_head existed already 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T21:33:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc738909280 4 recover_dentries: writing I dentry .fscrypt_head into frag 10000000000.00000000 2024-05-16T21:33:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.212+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:34 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc000 con 0x55b23e065200 2024-05-16T21:33:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.214+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 11 ==== osd_op_reply(34 10000000000.00000000 [omap-set-vals] v42'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.214+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.214+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:35 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc400 con 0x55b23e067600 2024-05-16T21:33:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.214+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 4 ==== osd_op_reply(35 10000000001.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.214+0000 7fc738909280 4 recover_dentries: frag 10000000001.00000000 fnode old v1 vs new v3 2024-05-16T21:33:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.214+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.214+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:36 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc800 con 0x55b23e067600 2024-05-16T21:33:46.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.215+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 5 ==== osd_op_reply(36 10000000001.00000000 [omap-set-header] v42'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.215+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:37 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5ccc00 con 0x55b23e067600 2024-05-16T21:33:46.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.216+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 6 ==== osd_op_reply(37 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.216+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T21:33:46.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.216+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.216+0000 7fc738909280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.216+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:38 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd000 con 0x55b23e067600 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.217+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 7 ==== osd_op_reply(38 10000000001.00000000 [omap-set-vals] v42'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.217+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000002.00000000 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.217+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x55b23e067a80 0x55b23d5ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.217+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:39 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd400 con 0x55b23e067a80 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.217+0000 7fc7378b8640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x55b23e067a80 0x55b23d5ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.218+0000 7fc7378b8640 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x55b23e067a80 0x55b23d5ce000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.220+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 1 ==== osd_op_reply(39 10000000002.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.220+0000 7fc738909280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000002.00000000 (2) No such file or directory 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.220+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.220+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:40 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd800 con 0x55b23e067a80 2024-05-16T21:33:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.221+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 2 ==== osd_op_reply(40 10000000002.00000000 [omap-set-header] v42'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.221+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:41 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cdc00 con 0x55b23e067a80 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.221+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 3 ==== osd_op_reply(41 10000000002.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.221+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.222+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:42 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc400 con 0x55b23e065200 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.222+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 12 ==== osd_op_reply(42 10000000000.00000000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.222+0000 7fc738909280 4 recover_dentries: frag 10000000000.00000000 fnode old v5 vs new v7 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.222+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.222+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:43 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc800 con 0x55b23e065200 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 13 ==== osd_op_reply(43 10000000000.00000000 [omap-set-header] v42'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:44 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5ccc00 con 0x55b23e065200 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 14 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv15 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000000.00000000/.fscrypt 2024-05-16T21:33:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc738909280 4 recover_dentries: dentry .fscrypt_head existed already 2024-05-16T21:33:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-05-16T21:33:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc738909280 4 recover_dentries: writing I dentry .fscrypt_head into frag 10000000000.00000000 2024-05-16T21:33:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.223+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:45 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e065200 2024-05-16T21:33:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.225+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 15 ==== osd_op_reply(45 10000000000.00000000 [omap-set-vals] v42'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.225+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.225+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:46 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e067600 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.225+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.225+0000 7fc738909280 4 recover_dentries: frag 10000000001.00000000 fnode old v3 vs new v5 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.225+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.225+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:47 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504c00 con 0x55b23e067600 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.226+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 9 ==== osd_op_reply(47 10000000001.00000000 [omap-set-header] v42'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.226+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:48 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc000 con 0x55b23e067600 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.226+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 10 ==== osd_op_reply(48 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.226+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.226+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.226+0000 7fc738909280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T21:33:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.226+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:49 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=572b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc400 con 0x55b23e067600 2024-05-16T21:33:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.227+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 11 ==== osd_op_reply(49 10000000001.00000000 [omap-set-vals] v42'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.227+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000003.00000000 2024-05-16T21:33:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.227+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:50 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc800 con 0x55b23e067a80 2024-05-16T21:33:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.228+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 4 ==== osd_op_reply(50 10000000003.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.228+0000 7fc738909280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000003.00000000 (2) No such file or directory 2024-05-16T21:33:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.228+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.228+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:51 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e067a80 2024-05-16T21:33:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.229+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 5 ==== osd_op_reply(51 10000000003.00000000 [omap-set-header] v42'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.229+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:52 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e067a80 2024-05-16T21:33:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.229+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 6 ==== osd_op_reply(52 10000000003.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.229+0000 7fc738909280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T21:33:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.229+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:53 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e067180 2024-05-16T21:33:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.230+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 14 ==== osd_op_reply(53 1.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.230+0000 7fc738909280 4 recover_dentries: frag 1.00000000 fnode old v5 vs new v10 2024-05-16T21:33:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.230+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.230+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:54 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505c00 con 0x55b23e067180 2024-05-16T21:33:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 15 ==== osd_op_reply(54 1.00000000 [omap-set-header] v42'9 uv9 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:55 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=44b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504800 con 0x55b23e067180 2024-05-16T21:33:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 16 ==== osd_op_reply(55 1.00000000 [omap-get-vals-by-keys out=576b] v0'0 uv9 ondisk = 0) ==== 154+0+576 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 4 recover_dentries: inspecting fullbit 1.00000000/.tmp4248767462 2024-05-16T21:33:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 4 recover_dentries: dentry .tmp4248767462_head existed already 2024-05-16T21:33:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 8 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 4 recover_dentries: writing I dentry .tmp4248767462_head into frag 1.00000000 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 4 recover_dentries: inspecting fullbit 1.00000000/.fscrypt 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 4 recover_dentries: writing I dentry .fscrypt_head into frag 1.00000000 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.231+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:56 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=1142b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e067180 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.232+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 17 ==== osd_op_reply(56 1.00000000 [omap-set-vals] v42'10 uv10 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.232+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.232+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:57 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd400 con 0x55b23e065200 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.232+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 16 ==== osd_op_reply(57 10000000000.00000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.232+0000 7fc738909280 4 recover_dentries: frag 10000000000.00000000 fnode old v7 vs new v9 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.232+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.232+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:58 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd800 con 0x55b23e065200 2024-05-16T21:33:46.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.234+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 17 ==== osd_op_reply(58 10000000000.00000000 [omap-set-header] v42'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.234+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:59 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cdc00 con 0x55b23e065200 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.234+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 18 ==== osd_op_reply(59 10000000000.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv17 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.234+0000 7fc738909280 4 recover_dentries: inspecting nullbit 10000000000.00000000/.fscrypt 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.234+0000 7fc738909280 4 recover_dentries: dentry exists, will remove 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.234+0000 7fc738909280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '.fscrypt' with lump fnode version 9vs existing fnode version 7 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.234+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:60 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc800 con 0x55b23e065200 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 19 ==== osd_op_reply(60 10000000000.00000000 [omap-rm-keys] v42'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc738909280 4 recover_dentries: updating root 0x0x1 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc738909280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T21:33:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:61 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e0000 con 0x55b23e066d00 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 8 ==== osd_op_reply(61 1.00000000.inode [read 0~582 out=582b] v0'0 uv22 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc738909280 4 recover_dentries: root exists, will modify (582) 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc738909280 4 recover_dentries: magic ok 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc738909280 4 recover_dentries: writing root ino 1.00000000.inode version 4 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.235+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:62 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e0400 con 0x55b23e066d00 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.237+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 9 ==== osd_op_reply(62 1.00000000.inode [writefull 0~582] v42'23 uv23 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.237+0000 7fc738909280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.237+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:63 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e0800 con 0x55b23e067180 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.237+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 18 ==== osd_op_reply(63 1.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.237+0000 7fc738909280 4 recover_dentries: frag 1.00000000 fnode old v10 vs new v12 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.237+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.237+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:64 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e0c00 con 0x55b23e067180 2024-05-16T21:33:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.238+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 19 ==== osd_op_reply(64 1.00000000 [omap-set-header] v42'11 uv11 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.238+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:65 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e1000 con 0x55b23e067180 2024-05-16T21:33:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.238+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 20 ==== osd_op_reply(65 1.00000000 [omap-get-vals-by-keys out=576b] v0'0 uv11 ondisk = 0) ==== 154+0+576 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.238+0000 7fc738909280 4 recover_dentries: inspecting nullbit 1.00000000/.tmp4248767462 2024-05-16T21:33:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.238+0000 7fc738909280 4 recover_dentries: dentry exists, will remove 2024-05-16T21:33:46.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.238+0000 7fc738909280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '.tmp4248767462' with lump fnode version 12vs existing fnode version 10 2024-05-16T21:33:46.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.238+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:66 6.1f 6:ff5b34d6:::1.00000000:head [omap-rm-keys in=27b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e1400 con 0x55b23e067180 2024-05-16T21:33:46.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.239+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 21 ==== osd_op_reply(66 1.00000000 [omap-rm-keys] v42'12 uv12 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.239+0000 7fc738909280 4 recover_dentries: inspecting lump 100.00000000 2024-05-16T21:33:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.239+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:67 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e1800 con 0x55b23e067180 2024-05-16T21:33:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.240+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 22 ==== osd_op_reply(67 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.240+0000 7fc738909280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v3 2024-05-16T21:33:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.240+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.240+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:68 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e1c00 con 0x55b23e067180 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 23 ==== osd_op_reply(68 100.00000000 [omap-set-header] v42'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:69 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e0800 con 0x55b23e067180 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 24 ==== osd_op_reply(69 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc738909280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc738909280 4 recover_dentries: dentry stray2_head existed already 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 1 vs fullbit version 2 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc738909280 4 recover_dentries: writing I dentry stray2_head into frag 100.00000000 2024-05-16T21:33:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.241+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:70 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e0c00 con 0x55b23e067180 2024-05-16T21:33:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.242+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 25 ==== osd_op_reply(70 100.00000000 [omap-set-vals] v42'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.242+0000 7fc738909280 4 recover_dentries: inspecting lump 602.00000000 2024-05-16T21:33:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.242+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:71 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e1000 con 0x55b23e065200 2024-05-16T21:33:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.243+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 20 ==== osd_op_reply(71 602.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.243+0000 7fc738909280 4 recover_dentries: frag 602.00000000 fnode old v1 vs new v10 2024-05-16T21:33:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.243+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.243+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:72 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5e0000 con 0x55b23e065200 2024-05-16T21:33:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.244+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 21 ==== osd_op_reply(72 602.00000000 [omap-set-header] v42'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.244+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:73 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5ccc00 con 0x55b23e065200 2024-05-16T21:33:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.244+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 22 ==== osd_op_reply(73 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.244+0000 7fc738909280 4 recover_dentries: inspecting fullbit 602.00000000/10000000000 2024-05-16T21:33:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.244+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.244+0000 7fc738909280 4 recover_dentries: writing I dentry 10000000000_head into frag 602.00000000 2024-05-16T21:33:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.244+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- osd_op(unknown.0.0:74 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=588b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd400 con 0x55b23e065200 2024-05-16T21:33:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.245+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.0 v2:172.21.15.5:6800/971514196 23 ==== osd_op_reply(74 602.00000000 [omap-set-vals] v42'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e065200 2024-05-16T21:33:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.245+0000 7fc738909280 4 recover_dentries: updating root 0x0x1 2024-05-16T21:33:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.245+0000 7fc738909280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T21:33:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.245+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:75 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd800 con 0x55b23e066d00 2024-05-16T21:33:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.246+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 10 ==== osd_op_reply(75 1.00000000.inode [read 0~582 out=582b] v0'0 uv23 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.246+0000 7fc738909280 4 recover_dentries: root exists, will modify (582) 2024-05-16T21:33:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.246+0000 7fc738909280 4 recover_dentries: magic ok 2024-05-16T21:33:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.246+0000 7fc738909280 4 recover_dentries: writing root ino 1.00000000.inode version 5 2024-05-16T21:33:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.246+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:76 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cdc00 con 0x55b23e066d00 2024-05-16T21:33:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.247+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 11 ==== osd_op_reply(76 1.00000000.inode [writefull 0~582] v42'24 uv24 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.247+0000 7fc738909280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T21:33:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.247+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:77 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc800 con 0x55b23e067180 2024-05-16T21:33:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.247+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 26 ==== osd_op_reply(77 1.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.247+0000 7fc738909280 4 recover_dentries: frag 1.00000000 fnode old v12 vs new v13 2024-05-16T21:33:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.247+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.247+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:78 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e067180 2024-05-16T21:33:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.248+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 27 ==== osd_op_reply(78 1.00000000 [omap-set-header] v42'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:79 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e067180 2024-05-16T21:33:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 28 ==== osd_op_reply(79 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc738909280 4 recover_dentries: updating root 0x0x1 2024-05-16T21:33:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc738909280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T21:33:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:80 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505c00 con 0x55b23e066d00 2024-05-16T21:33:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 12 ==== osd_op_reply(80 1.00000000.inode [read 0~582 out=582b] v0'0 uv24 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc738909280 4 recover_dentries: root exists, will modify (582) 2024-05-16T21:33:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc738909280 4 recover_dentries: magic ok 2024-05-16T21:33:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc738909280 4 recover_dentries: writing root ino 1.00000000.inode version 6 2024-05-16T21:33:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.249+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:81 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504800 con 0x55b23e066d00 2024-05-16T21:33:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.250+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 13 ==== osd_op_reply(81 1.00000000.inode [writefull 0~582] v42'25 uv25 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.250+0000 7fc738909280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T21:33:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.251+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:82 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e067180 2024-05-16T21:33:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.251+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 29 ==== osd_op_reply(82 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.251+0000 7fc738909280 4 recover_dentries: frag 1.00000000 fnode old v13 vs new v15 2024-05-16T21:33:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.251+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.251+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:83 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e067180 2024-05-16T21:33:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.252+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 30 ==== osd_op_reply(83 1.00000000 [omap-set-header] v42'14 uv14 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.252+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:84 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e067180 2024-05-16T21:33:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.252+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 31 ==== osd_op_reply(84 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.252+0000 7fc738909280 4 recover_dentries: inspecting fullbit 1.00000000/dir 2024-05-16T21:33:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.252+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.252+0000 7fc738909280 4 recover_dentries: writing I dentry dir_head into frag 1.00000000 2024-05-16T21:33:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.252+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:85 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e067180 2024-05-16T21:33:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.254+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 32 ==== osd_op_reply(85 1.00000000 [omap-set-vals] v42'15 uv15 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.254+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000004.00000000 2024-05-16T21:33:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.254+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:86 6.5 6:a367a3e8:::10000000004.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e067a80 2024-05-16T21:33:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.254+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 7 ==== osd_op_reply(86 10000000004.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.254+0000 7fc738909280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000004.00000000 (2) No such file or directory 2024-05-16T21:33:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.254+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.254+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:87 6.5 6:a367a3e8:::10000000004.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505c00 con 0x55b23e067a80 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.255+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 8 ==== osd_op_reply(87 10000000004.00000000 [omap-set-header] v42'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.255+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:88 6.5 6:a367a3e8:::10000000004.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc800 con 0x55b23e067a80 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 9 ==== osd_op_reply(88 10000000004.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc738909280 4 recover_dentries: updating root 0x0x1 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc738909280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:89 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5ccc00 con 0x55b23e066d00 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 14 ==== osd_op_reply(89 1.00000000.inode [read 0~582 out=582b] v0'0 uv25 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc738909280 4 recover_dentries: root exists, will modify (582) 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc738909280 4 recover_dentries: magic ok 2024-05-16T21:33:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc738909280 4 recover_dentries: writing root ino 1.00000000.inode version 7 2024-05-16T21:33:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.256+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:90 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd400 con 0x55b23e066d00 2024-05-16T21:33:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.257+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 15 ==== osd_op_reply(90 1.00000000.inode [writefull 0~582] v42'26 uv26 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.257+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.257+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:91 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd800 con 0x55b23e067600 2024-05-16T21:33:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.258+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 12 ==== osd_op_reply(91 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.258+0000 7fc738909280 4 recover_dentries: frag 10000000001.00000000 fnode old v5 vs new v7 2024-05-16T21:33:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.258+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.258+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:92 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cdc00 con 0x55b23e067600 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 13 ==== osd_op_reply(92 10000000001.00000000 [omap-set-header] v42'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:93 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd000 con 0x55b23e067600 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 14 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals-by-keys out=572b] v0'0 uv8 ondisk = 0) ==== 164+0+572 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc738909280 4 recover_dentries: dentry protectors_head existed already 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc738909280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T21:33:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.259+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:94 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=572b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc000 con 0x55b23e067600 2024-05-16T21:33:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.260+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 15 ==== osd_op_reply(94 10000000001.00000000 [omap-set-vals] v42'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.260+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000003.00000000 2024-05-16T21:33:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.260+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:95 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc400 con 0x55b23e067a80 2024-05-16T21:33:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.261+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 10 ==== osd_op_reply(95 10000000003.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.261+0000 7fc738909280 4 recover_dentries: frag 10000000003.00000000 fnode old v1 vs new v3 2024-05-16T21:33:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.261+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.261+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:96 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd800 con 0x55b23e067a80 2024-05-16T21:33:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.262+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 11 ==== osd_op_reply(96 10000000003.00000000 [omap-set-header] v42'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.262+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:97 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cdc00 con 0x55b23e067a80 2024-05-16T21:33:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.262+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 12 ==== osd_op_reply(97 10000000003.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.262+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000003.00000000/.tmp4015583989 2024-05-16T21:33:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.262+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.262+0000 7fc738909280 4 recover_dentries: writing I dentry .tmp4015583989_head into frag 10000000003.00000000 2024-05-16T21:33:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.262+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:98 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-vals in=614b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e067a80 2024-05-16T21:33:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.263+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 13 ==== osd_op_reply(98 10000000003.00000000 [omap-set-vals] v42'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.263+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.263+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:99 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504c00 con 0x55b23e067600 2024-05-16T21:33:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.264+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 16 ==== osd_op_reply(99 10000000001.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.264+0000 7fc738909280 4 recover_dentries: frag 10000000001.00000000 fnode old v7 vs new v9 2024-05-16T21:33:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.264+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.264+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:100 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e067600 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 17 ==== osd_op_reply(100 10000000001.00000000 [omap-set-header] v42'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:101 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e067600 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 18 ==== osd_op_reply(101 10000000001.00000000 [omap-get-vals-by-keys out=572b] v0'0 uv10 ondisk = 0) ==== 164+0+572 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc738909280 4 recover_dentries: dentry protectors_head existed already 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 8 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc738909280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T21:33:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.265+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:102 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=572b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e067600 2024-05-16T21:33:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.266+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 19 ==== osd_op_reply(102 10000000001.00000000 [omap-set-vals] v42'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.266+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000003.00000000 2024-05-16T21:33:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.266+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:103 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e067a80 2024-05-16T21:33:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.267+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 14 ==== osd_op_reply(103 10000000003.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.267+0000 7fc738909280 4 recover_dentries: frag 10000000003.00000000 fnode old v3 vs new v5 2024-05-16T21:33:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.267+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.267+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:104 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505c00 con 0x55b23e067a80 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 15 ==== osd_op_reply(104 10000000003.00000000 [omap-set-header] v42'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:105 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e067a80 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 16 ==== osd_op_reply(105 10000000003.00000000 [omap-get-vals-by-keys out=614b] v0'0 uv5 ondisk = 0) ==== 164+0+614 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000003.00000000/.tmp4015583989 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc738909280 4 recover_dentries: dentry .tmp4015583989_head existed already 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc738909280 4 recover_dentries: writing I dentry .tmp4015583989_head into frag 10000000003.00000000 2024-05-16T21:33:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.268+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:106 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-vals in=622b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc800 con 0x55b23e067a80 2024-05-16T21:33:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.269+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 17 ==== osd_op_reply(106 10000000003.00000000 [omap-set-vals] v42'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.269+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.269+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:107 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc400 con 0x55b23e067600 2024-05-16T21:33:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.269+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 20 ==== osd_op_reply(107 10000000001.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.269+0000 7fc738909280 4 recover_dentries: frag 10000000001.00000000 fnode old v9 vs new v13 2024-05-16T21:33:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.269+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.269+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:108 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd800 con 0x55b23e067600 2024-05-16T21:33:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 21 ==== osd_op_reply(108 10000000001.00000000 [omap-set-header] v42'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:109 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cdc00 con 0x55b23e067600 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 22 ==== osd_op_reply(109 10000000001.00000000 [omap-get-vals-by-keys out=572b] v0'0 uv12 ondisk = 0) ==== 164+0+572 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: dentry protectors_head existed already 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 12 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: dentry protectors_head existed already 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 12 2024-05-16T21:33:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T21:33:46.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.271+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:110 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=572b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd000 con 0x55b23e067600 2024-05-16T21:33:46.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.272+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 23 ==== osd_op_reply(110 10000000001.00000000 [omap-set-vals] v42'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.272+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000003.00000000 2024-05-16T21:33:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.272+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:111 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc000 con 0x55b23e067a80 2024-05-16T21:33:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.272+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 18 ==== osd_op_reply(111 10000000003.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.272+0000 7fc738909280 4 recover_dentries: frag 10000000003.00000000 fnode old v5 vs new v9 2024-05-16T21:33:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.272+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.272+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:112 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc400 con 0x55b23e067a80 2024-05-16T21:33:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.273+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 19 ==== osd_op_reply(112 10000000003.00000000 [omap-set-header] v42'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.273+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:113 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-vals-by-keys in=52b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd800 con 0x55b23e067a80 2024-05-16T21:33:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.274+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 20 ==== osd_op_reply(113 10000000003.00000000 [omap-get-vals-by-keys out=622b] v0'0 uv7 ondisk = 0) ==== 164+0+622 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.274+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000003.00000000/782e67495556e4f0 2024-05-16T21:33:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.274+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.274+0000 7fc738909280 4 recover_dentries: writing I dentry 782e67495556e4f0_head into frag 10000000003.00000000 2024-05-16T21:33:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.274+0000 7fc738909280 4 recover_dentries: inspecting nullbit 10000000003.00000000/.tmp4015583989 2024-05-16T21:33:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.274+0000 7fc738909280 4 recover_dentries: dentry exists, will remove 2024-05-16T21:33:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.274+0000 7fc738909280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '.tmp4015583989' with lump fnode version 9vs existing fnode version 5 2024-05-16T21:33:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.274+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:114 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-vals in=624b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504c00 con 0x55b23e067a80 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.275+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 21 ==== osd_op_reply(114 10000000003.00000000 [omap-set-vals] v42'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.275+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:115 6.12 6:4def72d4:::10000000003.00000000:head [omap-rm-keys in=27b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e067a80 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.276+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 22 ==== osd_op_reply(115 10000000003.00000000 [omap-rm-keys] v42'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.276+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.276+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:116 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e067600 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.276+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 24 ==== osd_op_reply(116 10000000001.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.276+0000 7fc738909280 4 recover_dentries: frag 10000000001.00000000 fnode old v13 vs new v15 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.276+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.276+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:117 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e067600 2024-05-16T21:33:46.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.277+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 25 ==== osd_op_reply(117 10000000001.00000000 [omap-set-header] v42'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.277+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:118 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604000 con 0x55b23e067600 2024-05-16T21:33:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.277+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 26 ==== osd_op_reply(118 10000000001.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv14 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.277+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T21:33:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.277+0000 7fc738909280 4 recover_dentries: dentry policies_head existed already 2024-05-16T21:33:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.278+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.278+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 14 2024-05-16T21:33:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.278+0000 7fc738909280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T21:33:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.278+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:119 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604400 con 0x55b23e067600 2024-05-16T21:33:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.278+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 27 ==== osd_op_reply(119 10000000001.00000000 [omap-set-vals] v42'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.279+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000002.00000000 2024-05-16T21:33:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.279+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:120 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604800 con 0x55b23e067a80 2024-05-16T21:33:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.279+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 23 ==== osd_op_reply(120 10000000002.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.279+0000 7fc738909280 4 recover_dentries: frag 10000000002.00000000 fnode old v1 vs new v3 2024-05-16T21:33:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.279+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.279+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:121 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604c00 con 0x55b23e067a80 2024-05-16T21:33:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.280+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 24 ==== osd_op_reply(121 10000000002.00000000 [omap-set-header] v42'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.280+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:122 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d605000 con 0x55b23e067a80 2024-05-16T21:33:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.280+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 25 ==== osd_op_reply(122 10000000002.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.280+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000002.00000000/.tmp3856600089 2024-05-16T21:33:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.280+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.280+0000 7fc738909280 4 recover_dentries: writing I dentry .tmp3856600089_head into frag 10000000002.00000000 2024-05-16T21:33:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.280+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:123 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-vals in=614b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d605400 con 0x55b23e067a80 2024-05-16T21:33:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.281+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 26 ==== osd_op_reply(123 10000000002.00000000 [omap-set-vals] v42'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.281+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.281+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:124 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d605800 con 0x55b23e067600 2024-05-16T21:33:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.282+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 28 ==== osd_op_reply(124 10000000001.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.282+0000 7fc738909280 4 recover_dentries: frag 10000000001.00000000 fnode old v15 vs new v17 2024-05-16T21:33:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.282+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.282+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:125 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d605c00 con 0x55b23e067600 2024-05-16T21:33:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 29 ==== osd_op_reply(125 10000000001.00000000 [omap-set-header] v42'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:126 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604800 con 0x55b23e067600 2024-05-16T21:33:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 30 ==== osd_op_reply(126 10000000001.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv16 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T21:33:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc738909280 4 recover_dentries: dentry policies_head existed already 2024-05-16T21:33:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 16 2024-05-16T21:33:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc738909280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T21:33:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.283+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:127 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604c00 con 0x55b23e067600 2024-05-16T21:33:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.284+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 31 ==== osd_op_reply(127 10000000001.00000000 [omap-set-vals] v42'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.284+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000002.00000000 2024-05-16T21:33:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.284+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:128 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505000 con 0x55b23e067a80 2024-05-16T21:33:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.284+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 27 ==== osd_op_reply(128 10000000002.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.284+0000 7fc738909280 4 recover_dentries: frag 10000000002.00000000 fnode old v3 vs new v5 2024-05-16T21:33:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.284+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.284+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:129 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505c00 con 0x55b23e067a80 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.285+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 28 ==== osd_op_reply(129 10000000002.00000000 [omap-set-header] v42'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.285+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:130 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504000 con 0x55b23e067a80 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.286+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 29 ==== osd_op_reply(130 10000000002.00000000 [omap-get-vals-by-keys out=614b] v0'0 uv12 ondisk = 0) ==== 164+0+614 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.286+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000002.00000000/.tmp3856600089 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.286+0000 7fc738909280 4 recover_dentries: dentry .tmp3856600089_head existed already 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.286+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.286+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.286+0000 7fc738909280 4 recover_dentries: writing I dentry .tmp3856600089_head into frag 10000000002.00000000 2024-05-16T21:33:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.286+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:131 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-vals in=622b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504c00 con 0x55b23e067a80 2024-05-16T21:33:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.287+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 30 ==== osd_op_reply(131 10000000002.00000000 [omap-set-vals] v42'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.287+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T21:33:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.287+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:132 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d504400 con 0x55b23e067600 2024-05-16T21:33:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.287+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 32 ==== osd_op_reply(132 10000000001.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.287+0000 7fc738909280 4 recover_dentries: frag 10000000001.00000000 fnode old v17 vs new v21 2024-05-16T21:33:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.287+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.287+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:133 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc800 con 0x55b23e067600 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 33 ==== osd_op_reply(133 10000000001.00000000 [omap-set-header] v42'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:134 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc000 con 0x55b23e067600 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 34 ==== osd_op_reply(134 10000000001.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv18 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: dentry policies_head existed already 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 16 vs fullbit version 20 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: dentry policies_head existed already 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 16 vs fullbit version 20 2024-05-16T21:33:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T21:33:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.288+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- osd_op(unknown.0.0:135 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cc400 con 0x55b23e067600 2024-05-16T21:33:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.289+0000 7fc7368b6640 1 -- 172.21.15.5:0/3197620445 <== osd.5 v2:172.21.15.157:6808/2462600028 35 ==== osd_op_reply(135 10000000001.00000000 [omap-set-vals] v42'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b1180 con 0x55b23e067600 2024-05-16T21:33:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.289+0000 7fc738909280 4 recover_dentries: inspecting lump 10000000002.00000000 2024-05-16T21:33:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.289+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:136 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd800 con 0x55b23e067a80 2024-05-16T21:33:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.290+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 31 ==== osd_op_reply(136 10000000002.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.290+0000 7fc738909280 4 recover_dentries: frag 10000000002.00000000 fnode old v5 vs new v9 2024-05-16T21:33:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.290+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.290+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:137 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604000 con 0x55b23e067a80 2024-05-16T21:33:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 32 ==== osd_op_reply(137 10000000002.00000000 [omap-set-header] v42'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:138 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=68b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604400 con 0x55b23e067a80 2024-05-16T21:33:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 33 ==== osd_op_reply(138 10000000002.00000000 [omap-get-vals-by-keys out=622b] v0'0 uv14 ondisk = 0) ==== 164+0+622 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc738909280 4 recover_dentries: inspecting fullbit 10000000002.00000000/774a36a85695620b4975dac12d64369b 2024-05-16T21:33:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc738909280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T21:33:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc738909280 4 recover_dentries: writing I dentry 774a36a85695620b4975dac12d64369b_head into frag 10000000002.00000000 2024-05-16T21:33:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc738909280 4 recover_dentries: inspecting nullbit 10000000002.00000000/.tmp3856600089 2024-05-16T21:33:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc738909280 4 recover_dentries: dentry exists, will remove 2024-05-16T21:33:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc738909280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '.tmp3856600089' with lump fnode version 9vs existing fnode version 5 2024-05-16T21:33:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.291+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:139 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-vals in=640b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d605800 con 0x55b23e067a80 2024-05-16T21:33:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.292+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 34 ==== osd_op_reply(139 10000000002.00000000 [omap-set-vals] v42'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.292+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- osd_op(unknown.0.0:140 6.12 6:4bec3886:::10000000002.00000000:head [omap-rm-keys in=27b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d605c00 con 0x55b23e067a80 2024-05-16T21:33:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.293+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.7 v2:172.21.15.157:6816/3015790228 35 ==== osd_op_reply(140 10000000002.00000000 [omap-rm-keys] v42'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067a80 2024-05-16T21:33:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.293+0000 7fc738909280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T21:33:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.293+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:141 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604800 con 0x55b23e067180 2024-05-16T21:33:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.294+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 33 ==== osd_op_reply(141 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.294+0000 7fc738909280 4 recover_dentries: frag 1.00000000 fnode old v15 vs new v17 2024-05-16T21:33:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.294+0000 7fc738909280 4 recover_dentries: writing fnode to omap header 2024-05-16T21:33:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.294+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:142 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505400 con 0x55b23e067180 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 34 ==== osd_op_reply(142 1.00000000 [omap-set-header] v42'16 uv16 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:143 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d505800 con 0x55b23e067180 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 35 ==== osd_op_reply(143 1.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv16 ondisk = 0) ==== 154+0+565 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc738909280 4 recover_dentries: inspecting fullbit 1.00000000/dir 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc738909280 4 recover_dentries: dentry dir_head existed already 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc738909280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc738909280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 16 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc738909280 4 recover_dentries: writing I dentry dir_head into frag 1.00000000 2024-05-16T21:33:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.295+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:144 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=613b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cdc00 con 0x55b23e067180 2024-05-16T21:33:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.296+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 36 ==== osd_op_reply(144 1.00000000 [omap-set-vals] v42'17 uv17 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.296+0000 7fc738909280 4 recover_dentries: updating root 0x0x1 2024-05-16T21:33:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.296+0000 7fc738909280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T21:33:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.296+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:145 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d5cd000 con 0x55b23e066d00 2024-05-16T21:33:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.296+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 16 ==== osd_op_reply(145 1.00000000.inode [read 0~582 out=582b] v0'0 uv26 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.296+0000 7fc738909280 4 recover_dentries: root exists, will modify (582) 2024-05-16T21:33:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.296+0000 7fc738909280 4 recover_dentries: magic ok 2024-05-16T21:33:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.297+0000 7fc738909280 4 recover_dentries: writing root ino 1.00000000.inode version 8 2024-05-16T21:33:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.297+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:146 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d605000 con 0x55b23e066d00 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 <== osd.2 v2:172.21.15.5:6816/2608436175 17 ==== osd_op_reply(146 1.00000000.inode [writefull 0~582] v42'27 uv27 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x55b23d2aa000 con 0x55b23e066d00 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 main_event: consumed 8 inodes 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:147 6.13 6:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b23d605400 con 0x55b23e067180 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 37 ==== osd_op_reply(147 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 consume_inos: Used ino 0x0x10000000000 requires inotable update 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 consume_inos: Used ino 0x0x10000000001 requires inotable update 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 consume_inos: Used ino 0x0x10000000002 requires inotable update 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 consume_inos: Used ino 0x0x10000000003 requires inotable update 2024-05-16T21:33:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 consume_inos: Used ino 0x0x10000000004 requires inotable update 2024-05-16T21:33:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 consume_inos: Used ino 0x0x10000000005 requires inotable update 2024-05-16T21:33:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 consume_inos: Used ino 0x0x100000001fa requires inotable update 2024-05-16T21:33:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 4 consume_inos: writing modified inotable version 1 2024-05-16T21:33:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.298+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:148 6.13 6:c91d4a1d:::mds0_inotable:head [writefull 0~50 in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x55b23d604000 con 0x55b23e067180 2024-05-16T21:33:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc7378b8640 1 -- 172.21.15.5:0/3197620445 <== osd.3 v2:172.21.15.5:6808/1040173321 38 ==== osd_op_reply(148 mds0_inotable [writefull 0~50] v42'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x55b23d5b0f00 con 0x55b23e067180 2024-05-16T21:33:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:0.000000 0x400000 LID: () 2024-05-16T21:33:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:32.892547+0000 0x400030 SUBTREEMAP: () 2024-05-16T21:33:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:39.934222+0000 0x4003ac SESSION: () 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:40.022845+0000 0x4004ae OPEN: () 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:40.023043+0000 0x40055a UPDATE: (setattr) 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout: / 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:43.988579+0000 0x400889 UPDATE: (mkdir) 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout: .tmp4248767462 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:43.992309+0000 0x4010ac UPDATE: (mkdir) 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout: .tmp4248767462/.fscrypt 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:43.993203+0000 0x401a06 UPDATE: (mkdir) 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout: .fscrypt/policies 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:43.994295+0000 0x40235a UPDATE: (mkdir) 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout: .fscrypt/protectors 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:43.999508+0000 0x402cb0 UPDATE: (rename) 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout: .fscrypt 2024-05-16T21:33:46.303 INFO:teuthology.orchestra.run.smithi005.stdout: .tmp4248767462/.fscrypt 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.004869+0000 0x40372f UPDATE: (unlink_local) 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout: .tmp4248767462 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout: stray2/10000000000 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.064260+0000 0x4042d7 UPDATE: (scatter_writebehind) 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.404858+0000 0x404749 UPDATE: (mkdir) 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout: dir 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.557385+0000 0x404f51 UPDATE: (openc) 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout: protectors/.tmp4015583989 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.562660+0000 0x40577f UPDATE: (cap update) 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout: protectors/.tmp4015583989 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.566459+0000 0x405fba UPDATE: (rename) 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout: protectors/782e67495556e4f0 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout: protectors/.tmp4015583989 2024-05-16T21:33:46.304 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.570973+0000 0x406a66 UPDATE: (openc) 2024-05-16T21:33:46.305 INFO:teuthology.orchestra.run.smithi005.stdout: policies/.tmp3856600089 2024-05-16T21:33:46.305 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.574697+0000 0x4072a2 UPDATE: (cap update) 2024-05-16T21:33:46.305 INFO:teuthology.orchestra.run.smithi005.stdout: policies/.tmp3856600089 2024-05-16T21:33:46.305 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.578275+0000 0x407adb UPDATE: (rename) 2024-05-16T21:33:46.305 INFO:teuthology.orchestra.run.smithi005.stdout: policies/774a36a85695620b4975dac12d64369b 2024-05-16T21:33:46.305 INFO:teuthology.orchestra.run.smithi005.stdout: policies/.tmp3856600089 2024-05-16T21:33:46.305 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:44.581649+0000 0x408593 UPDATE: (cap update) 2024-05-16T21:33:46.305 INFO:teuthology.orchestra.run.smithi005.stdout: dir 2024-05-16T21:33:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 4 20 events 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x55b23e065200 msgr2=0x55b23d277180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x55b23e065200 0x55b23d277180 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x55b23e066d00 msgr2=0x55b23d276680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x55b23e066d00 0x55b23d276680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x55b23e067180 msgr2=0x55b23d276c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x55b23e067180 0x55b23d276c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x55b23e067600 msgr2=0x55b23d277700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x55b23e067600 0x55b23d277700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x55b23e067a80 msgr2=0x55b23d5ce000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x55b23e067a80 0x55b23d5ce000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 reap_dead start 2024-05-16T21:33:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.299+0000 7fc7370b7640 1 -- 172.21.15.5:0/3197620445 reap_dead start 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x55b23e065680 msgr2=0x55b23d276100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x55b23e065680 0x55b23d276100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55b23dfc70b0 tx=0x55b23d2bbb00 comp rx=0 tx=0).stop 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e066880 msgr2=0x55b23d275b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e066880 0x55b23d275b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b23e09e6f0 tx=0x55b23d2bb860 comp rx=0 tx=0).stop 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 shutdown_connections 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x55b23e065680 0x55b23d276100 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 --2- 172.21.15.5:0/3197620445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e066880 0x55b23d275b80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 >> 172.21.15.5:0/3197620445 conn(0x55b23e065b00 msgr2=0x55b23d2a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 shutdown_connections 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/3197620445 wait complete. 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/2843808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e064900 msgr2=0x55b23d274580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e064900 0x55b23d274580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55b23dfc7560 tx=0x55b23d2bbe00 comp rx=0 tx=0).stop 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/2843808085 shutdown_connections 2024-05-16T21:33:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b23e064d80 0x55b23d274b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b23e064900 0x55b23d274580 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 --2- 172.21.15.5:0/2843808085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b23e064480 0x55b23d274000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/2843808085 >> 172.21.15.5:0/2843808085 conn(0x55b23e064000 msgr2=0x55b23d2a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/2843808085 shutdown_connections 2024-05-16T21:33:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.300+0000 7fc738909280 1 -- 172.21.15.5:0/2843808085 wait complete. 2024-05-16T21:33:46.310 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'list'] in time 0:00:00.186315, result: 0.000000 0x400000 LID: () 2024-05-16T21:33:32.892547+0000 0x400030 SUBTREEMAP: () 2024-05-16T21:33:39.934222+0000 0x4003ac SESSION: () 2024-05-16T21:33:40.022845+0000 0x4004ae OPEN: () 2024-05-16T21:33:40.023043+0000 0x40055a UPDATE: (setattr) / 2024-05-16T21:33:43.988579+0000 0x400889 UPDATE: (mkdir) .tmp4248767462 2024-05-16T21:33:43.992309+0000 0x4010ac UPDATE: (mkdir) .tmp4248767462/.fscrypt 2024-05-16T21:33:43.993203+0000 0x401a06 UPDATE: (mkdir) .fscrypt/policies 2024-05-16T21:33:43.994295+0000 0x40235a UPDATE: (mkdir) .fscrypt/protectors 2024-05-16T21:33:43.999508+0000 0x402cb0 UPDATE: (rename) .fscrypt .tmp4248767462/.fscrypt 2024-05-16T21:33:44.004869+0000 0x40372f UPDATE: (unlink_local) .tmp4248767462 stray2/10000000000 2024-05-16T21:33:44.064260+0000 0x4042d7 UPDATE: (scatter_writebehind) 2024-05-16T21:33:44.404858+0000 0x404749 UPDATE: (mkdir) dir 2024-05-16T21:33:44.557385+0000 0x404f51 UPDATE: (openc) protectors/.tmp4015583989 2024-05-16T21:33:44.562660+0000 0x40577f UPDATE: (cap update) protectors/.tmp4015583989 2024-05-16T21:33:44.566459+0000 0x405fba UPDATE: (rename) protectors/782e67495556e4f0 protectors/.tmp4015583989 2024-05-16T21:33:44.570973+0000 0x406a66 UPDATE: (openc) policies/.tmp3856600089 2024-05-16T21:33:44.574697+0000 0x4072a2 UPDATE: (cap update) policies/.tmp3856600089 2024-05-16T21:33:44.578275+0000 0x407adb UPDATE: (rename) policies/774a36a85695620b4975dac12d64369b policies/.tmp3856600089 2024-05-16T21:33:44.581649+0000 0x408593 UPDATE: (cap update) dir 2024-05-16T21:33:46.310 DEBUG:teuthology.orchestra.run.smithi005:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-05-16T21:33:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.360+0000 7f1a6c998280 1 -- start start 2024-05-16T21:33:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.360+0000 7f1a6c998280 1 Processor -- start 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c4480 0x5573d28cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c4900 0x5573d28cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c4d80 0x5573d28ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6c998280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5573d35da180 con 0x5573d28c4480 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6c998280 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5573d35da300 con 0x5573d28c4900 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6c998280 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x5573d35da480 con 0x5573d28c4d80 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6b146640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c4480 0x5573d28cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6b146640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c4480 0x5573d28cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46642/0 (socket says 172.21.15.5:46642) 2024-05-16T21:33:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.361+0000 7f1a6b146640 1 -- 172.21.15.5:0/2850068951 learned_addr learned my addr 172.21.15.5:0/2850068951 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6a945640 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c4900 0x5573d28cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6b947640 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c4d80 0x5573d28ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6b146640 1 -- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c4d80 msgr2=0x5573d28ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6b146640 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c4d80 0x5573d28ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6b146640 1 -- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c4900 msgr2=0x5573d28cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6b146640 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c4900 0x5573d28cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6b146640 1 -- 172.21.15.5:0/2850068951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ce81a780 con 0x5573d28c4480 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6a945640 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c4900 0x5573d28cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6b146640 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c4480 0x5573d28cc580 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5573d36230b0 tx=0x5573d290fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47a355b74a4a963 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a68941640 1 -- 172.21.15.5:0/2850068951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573ce80a9c0 con 0x5573d28c4480 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a68941640 1 -- 172.21.15.5:0/2850068951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5573ce810fc0 con 0x5573d28c4480 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a68941640 1 -- 172.21.15.5:0/2850068951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573ce80a680 con 0x5573d28c4480 2024-05-16T21:33:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6c998280 1 -- 172.21.15.5:0/2850068951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ce81a3c0 con 0x5573d28c4480 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6c998280 1 -- 172.21.15.5:0/2850068951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5573ce81b680 con 0x5573d28c4480 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6c998280 4 waiting for MDS map... 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a68941640 1 -- 172.21.15.5:0/2850068951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x5573d36d0600 con 0x5573d28c4480 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a68941640 1 -- 172.21.15.5:0/2850068951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 2280+0+0 (secure 0 0 0) 0x5573d286f180 con 0x5573d28c4480 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6c998280 4 Got MDS map 26 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.362+0000 7f1a6c998280 10 main: JournalTool::main 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.363+0000 7f1a6c998280 4 main: JournalTool: connecting to RADOS... 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.363+0000 7f1a6c998280 1 Processor -- start 2024-05-16T21:33:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.363+0000 7f1a6c998280 1 -- start start 2024-05-16T21:33:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5680 0x5573d28cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5b00 0x5573d28cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6c998280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5573d35da600 con 0x5573d28c5b00 2024-05-16T21:33:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6c998280 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5573d35da780 con 0x5573d28c5f80 2024-05-16T21:33:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6c998280 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x5573d35da900 con 0x5573d28c5680 2024-05-16T21:33:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6b146640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5b00 0x5573d28cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6b146640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5b00 0x5573d28cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46658/0 (socket says 172.21.15.5:46658) 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6b146640 1 -- 172.21.15.5:0/949965483 learned_addr learned my addr 172.21.15.5:0/949965483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6a945640 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6b146640 1 -- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5680 msgr2=0x5573d28cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6b947640 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5680 0x5573d28cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6b146640 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5680 0x5573d28cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6b146640 1 -- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 msgr2=0x5573d28cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.364+0000 7f1a6b146640 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6b146640 1 -- 172.21.15.5:0/949965483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ce81b4a0 con 0x5573d28c5b00 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6a945640 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6b146640 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5b00 0x5573d28cd600 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5573d3623470 tx=0x5573d290fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b2295004a74edd server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6693d640 1 -- 172.21.15.5:0/949965483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573ce80ab60 con 0x5573d28c5b00 2024-05-16T21:33:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6693d640 1 -- 172.21.15.5:0/949965483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5573ce810e00 con 0x5573d28c5b00 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6693d640 1 -- 172.21.15.5:0/949965483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573ce80a820 con 0x5573d28c5b00 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 -- 172.21.15.5:0/949965483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5b00 msgr2=0x5573d28cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5b00 0x5573d28cd600 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5573d3623470 tx=0x5573d290fbc0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 -- 172.21.15.5:0/949965483 shutdown_connections 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5b00 0x5573d28cd600 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 --2- 172.21.15.5:0/949965483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5680 0x5573d28cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 -- 172.21.15.5:0/949965483 >> 172.21.15.5:0/949965483 conn(0x5573d28c5200 msgr2=0x5573d28fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 -- 172.21.15.5:0/949965483 shutdown_connections 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.365+0000 7f1a6c998280 1 -- 172.21.15.5:0/949965483 wait complete. 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.366+0000 7f1a6c998280 1 Processor -- start 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.366+0000 7f1a6c998280 1 -- start start 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5680 0x5573d28cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5b00 0x5573d28cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6c998280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5573d35db800 con 0x5573d28c5680 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6c998280 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5573d35db680 con 0x5573d28c5f80 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6c998280 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x5573d35db500 con 0x5573d28c5b00 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6b947640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5680 0x5573d28cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6b947640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5680 0x5573d28cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46676/0 (socket says 172.21.15.5:46676) 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6b947640 1 -- 172.21.15.5:0/644936889 learned_addr learned my addr 172.21.15.5:0/644936889 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6a945640 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.367+0000 7f1a6b146640 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5b00 0x5573d28cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6b947640 1 -- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5b00 msgr2=0x5573d28cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6b947640 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5b00 0x5573d28cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6b947640 1 -- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 msgr2=0x5573d28cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6b947640 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6b947640 1 -- 172.21.15.5:0/644936889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ce81a000 con 0x5573d28c5680 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6b947640 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5680 0x5573d28cd080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5573d36df800 tx=0x5573d36ddce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6513a640 1 -- 172.21.15.5:0/644936889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573ce80ab60 con 0x5573d28c5680 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6513a640 1 -- 172.21.15.5:0/644936889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5573ce810a80 con 0x5573d28c5680 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6c998280 1 -- 172.21.15.5:0/644936889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ce81a960 con 0x5573d28c5680 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6513a640 1 -- 172.21.15.5:0/644936889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573ce80a820 con 0x5573d28c5680 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6c998280 1 -- 172.21.15.5:0/644936889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ce81b860 con 0x5573d28c5680 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.368+0000 7f1a6c998280 4 main: JournalTool: resolving pool 6 2024-05-16T21:33:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.369+0000 7f1a6513a640 1 -- 172.21.15.5:0/644936889 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x5573d3726c00 con 0x5573d28c5680 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.370+0000 7f1a6513a640 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x5573d28c7600 0x5573d28ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.370+0000 7f1a6513a640 1 -- 172.21.15.5:0/644936889 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x5573d3725000 con 0x5573d28c5680 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.370+0000 7f1a6c998280 4 main: JournalTool: creating IoCtx.. 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.370+0000 7f1a6c998280 4 main: Executing for rank 0 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.370+0000 7f1a6b146640 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x5573d28c7600 0x5573d28ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.370+0000 7f1a6b146640 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x5573d28c7600 0x5573d28ce100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5573d3623470 tx=0x5573d290f8c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.371+0000 7f1a6c998280 1 -- start start 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.371+0000 7f1a6c998280 1 Processor -- start 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c6880 0x5573d28ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c6d00 0x5573d28cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6c998280 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c7180 0x5573d28cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6c998280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5573d35da780 con 0x5573d28c6d00 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6c998280 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5573d35da900 con 0x5573d28c6880 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6c998280 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x5573d35db200 con 0x5573d28c7180 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c6d00 0x5573d28cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b947640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c6880 0x5573d28ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c6d00 0x5573d28cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46678/0 (socket says 172.21.15.5:46678) 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 -- 172.21.15.5:0/4000383430 learned_addr learned my addr 172.21.15.5:0/4000383430 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6a945640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c7180 0x5573d28cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 -- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c7180 msgr2=0x5573d28cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c7180 0x5573d28cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 -- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c6880 msgr2=0x5573d28ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c6880 0x5573d28ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ce81ba40 con 0x5573d28c6d00 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6b146640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c6d00 0x5573d28cec00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x5573d37543c0 tx=0x5573d290fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856bebdfcae7e181 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a62134640 1 -- 172.21.15.5:0/4000383430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573d3766820 con 0x5573d28c6d00 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a62134640 1 -- 172.21.15.5:0/4000383430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5573ce810c40 con 0x5573d28c6d00 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a62134640 1 -- 172.21.15.5:0/4000383430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573d3766680 con 0x5573d28c6d00 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.372+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ce81a780 con 0x5573d28c6d00 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5573ce81a3c0 con 0x5573d28c6d00 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a6c998280 4 waiting for MDS map... 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a62134640 1 -- 172.21.15.5:0/4000383430 <== mon.0 v2:172.21.15.5:3300/0 4 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x5573d2c2a200 con 0x5573d28c6d00 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a62134640 1 -- 172.21.15.5:0/4000383430 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 2280+0+0 (secure 0 0 0) 0x5573d286f500 con 0x5573d28c6d00 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a6c998280 4 Got MDS map 26 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x5573d28c7a80 0x5573d28cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c29c00 con 0x5573d28c7a80 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a6b947640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x5573d28c7a80 0x5573d28cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.373+0000 7f1a6b947640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x5573d28c7a80 0x5573d28cf700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=b41b8d0aa925ea78 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.374+0000 7f1a6b947640 1 -- 172.21.15.5:0/4000383430 <== osd.2 v2:172.21.15.5:6816/2608436175 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5573d28fe500 con 0x5573d28c7a80 2024-05-16T21:33:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.374+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3e000 con 0x5573d28c7a80 2024-05-16T21:33:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.374+0000 7f1a6b947640 1 -- 172.21.15.5:0/4000383430 <== osd.2 v2:172.21.15.5:6816/2608436175 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv3 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5573d28fe500 con 0x5573d28c7a80 2024-05-16T21:33:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.374+0000 7f1a60931640 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3ec00 con 0x5573d28c7a80 2024-05-16T21:33:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.374+0000 7f1a6b947640 1 -- 172.21.15.5:0/4000383430 <== osd.2 v2:172.21.15.5:6816/2608436175 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv19 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5573d28fe500 con 0x5573d28c7a80 2024-05-16T21:33:46.382 INFO:teuthology.orchestra.run.smithi005.stdout:old journal was 4194304~35968 2024-05-16T21:33:46.383 INFO:teuthology.orchestra.run.smithi005.stdout:new journal start will be 8388608 (4158336 bytes past old end) 2024-05-16T21:33:46.383 INFO:teuthology.orchestra.run.smithi005.stdout:writing journal head 2024-05-16T21:33:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.375+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- osd_op(unknown.0.0:4 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3e400 con 0x5573d28c7a80 2024-05-16T21:33:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6b947640 1 -- 172.21.15.5:0/4000383430 <== osd.2 v2:172.21.15.5:6816/2608436175 4 ==== osd_op_reply(4 200.00000000 [writefull 0~90] v42'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5573d28fe500 con 0x5573d28c7a80 2024-05-16T21:33:46.383 INFO:teuthology.orchestra.run.smithi005.stdout:writing EResetJournal entry 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x5573d2c48000 0x5573d2c4c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:5 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3e800 con 0x5573d2c48000 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:6 6.b 6:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3e000 con 0x5573d2c48000 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:7 6.1f 6:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3ec00 con 0x5573d2c48000 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x5573d2c48480 0x5573d2c4c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] -- osd_op(unknown.0.0:8 6.1a 6:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3e400 con 0x5573d2c48480 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] -- osd_op(unknown.0.0:9 6.1e 6:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c29c00 con 0x5573d2c48480 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x5573d2c48900 0x5573d2c4cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6a945640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x5573d2c48000 0x5573d2c4c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] -- osd_op(unknown.0.0:10 6.1d 6:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3f000 con 0x5573d2c48900 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6b146640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x5573d2c48900 0x5573d2c4cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6b947640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x5573d2c48480 0x5573d2c4c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6a945640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x5573d2c48000 0x5573d2c4c000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=deb62b0198ade984 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.376+0000 7f1a6b146640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x5573d2c48900 0x5573d2c4cb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=9ff5362a379bd768 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.377+0000 7f1a6b947640 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x5573d2c48480 0x5573d2c4c580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=e18e1688e89e1674 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.378+0000 7f1a6b146640 1 -- 172.21.15.5:0/4000383430 <== osd.1 v2:172.21.15.5:6824/1146909345 1 ==== osd_op_reply(10 200.00000007 [delete] v42'4 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5573d28fe780 con 0x5573d2c48900 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.378+0000 7f1a6a945640 1 -- 172.21.15.5:0/4000383430 <== osd.3 v2:172.21.15.5:6808/1040173321 1 ==== osd_op_reply(5 200.00000002 [delete] v42'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5573d28fea00 con 0x5573d2c48000 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.378+0000 7f1a6a945640 1 -- 172.21.15.5:0/4000383430 <== osd.3 v2:172.21.15.5:6808/1040173321 2 ==== osd_op_reply(7 200.00000004 [delete] v42'18 uv17 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5573d28fea00 con 0x5573d2c48000 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.378+0000 7f1a6a945640 1 -- 172.21.15.5:0/4000383430 <== osd.3 v2:172.21.15.5:6808/1040173321 3 ==== osd_op_reply(6 200.00000003 [delete] v42'4 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5573d28fea00 con 0x5573d2c48000 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.378+0000 7f1a6b947640 1 -- 172.21.15.5:0/4000383430 <== osd.4 v2:172.21.15.157:6824/3329892271 1 ==== osd_op_reply(8 200.00000005 [delete] v42'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5573d28fe500 con 0x5573d2c48480 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.378+0000 7f1a60931640 1 -- 172.21.15.5:0/4000383430 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- osd_op(unknown.0.0:11 6.1b 6:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5573d2c3e800 con 0x5573d2c48000 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.378+0000 7f1a6b947640 1 -- 172.21.15.5:0/4000383430 <== osd.4 v2:172.21.15.157:6824/3329892271 2 ==== osd_op_reply(9 200.00000006 [delete] v42'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5573d28fe500 con 0x5573d2c48480 2024-05-16T21:33:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6a945640 1 -- 172.21.15.5:0/4000383430 <== osd.3 v2:172.21.15.5:6808/1040173321 4 ==== osd_op_reply(11 200.00000002 [write 0~48] v42'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5573d28fea00 con 0x5573d2c48000 2024-05-16T21:33:46.388 INFO:teuthology.orchestra.run.smithi005.stdout:done 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x5573d2c48900 msgr2=0x5573d2c4cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x5573d2c48900 0x5573d2c4cb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x5573d28c7a80 msgr2=0x5573d28cf700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x5573d28c7a80 0x5573d28cf700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x5573d2c48000 msgr2=0x5573d2c4c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x5573d2c48000 0x5573d2c4c000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x5573d2c48480 msgr2=0x5573d2c4c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x5573d2c48480 0x5573d2c4c580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6a945640 1 -- 172.21.15.5:0/4000383430 reap_dead start 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6a945640 1 -- 172.21.15.5:0/4000383430 reap_dead start 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.379+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c6d00 msgr2=0x5573d28cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c6d00 0x5573d28cec00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x5573d37543c0 tx=0x5573d290fb60 comp rx=0 tx=0).stop 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 shutdown_connections 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/4000383430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c6d00 0x5573d28cec00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 >> 172.21.15.5:0/4000383430 conn(0x5573d28c6400 msgr2=0x5573d2bd4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 shutdown_connections 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/4000383430 wait complete. 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x5573d28c7600 msgr2=0x5573d28ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x5573d28c7600 0x5573d28ce100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5573d3623470 tx=0x5573d290f8c0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/644936889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5680 msgr2=0x5573d28cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5680 0x5573d28cd080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5573d36df800 tx=0x5573d36ddce0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/644936889 shutdown_connections 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x5573d28c7600 0x5573d28ce100 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c5f80 0x5573d28cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c5b00 0x5573d28cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/644936889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c5680 0x5573d28cd080 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/644936889 >> 172.21.15.5:0/644936889 conn(0x5573d28c5200 msgr2=0x5573d28fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/644936889 shutdown_connections 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/644936889 wait complete. 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/2850068951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c4480 msgr2=0x5573d28cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c4480 0x5573d28cc580 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5573d36230b0 tx=0x5573d290fb00 comp rx=0 tx=0).stop 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/2850068951 shutdown_connections 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5573d28c4d80 0x5573d28ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5573d28c4900 0x5573d28cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 --2- 172.21.15.5:0/2850068951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5573d28c4480 0x5573d28cc580 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/2850068951 >> 172.21.15.5:0/2850068951 conn(0x5573d28c4000 msgr2=0x5573d28fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/2850068951 shutdown_connections 2024-05-16T21:33:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.380+0000 7f1a6c998280 1 -- 172.21.15.5:0/2850068951 wait complete. 2024-05-16T21:33:46.394 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.083397, result: old journal was 4194304~35968 new journal start will be 8388608 (4158336 bytes past old end) writing journal head writing EResetJournal entry done 2024-05-16T21:33:46.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-16T21:33:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.506+0000 7f1f05e6e640 1 Processor -- start 2024-05-16T21:33:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.506+0000 7f1f05e6e640 1 -- start start 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.507+0000 7f1f05e6e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1f00148910 0x7f1f0014e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.507+0000 7f1f05e6e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f000ba800 con 0x7f1f000a9060 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.507+0000 7f1f05e6e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f000b8a30 con 0x7f1f0014eba0 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.507+0000 7f1f05e6e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1f000b8d10 con 0x7f1f00148910 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.507+0000 7f1eff7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f000a9060 0x7f1f000ba0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44298/0 (socket says 172.21.15.5:44298) 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.508+0000 7f1eff7fe640 1 -- 172.21.15.5:0/1199345644 learned_addr learned my addr 172.21.15.5:0/1199345644 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.508+0000 7f1efeffd640 1 --2- 172.21.15.5:0/1199345644 >> v2:172.21.15.157:3300/0 conn(0x7f1f00148910 0x7f1f0014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.508+0000 7f1efe7fc640 1 -- 172.21.15.5:0/1199345644 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091937705 0 0) 0x7f1ef0001110 con 0x7f1f000a9060 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.508+0000 7f1efe7fc640 1 -- 172.21.15.5:0/1199345644 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ee8003520 con 0x7f1f000a9060 2024-05-16T21:33:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.508+0000 7f1efeffd640 1 -- 172.21.15.5:0/1199345644 >> v1:172.21.15.157:6789/0 conn(0x7f1f0014eba0 legacy=0x7f1f00158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.508+0000 7f1efeffd640 1 -- 172.21.15.5:0/1199345644 >> v1:172.21.15.5:6789/0 conn(0x7f1f000a9060 legacy=0x7f1f000ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.508+0000 7f1efe7fc640 1 -- 172.21.15.5:0/1199345644 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738849292 0 0) 0x7f1f000b8a30 con 0x7f1f0014eba0 2024-05-16T21:33:46.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.508+0000 7f1efeffd640 1 -- 172.21.15.5:0/1199345644 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f000b8ff0 con 0x7f1f00148910 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.509+0000 7f1efeffd640 1 --2- 172.21.15.5:0/1199345644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f00148910 0x7f1f0014e660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40097a0 tx=0x7f1ef402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f70a9731d7ab12 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.509+0000 7f1efe7fc640 1 -- 172.21.15.5:0/1199345644 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4037070 con 0x7f1f00148910 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.509+0000 7f1efe7fc640 1 -- 172.21.15.5:0/1199345644 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef4032640 con 0x7f1f00148910 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.509+0000 7f1efe7fc640 1 -- 172.21.15.5:0/1199345644 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40329f0 con 0x7f1f00148910 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.510+0000 7f1f05e6e640 1 -- 172.21.15.5:0/1199345644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f00148910 msgr2=0x7f1f0014e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.510+0000 7f1f05e6e640 1 --2- 172.21.15.5:0/1199345644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f00148910 0x7f1f0014e660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40097a0 tx=0x7f1ef402a2c0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.510+0000 7f1f05e6e640 1 -- 172.21.15.5:0/1199345644 shutdown_connections 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.510+0000 7f1f05e6e640 1 --2- 172.21.15.5:0/1199345644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f00148910 0x7f1f0014e660 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.510+0000 7f1f05e6e640 1 -- 172.21.15.5:0/1199345644 >> 172.21.15.5:0/1199345644 conn(0x7f1f000c07c0 msgr2=0x7f1f000c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.510+0000 7f1f05e6e640 1 -- 172.21.15.5:0/1199345644 shutdown_connections 2024-05-16T21:33:46.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.510+0000 7f1f05e6e640 1 -- 172.21.15.5:0/1199345644 wait complete. 2024-05-16T21:33:46.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.511+0000 7f1f05e6e640 1 Processor -- start 2024-05-16T21:33:46.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.511+0000 7f1f05e6e640 1 -- start start 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.512+0000 7f1f05e6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a9060 0x7f1f001db340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.512+0000 7f1f05e6e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f00148910 0x7f1f001e5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.512+0000 7f1f05e6e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f0014eba0 0x7f1f00141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.512+0000 7f1f05e6e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0008d400 con 0x7f1f000a9060 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.512+0000 7f1f05e6e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0014efb0 con 0x7f1f0014eba0 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.512+0000 7f1f05e6e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0008d580 con 0x7f1f00148910 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.512+0000 7f1eff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a9060 0x7f1f001db340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.512+0000 7f1eff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a9060 0x7f1f001db340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46692/0 (socket says 172.21.15.5:46692) 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1eff7fe640 1 -- 172.21.15.5:0/3057479399 learned_addr learned my addr 172.21.15.5:0/3057479399 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1efeffd640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f00148910 0x7f1f001e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1efffff640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f0014eba0 0x7f1f00141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1eff7fe640 1 -- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f00148910 msgr2=0x7f1f001e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1eff7fe640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f00148910 0x7f1f001e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1eff7fe640 1 -- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f0014eba0 msgr2=0x7f1f00141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1eff7fe640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f0014eba0 0x7f1f00141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1eff7fe640 1 -- 172.21.15.5:0/3057479399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f001db880 con 0x7f1f000a9060 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1efffff640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f0014eba0 0x7f1f00141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1eff7fe640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a9060 0x7f1f001db340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000c700 tx=0x7f1ef000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1ee7fff640 1 -- 172.21.15.5:0/3057479399 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0017070 con 0x7f1f000a9060 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1ee7fff640 1 -- 172.21.15.5:0/3057479399 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef0001d30 con 0x7f1f000a9060 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f001d9930 con 0x7f1f000a9060 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1ee7fff640 1 -- 172.21.15.5:0/3057479399 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0005cb0 con 0x7f1f000a9060 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.513+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f001e8c30 con 0x7f1f000a9060 2024-05-16T21:33:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.514+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f001d9b00 con 0x7f1f000a9060 2024-05-16T21:33:46.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.515+0000 7f1ee7fff640 1 -- 172.21.15.5:0/3057479399 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ef001a070 con 0x7f1f000a9060 2024-05-16T21:33:46.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.515+0000 7f1ee7fff640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eec076300 0x7f1eec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:46.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.515+0000 7f1ee7fff640 1 -- 172.21.15.5:0/3057479399 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f1ef00967f0 con 0x7f1f000a9060 2024-05-16T21:33:46.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.515+0000 7f1efeffd640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eec076300 0x7f1eec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:46.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.516+0000 7f1efeffd640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eec076300 0x7f1eec078810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4034000 tx=0x7f1ef402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:46.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.520+0000 7f1ee7fff640 1 -- 172.21.15.5:0/3057479399 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1f000ba800 con 0x7f1f000a9060 2024-05-16T21:33:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:46.754+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f1f00050940 con 0x7f1f000a9060 2024-05-16T21:33:47.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.111+0000 7f1ee7fff640 1 -- 172.21.15.5:0/3057479399 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v27) ==== 162+0+0 (secure 0 0 0) 0x7f1ef00680e0 con 0x7f1f000a9060 2024-05-16T21:33:47.113 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-16T21:33:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eec076300 msgr2=0x7f1eec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eec076300 0x7f1eec078810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4034000 tx=0x7f1ef402e000 comp rx=0 tx=0).stop 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a9060 msgr2=0x7f1f001db340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a9060 0x7f1f001db340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000c700 tx=0x7f1ef000cbc0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 shutdown_connections 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1eec076300 0x7f1eec078810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f0014eba0 0x7f1f00141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f00148910 0x7f1f001e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 --2- 172.21.15.5:0/3057479399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a9060 0x7f1f001db340 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 >> 172.21.15.5:0/3057479399 conn(0x7f1f000c07c0 msgr2=0x7f1f00146c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 shutdown_connections 2024-05-16T21:33:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.115+0000 7f1f05e6e640 1 -- 172.21.15.5:0/3057479399 wait complete. 2024-05-16T21:33:47.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:47.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.250+0000 7fc8ff5b4640 1 Processor -- start 2024-05-16T21:33:47.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.250+0000 7fc8ff5b4640 1 -- start start 2024-05-16T21:33:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.251+0000 7fc8ff5b4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f814e360 0x7fc8f81522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.251+0000 7fc8ff5b4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc8f8148770 0x7fc8f80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.251+0000 7fc8ff5b4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f80c0620 con 0x7fc8f80bf9b0 2024-05-16T21:33:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.251+0000 7fc8ff5b4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f8151e40 con 0x7fc8f8148770 2024-05-16T21:33:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.251+0000 7fc8ff5b4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f8151ad0 con 0x7fc8f814e360 2024-05-16T21:33:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fdb51640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc8f80bf9b0 0x7fc8f80bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41420/0 (socket says 172.21.15.5:41420) 2024-05-16T21:33:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fdb51640 1 -- 172.21.15.5:0/4287502596 learned_addr learned my addr 172.21.15.5:0/4287502596 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fcb4f640 1 --2- 172.21.15.5:0/4287502596 >> v2:172.21.15.157:3300/0 conn(0x7fc8f8148770 0x7fc8f80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fd350640 1 --2- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f814e360 0x7fc8f81522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8effff640 1 -- 172.21.15.5:0/4287502596 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214969502 0 0) 0x7fc8f80c0620 con 0x7fc8f80bf9b0 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8effff640 1 -- 172.21.15.5:0/4287502596 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8e4003520 con 0x7fc8f80bf9b0 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fcb4f640 1 -- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f814e360 msgr2=0x7fc8f81522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fcb4f640 1 --2- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f814e360 0x7fc8f81522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fcb4f640 1 -- 172.21.15.5:0/4287502596 >> v1:172.21.15.5:6789/0 conn(0x7fc8f80bf9b0 legacy=0x7fc8f80bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8effff640 1 -- 172.21.15.5:0/4287502596 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 645207761 0 0) 0x7fc8e4003520 con 0x7fc8f80bf9b0 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fcb4f640 1 -- 172.21.15.5:0/4287502596 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f8152810 con 0x7fc8f8148770 2024-05-16T21:33:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.252+0000 7fc8fd350640 1 --2- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f814e360 0x7fc8f81522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:33:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.253+0000 7fc8fcb4f640 1 --2- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f8148770 0x7fc8f80c0c80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80097d0 tx=0x7fc8e802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=901f12740f6f10e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.253+0000 7fc8effff640 1 -- 172.21.15.5:0/4287502596 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8037070 con 0x7fc8f8148770 2024-05-16T21:33:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.253+0000 7fc8effff640 1 -- 172.21.15.5:0/4287502596 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e802ac70 con 0x7fc8f8148770 2024-05-16T21:33:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.253+0000 7fc8effff640 1 -- 172.21.15.5:0/4287502596 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0001a70 con 0x7fc8f8148770 2024-05-16T21:33:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.254+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f8148770 msgr2=0x7fc8f80c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.254+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f8148770 0x7fc8f80c0c80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80097d0 tx=0x7fc8e802a1e0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.254+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/4287502596 shutdown_connections 2024-05-16T21:33:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.254+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f8148770 0x7fc8f80c0c80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.254+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/4287502596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f814e360 0x7fc8f81522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.254+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/4287502596 >> 172.21.15.5:0/4287502596 conn(0x7fc8f80c17c0 msgr2=0x7fc8f80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.254+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/4287502596 shutdown_connections 2024-05-16T21:33:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.254+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/4287502596 wait complete. 2024-05-16T21:33:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.255+0000 7fc8ff5b4640 1 Processor -- start 2024-05-16T21:33:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.256+0000 7fc8ff5b4640 1 -- start start 2024-05-16T21:33:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8ff5b4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f80bf9b0 0x7fc8f80a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8ff5b4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f8148770 0x7fc8f81dde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8ff5b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f814e360 0x7fc8f80a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8ff5b4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f8158cc0 con 0x7fc8f814e360 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8ff5b4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f80c13d0 con 0x7fc8f80bf9b0 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8ff5b4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f8158e40 con 0x7fc8f8148770 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f814e360 0x7fc8f80a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f814e360 0x7fc8f80a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40712/0 (socket says 172.21.15.5:40712) 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 -- 172.21.15.5:0/2567972581 learned_addr learned my addr 172.21.15.5:0/2567972581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fcb4f640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f8148770 0x7fc8f81dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fd350640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f80bf9b0 0x7fc8f80a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 -- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f8148770 msgr2=0x7fc8f81dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f8148770 0x7fc8f81dde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 -- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f80bf9b0 msgr2=0x7fc8f80a51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f80bf9b0 0x7fc8f80a51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 -- 172.21.15.5:0/2567972581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f81e4c20 con 0x7fc8f814e360 2024-05-16T21:33:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8fdb51640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f814e360 0x7fc8f80a6000 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000cb40 tx=0x7fc8f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8edffb640 1 -- 172.21.15.5:0/2567972581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0017070 con 0x7fc8f814e360 2024-05-16T21:33:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8edffb640 1 -- 172.21.15.5:0/2567972581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f000acc0 con 0x7fc8f814e360 2024-05-16T21:33:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f81de3c0 con 0x7fc8f814e360 2024-05-16T21:33:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.257+0000 7fc8edffb640 1 -- 172.21.15.5:0/2567972581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0012640 con 0x7fc8f814e360 2024-05-16T21:33:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.258+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f81e5180 con 0x7fc8f814e360 2024-05-16T21:33:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.259+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f8158aa0 con 0x7fc8f814e360 2024-05-16T21:33:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.259+0000 7fc8edffb640 1 -- 172.21.15.5:0/2567972581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc8f001a070 con 0x7fc8f814e360 2024-05-16T21:33:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.260+0000 7fc8edffb640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc8dc0762d0 0x7fc8dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.260+0000 7fc8edffb640 1 -- 172.21.15.5:0/2567972581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7fc8f0097380 con 0x7fc8f814e360 2024-05-16T21:33:47.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.260+0000 7fc8fd350640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc8dc0762d0 0x7fc8dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:47.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.261+0000 7fc8fd350640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc8dc0762d0 0x7fc8dc0787e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009560 tx=0x7fc8f4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.265+0000 7fc8edffb640 1 -- 172.21.15.5:0/2567972581 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc8f81e4c20 con 0x7fc8f814e360 2024-05-16T21:33:47.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.493+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8f80bf790 con 0x7fc8f814e360 2024-05-16T21:33:47.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.494+0000 7fc8edffb640 1 -- 172.21.15.5:0/2567972581 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+4347 (secure 0 0 0) 0x7fc8f0060640 con 0x7fc8f814e360 2024-05-16T21:33:47.496 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:47.496 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:47.115996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-05-16T21:33:47.496 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 28 2024-05-16T21:33:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc8dc0762d0 msgr2=0x7fc8dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc8dc0762d0 0x7fc8dc0787e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009560 tx=0x7fc8f4009190 comp rx=0 tx=0).stop 2024-05-16T21:33:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f814e360 msgr2=0x7fc8f80a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f814e360 0x7fc8f80a6000 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000cb40 tx=0x7fc8f000a060 comp rx=0 tx=0).stop 2024-05-16T21:33:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 shutdown_connections 2024-05-16T21:33:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fc8dc0762d0 0x7fc8dc0787e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f814e360 0x7fc8f80a6000 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8f8148770 0x7fc8f81dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 --2- 172.21.15.5:0/2567972581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8f80bf9b0 0x7fc8f80a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 >> 172.21.15.5:0/2567972581 conn(0x7fc8f80c17c0 msgr2=0x7fc8f813e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 shutdown_connections 2024-05-16T21:33:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:47.496+0000 7fc8ff5b4640 1 -- 172.21.15.5:0/2567972581 wait complete. 2024-05-16T21:33:47.812 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T21:33:32.258682+0000', 'modified': '2024-05-16T21:33:47.115996+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5181': {'gid': 5181, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.5:6835/2190655947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 2190655947}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 2190655947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-16T21:33:47.812 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5181:up:replay 2024-05-16T21:33:48.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.940+0000 7fcbb0ba8640 1 Processor -- start 2024-05-16T21:33:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.940+0000 7fcbb0ba8640 1 -- start start 2024-05-16T21:33:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbb0ba8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbb0ba8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcbac0bf9b0 0x7fcbac0bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbb0ba8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbac0c0620 con 0x7fcbac14e360 2024-05-16T21:33:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbb0ba8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcbac151e40 con 0x7fcbac0bf9b0 2024-05-16T21:33:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbb0ba8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcbac151ad0 con 0x7fcbac148770 2024-05-16T21:33:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbaad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcbac0bf9b0 0x7fcbac0bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbaa59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcbac14e360 0x7fcbac1522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41428/0 (socket says 172.21.15.5:41428) 2024-05-16T21:33:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbaa59c640 1 -- 172.21.15.5:0/2038084782 learned_addr learned my addr 172.21.15.5:0/2038084782 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcba9d9b640 1 --2- 172.21.15.5:0/2038084782 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbaad9d640 1 -- 172.21.15.5:0/2038084782 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 msgr2=0x7fcbac0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbaad9d640 1 --2- 172.21.15.5:0/2038084782 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbaad9d640 1 -- 172.21.15.5:0/2038084782 >> v1:172.21.15.5:6789/0 conn(0x7fcbac14e360 legacy=0x7fcbac1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcbaad9d640 1 -- 172.21.15.5:0/2038084782 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac0c0300 con 0x7fcbac0bf9b0 2024-05-16T21:33:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.941+0000 7fcba959a640 1 -- 172.21.15.5:0/2038084782 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924626562 0 0) 0x7fcbac0c0620 con 0x7fcbac14e360 2024-05-16T21:33:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.942+0000 7fcbaad9d640 1 --2- 172.21.15.5:0/2038084782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac0bf9b0 0x7fcbac0bfdc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcba40097a0 tx=0x7fcba402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c498841adff91c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.942+0000 7fcba959a640 1 -- 172.21.15.5:0/2038084782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4037070 con 0x7fcbac0bf9b0 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.942+0000 7fcba959a640 1 -- 172.21.15.5:0/2038084782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba4032440 con 0x7fcbac0bf9b0 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.942+0000 7fcba959a640 1 -- 172.21.15.5:0/2038084782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4032810 con 0x7fcbac0bf9b0 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.943+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/2038084782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac0bf9b0 msgr2=0x7fcbac0bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.943+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/2038084782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac0bf9b0 0x7fcbac0bfdc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcba40097a0 tx=0x7fcba402a210 comp rx=0 tx=0).stop 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.943+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/2038084782 shutdown_connections 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.943+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/2038084782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac0bf9b0 0x7fcbac0bfdc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.943+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/2038084782 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.943+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/2038084782 >> 172.21.15.5:0/2038084782 conn(0x7fcbac0c17c0 msgr2=0x7fcbac0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.943+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/2038084782 shutdown_connections 2024-05-16T21:33:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.943+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/2038084782 wait complete. 2024-05-16T21:33:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.945+0000 7fcbb0ba8640 1 Processor -- start 2024-05-16T21:33:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.945+0000 7fcbb0ba8640 1 -- start start 2024-05-16T21:33:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbb0ba8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbac0bf9b0 0x7fcbac140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbb0ba8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbb0ba8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac14e360 0x7fcbac13d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbb0ba8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac158cc0 con 0x7fcbac14e360 2024-05-16T21:33:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbb0ba8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac0c13d0 con 0x7fcbac0bf9b0 2024-05-16T21:33:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbb0ba8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcbac158e40 con 0x7fcbac148770 2024-05-16T21:33:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac14e360 0x7fcbac13d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac14e360 0x7fcbac13d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40722/0 (socket says 172.21.15.5:40722) 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaad9d640 1 -- 172.21.15.5:0/1831145160 learned_addr learned my addr 172.21.15.5:0/1831145160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaa59c640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbac0bf9b0 0x7fcbac140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcba9d9b640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaad9d640 1 -- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 msgr2=0x7fcbac141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaad9d640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaad9d640 1 -- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbac0bf9b0 msgr2=0x7fcbac140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaad9d640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbac0bf9b0 0x7fcbac140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaad9d640 1 -- 172.21.15.5:0/1831145160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac1412d0 con 0x7fcbac14e360 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcba9d9b640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.946+0000 7fcbaa59c640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbac0bf9b0 0x7fcbac140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.947+0000 7fcbaad9d640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac14e360 0x7fcbac13d9a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcba40098c0 tx=0x7fcba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.947+0000 7fcb9affd640 1 -- 172.21.15.5:0/1831145160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4037040 con 0x7fcbac14e360 2024-05-16T21:33:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.947+0000 7fcb9affd640 1 -- 172.21.15.5:0/1831145160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba4042070 con 0x7fcbac14e360 2024-05-16T21:33:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.947+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbac1421b0 con 0x7fcbac14e360 2024-05-16T21:33:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.947+0000 7fcb9affd640 1 -- 172.21.15.5:0/1831145160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4030b50 con 0x7fcbac14e360 2024-05-16T21:33:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.947+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbac14f500 con 0x7fcbac14e360 2024-05-16T21:33:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.948+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbac0bdfc0 con 0x7fcbac14e360 2024-05-16T21:33:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.949+0000 7fcb9affd640 1 -- 172.21.15.5:0/1831145160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcba4030cf0 con 0x7fcbac14e360 2024-05-16T21:33:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.949+0000 7fcb9affd640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcb8c0762d0 0x7fcb8c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.949+0000 7fcb9affd640 1 -- 172.21.15.5:0/1831145160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7fcba40b82c0 con 0x7fcbac14e360 2024-05-16T21:33:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.949+0000 7fcbaa59c640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcb8c0762d0 0x7fcb8c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.950+0000 7fcbaa59c640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcb8c0762d0 0x7fcb8c0787e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0012e0 tx=0x7fcb9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:48.954+0000 7fcb9affd640 1 -- 172.21.15.5:0/1831145160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcbac0bdfc0 con 0x7fcbac14e360 2024-05-16T21:33:49.126 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-05-16T21:33:49.125+0000 7faeb1d2c640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-05-16T21:33:49.127 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-05-16T21:33:49.125+0000 7faeb1d2c640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000003 2024-05-16T21:33:49.127 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-05-16T21:33:49.126+0000 7faeb1d2c640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000002 2024-05-16T21:33:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.187+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbac14f6d0 con 0x7fcbac14e360 2024-05-16T21:33:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.187+0000 7fcb9affd640 1 -- 172.21.15.5:0/1831145160 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+4347 (secure 0 0 0) 0x7fcba4032e20 con 0x7fcbac14e360 2024-05-16T21:33:49.190 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:49.190 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:48.121355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-05-16T21:33:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcb8c0762d0 msgr2=0x7fcb8c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcb8c0762d0 0x7fcb8c0787e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0012e0 tx=0x7fcb9c009040 comp rx=0 tx=0).stop 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac14e360 msgr2=0x7fcbac13d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac14e360 0x7fcbac13d9a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcba40098c0 tx=0x7fcba40046c0 comp rx=0 tx=0).stop 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 shutdown_connections 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fcb8c0762d0 0x7fcb8c0787e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbac14e360 0x7fcbac13d9a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbac148770 0x7fcbac141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 --2- 172.21.15.5:0/1831145160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbac0bf9b0 0x7fcbac140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.189+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 >> 172.21.15.5:0/1831145160 conn(0x7fcbac0c17c0 msgr2=0x7fcbac0bd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.190+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 shutdown_connections 2024-05-16T21:33:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:49.190+0000 7fcbb0ba8640 1 -- 172.21.15.5:0/1831145160 wait complete. 2024-05-16T21:33:49.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T21:33:32.258682+0000', 'modified': '2024-05-16T21:33:48.121355+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5181': {'gid': 5181, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.5:6835/2190655947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 2190655947}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 2190655947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-16T21:33:49.505 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5181:up:rejoin 2024-05-16T21:33:50.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.630+0000 7f1db410d640 1 Processor -- start 2024-05-16T21:33:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.630+0000 7f1db410d640 1 -- start start 2024-05-16T21:33:50.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db410d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1dac14e360 0x7f1dac1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:50.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db410d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1dac148770 0x7f1dac0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:50.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db410d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dac0c0620 con 0x7f1dac0bf9b0 2024-05-16T21:33:50.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db410d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac151e40 con 0x7f1dac148770 2024-05-16T21:33:50.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db410d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac151ad0 con 0x7f1dac14e360 2024-05-16T21:33:50.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db16a8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1dac148770 0x7f1dac0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:50.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db26aa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1dac0bf9b0 0x7f1dac0bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41440/0 (socket says 172.21.15.5:41440) 2024-05-16T21:33:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db26aa640 1 -- 172.21.15.5:0/2211506136 learned_addr learned my addr 172.21.15.5:0/2211506136 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db1ea9640 1 --2- 172.21.15.5:0/2211506136 >> v2:172.21.15.157:3300/0 conn(0x7f1dac14e360 0x7f1dac1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db16a8640 1 -- 172.21.15.5:0/2211506136 >> v2:172.21.15.157:3300/0 conn(0x7f1dac14e360 msgr2=0x7f1dac1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db16a8640 1 --2- 172.21.15.5:0/2211506136 >> v2:172.21.15.157:3300/0 conn(0x7f1dac14e360 0x7f1dac1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db16a8640 1 -- 172.21.15.5:0/2211506136 >> v1:172.21.15.5:6789/0 conn(0x7f1dac0bf9b0 legacy=0x7f1dac0bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db0ea7640 1 -- 172.21.15.5:0/2211506136 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127858786 0 0) 0x7f1dac0c0620 con 0x7f1dac0bf9b0 2024-05-16T21:33:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.632+0000 7f1db16a8640 1 -- 172.21.15.5:0/2211506136 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac152810 con 0x7f1dac148770 2024-05-16T21:33:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.633+0000 7f1db16a8640 1 --2- 172.21.15.5:0/2211506136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac0c0c80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1da00097a0 tx=0x7f1da002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581b3f1d692db800 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.633+0000 7f1db0ea7640 1 -- 172.21.15.5:0/2211506136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0037070 con 0x7f1dac148770 2024-05-16T21:33:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.633+0000 7f1db0ea7640 1 -- 172.21.15.5:0/2211506136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da0032440 con 0x7f1dac148770 2024-05-16T21:33:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.633+0000 7f1db0ea7640 1 -- 172.21.15.5:0/2211506136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0032810 con 0x7f1dac148770 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.634+0000 7f1db410d640 1 -- 172.21.15.5:0/2211506136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 msgr2=0x7f1dac0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.634+0000 7f1db410d640 1 --2- 172.21.15.5:0/2211506136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac0c0c80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1da00097a0 tx=0x7f1da002a270 comp rx=0 tx=0).stop 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.634+0000 7f1db410d640 1 -- 172.21.15.5:0/2211506136 shutdown_connections 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.634+0000 7f1db410d640 1 --2- 172.21.15.5:0/2211506136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac0c0c80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.634+0000 7f1db410d640 1 --2- 172.21.15.5:0/2211506136 >> v2:172.21.15.157:3300/0 conn(0x7f1dac14e360 0x7f1dac1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.634+0000 7f1db410d640 1 -- 172.21.15.5:0/2211506136 >> 172.21.15.5:0/2211506136 conn(0x7f1dac0c17c0 msgr2=0x7f1dac0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.634+0000 7f1db410d640 1 -- 172.21.15.5:0/2211506136 shutdown_connections 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.634+0000 7f1db410d640 1 -- 172.21.15.5:0/2211506136 wait complete. 2024-05-16T21:33:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.635+0000 7f1db410d640 1 Processor -- start 2024-05-16T21:33:50.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.635+0000 7f1db410d640 1 -- start start 2024-05-16T21:33:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.636+0000 7f1db410d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dac0bf9b0 0x7f1dac0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.636+0000 7f1db410d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.636+0000 7f1db410d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dac14e360 0x7f1dac070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db410d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac158cc0 con 0x7f1dac148770 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db410d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac0c13d0 con 0x7f1dac14e360 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db410d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac158e40 con 0x7f1dac0bf9b0 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac06ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40732/0 (socket says 172.21.15.5:40732) 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 -- 172.21.15.5:0/347370523 learned_addr learned my addr 172.21.15.5:0/347370523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db1ea9640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dac0bf9b0 0x7f1dac0b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db26aa640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dac14e360 0x7f1dac070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 -- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dac0bf9b0 msgr2=0x7f1dac0b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dac0bf9b0 0x7f1dac0b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 -- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dac14e360 msgr2=0x7f1dac070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dac14e360 0x7f1dac070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 -- 172.21.15.5:0/347370523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac072860 con 0x7f1dac148770 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db1ea9640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dac0bf9b0 0x7f1dac0b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db16a8640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac06ef80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1da0000c00 tx=0x7f1da00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1daa7fc640 1 -- 172.21.15.5:0/347370523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0037050 con 0x7f1dac148770 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1daa7fc640 1 -- 172.21.15.5:0/347370523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da0038040 con 0x7f1dac148770 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1daa7fc640 1 -- 172.21.15.5:0/347370523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0004490 con 0x7f1dac148770 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac0b80e0 con 0x7f1dac148770 2024-05-16T21:33:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.637+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac1e48d0 con 0x7f1dac148770 2024-05-16T21:33:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.638+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac0c0e90 con 0x7f1dac148770 2024-05-16T21:33:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.639+0000 7f1daa7fc640 1 -- 172.21.15.5:0/347370523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1da0030900 con 0x7f1dac148770 2024-05-16T21:33:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.640+0000 7f1daa7fc640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1d98076300 0x7f1d98078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.640+0000 7f1daa7fc640 1 -- 172.21.15.5:0/347370523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f1da00b8160 con 0x7f1dac148770 2024-05-16T21:33:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.640+0000 7f1db1ea9640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1d98076300 0x7f1d98078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.641+0000 7f1db1ea9640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1d98076300 0x7f1d98078810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006fd0 tx=0x7f1da4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.644+0000 7f1daa7fc640 1 -- 172.21.15.5:0/347370523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1da0081a60 con 0x7f1dac148770 2024-05-16T21:33:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.877+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1dac050940 con 0x7f1dac148770 2024-05-16T21:33:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.878+0000 7f1daa7fc640 1 -- 172.21.15.5:0/347370523 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+4354 (secure 0 0 0) 0x7f1da0081360 con 0x7f1dac148770 2024-05-16T21:33:50.880 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:50.880 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:50.124310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5181,"qdb_cluster":[5181]},"id":3}]} 2024-05-16T21:33:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-05-16T21:33:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1d98076300 msgr2=0x7f1d98078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1d98076300 0x7f1d98078810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006fd0 tx=0x7f1da4008040 comp rx=0 tx=0).stop 2024-05-16T21:33:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 msgr2=0x7f1dac06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac06ef80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1da0000c00 tx=0x7f1da00046c0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 shutdown_connections 2024-05-16T21:33:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1d98076300 0x7f1d98078810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1dac14e360 0x7f1dac070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dac148770 0x7f1dac06ef80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 --2- 172.21.15.5:0/347370523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1dac0bf9b0 0x7f1dac0b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 >> 172.21.15.5:0/347370523 conn(0x7f1dac0c17c0 msgr2=0x7f1dac141d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 shutdown_connections 2024-05-16T21:33:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:50.880+0000 7f1db410d640 1 -- 172.21.15.5:0/347370523 wait complete. 2024-05-16T21:33:51.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T21:33:32.258682+0000', 'modified': '2024-05-16T21:33:50.124310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5181': {'gid': 5181, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.5:6835/2190655947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 2190655947}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 2190655947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5181, 'qdb_cluster': [5181]} 2024-05-16T21:33:51.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-16T21:33:51.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-16T21:33:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.307+0000 7f1591c22640 1 Processor -- start 2024-05-16T21:33:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.308+0000 7f1591c22640 1 -- start start 2024-05-16T21:33:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f1591c22640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f158c151fc0 0x7f158c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f1591c22640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f158c06da30 0x7f158c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f1591c22640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c0c36f0 con 0x7f158c06de40 2024-05-16T21:33:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f1591c22640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f158c0bdc10 con 0x7f158c06da30 2024-05-16T21:33:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f1591c22640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f158c152530 con 0x7f158c151fc0 2024-05-16T21:33:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f158affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f158c06da30 0x7f158c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f158affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f158c06da30 0x7f158c0be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40746/0 (socket says 172.21.15.5:40746) 2024-05-16T21:33:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f158affd640 1 -- 172.21.15.5:0/4024546748 learned_addr learned my addr 172.21.15.5:0/4024546748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f158b7fe640 1 --2- 172.21.15.5:0/4024546748 >> v2:172.21.15.157:3300/0 conn(0x7f158c151fc0 0x7f158c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f158affd640 1 -- 172.21.15.5:0/4024546748 >> v2:172.21.15.157:3300/0 conn(0x7f158c151fc0 msgr2=0x7f158c0bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f158affd640 1 --2- 172.21.15.5:0/4024546748 >> v2:172.21.15.157:3300/0 conn(0x7f158c151fc0 0x7f158c0bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f158affd640 1 -- 172.21.15.5:0/4024546748 >> v1:172.21.15.157:6789/0 conn(0x7f158c06de40 legacy=0x7f158c14e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.309+0000 7f158affd640 1 -- 172.21.15.5:0/4024546748 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c152810 con 0x7f158c06da30 2024-05-16T21:33:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.310+0000 7f158affd640 1 --2- 172.21.15.5:0/4024546748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0be940 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f158c08d300 tx=0x7f158002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bc2079db00868e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.310+0000 7f158a7fc640 1 -- 172.21.15.5:0/4024546748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580037070 con 0x7f158c06da30 2024-05-16T21:33:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.310+0000 7f158a7fc640 1 -- 172.21.15.5:0/4024546748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1580032440 con 0x7f158c06da30 2024-05-16T21:33:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.310+0000 7f158a7fc640 1 -- 172.21.15.5:0/4024546748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580032810 con 0x7f158c06da30 2024-05-16T21:33:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.311+0000 7f1591c22640 1 -- 172.21.15.5:0/4024546748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 msgr2=0x7f158c0be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.311+0000 7f1591c22640 1 --2- 172.21.15.5:0/4024546748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0be940 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f158c08d300 tx=0x7f158002a1e0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.311+0000 7f1591c22640 1 -- 172.21.15.5:0/4024546748 shutdown_connections 2024-05-16T21:33:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.311+0000 7f1591c22640 1 --2- 172.21.15.5:0/4024546748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0be940 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.311+0000 7f1591c22640 1 --2- 172.21.15.5:0/4024546748 >> v2:172.21.15.157:3300/0 conn(0x7f158c151fc0 0x7f158c0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.311+0000 7f1591c22640 1 -- 172.21.15.5:0/4024546748 >> 172.21.15.5:0/4024546748 conn(0x7f158c0c3d20 msgr2=0x7f158c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.311+0000 7f1591c22640 1 -- 172.21.15.5:0/4024546748 shutdown_connections 2024-05-16T21:33:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.311+0000 7f1591c22640 1 -- 172.21.15.5:0/4024546748 wait complete. 2024-05-16T21:33:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.312+0000 7f1591c22640 1 Processor -- start 2024-05-16T21:33:51.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.313+0000 7f1591c22640 1 -- start start 2024-05-16T21:33:51.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.313+0000 7f1591c22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1591c22640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c06de40 0x7f158c1e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1591c22640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c151fc0 0x7f158c1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1591c22640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0a3050 con 0x7f158c06da30 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1591c22640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0a2ed0 con 0x7f158c151fc0 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1591c22640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f158c0bee80 con 0x7f158c06de40 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0b8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40754/0 (socket says 172.21.15.5:40754) 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 -- 172.21.15.5:0/4176205507 learned_addr learned my addr 172.21.15.5:0/4176205507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158bfff640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c151fc0 0x7f158c1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158affd640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c06de40 0x7f158c1e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 -- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c06de40 msgr2=0x7f158c1e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c06de40 0x7f158c1e4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 -- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c151fc0 msgr2=0x7f158c1506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c151fc0 0x7f158c1506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 -- 172.21.15.5:0/4176205507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c0b9390 con 0x7f158c06da30 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f158b7fe640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0b8e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f157c00d5f0 tx=0x7f157c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1573fff640 1 -- 172.21.15.5:0/4176205507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c0125f0 con 0x7f158c06da30 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1573fff640 1 -- 172.21.15.5:0/4176205507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c019070 con 0x7f158c06da30 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1591c22640 1 -- 172.21.15.5:0/4176205507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c1e4b60 con 0x7f158c06da30 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1573fff640 1 -- 172.21.15.5:0/4176205507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c0129d0 con 0x7f158c06da30 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.314+0000 7f1591c22640 1 -- 172.21.15.5:0/4176205507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c0b7770 con 0x7f158c06da30 2024-05-16T21:33:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.317+0000 7f1573fff640 1 -- 172.21.15.5:0/4176205507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f157c012b70 con 0x7f158c06da30 2024-05-16T21:33:51.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.317+0000 7f1573fff640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f15780762d0 0x7f15780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.317+0000 7f1573fff640 1 -- 172.21.15.5:0/4176205507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f157c0979a0 con 0x7f158c06da30 2024-05-16T21:33:51.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.318+0000 7f158affd640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f15780762d0 0x7f15780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.318+0000 7f1598bad740 1 Processor -- start 2024-05-16T21:33:51.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.318+0000 7f1598bad740 1 -- start start 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.318+0000 7f158affd640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f15780762d0 0x7f15780787e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1580034000 tx=0x7f158002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f1598bad740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b80680b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f1598bad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8064093b0 0x55b8067cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f1598bad740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b806411590 0x55b8068002a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f1598bad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b806745f10 con 0x55b8064093b0 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f1598bad740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b806735ab0 con 0x55b806432270 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f1598bad740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55b806739af0 con 0x55b806411590 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f158affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8064093b0 0x55b8067cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f158affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8064093b0 0x55b8067cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40770/0 (socket says 172.21.15.5:40770) 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f158affd640 1 -- 172.21.15.5:0/2791652222 learned_addr learned my addr 172.21.15.5:0/2791652222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b80680b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.319+0000 7f158bfff640 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b806411590 0x55b8068002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f158affd640 1 -- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b806411590 msgr2=0x55b8068002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f158affd640 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b806411590 0x55b8068002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f158affd640 1 -- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 msgr2=0x55b80680b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f158affd640 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b80680b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f158affd640 1 -- 172.21.15.5:0/2791652222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8066f95d0 con 0x55b8064093b0 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b80680b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f158affd640 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8064093b0 0x55b8067cf670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1580000c00 tx=0x7f158002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4458a3e71d7fe27a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f15717fa640 1 -- 172.21.15.5:0/2791652222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158004e070 con 0x55b8064093b0 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f15717fa640 1 -- 172.21.15.5:0/2791652222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1580049470 con 0x55b8064093b0 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.320+0000 7f15717fa640 1 -- 172.21.15.5:0/2791652222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580037040 con 0x55b8064093b0 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 -- 172.21.15.5:0/2791652222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8064093b0 msgr2=0x55b8067cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8064093b0 0x55b8067cf670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1580000c00 tx=0x7f158002c000 comp rx=0 tx=0).stop 2024-05-16T21:33:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 -- 172.21.15.5:0/2791652222 shutdown_connections 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b806411590 0x55b8068002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8064093b0 0x55b8067cf670 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 --2- 172.21.15.5:0/2791652222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b80680b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 -- 172.21.15.5:0/2791652222 >> 172.21.15.5:0/2791652222 conn(0x55b8064263c0 msgr2=0x55b80680a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 -- 172.21.15.5:0/2791652222 shutdown_connections 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.321+0000 7f1598bad740 1 -- 172.21.15.5:0/2791652222 wait complete. 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.322+0000 7f1598bad740 1 -- start start 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.322+0000 7f1598bad740 1 Processor -- start 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f1598bad740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f1598bad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b8067fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f1598bad740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b8067fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f1598bad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b80641b850 con 0x55b806411590 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f1598bad740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b8066f1c10 con 0x55b806432270 2024-05-16T21:33:51.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f1598bad740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55b8067d0080 con 0x55b8064093b0 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f1598bad740 10 client.0 _ll_register_callbacks cb 0x55b8066f5150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b8067fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b8067fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40784/0 (socket says 172.21.15.5:40784) 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 -- 172.21.15.5:0/2945388012 learned_addr learned my addr 172.21.15.5:0/2945388012 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 -- 172.21.15.5:0/2945388012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 msgr2=0x55b8067f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158bfff640 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b8067fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 -- 172.21.15.5:0/2945388012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 msgr2=0x55b8067fbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b8067fbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 -- 172.21.15.5:0/2945388012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b80644a2d0 con 0x55b806411590 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f158affd640 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b8067fb6a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1580000c00 tx=0x7f1580004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188ac39e1a37858 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f156a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.323+0000 7f156a7fc640 1 -- 172.21.15.5:0/2945388012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158004e070 con 0x55b806411590 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f156a7fc640 1 -- 172.21.15.5:0/2945388012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f1580054b70 con 0x55b806411590 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 1 -- 172.21.15.5:0/2945388012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1580049470 con 0x55b806411590 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f156a7fc640 1 -- 172.21.15.5:0/2945388012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1580037040 con 0x55b806411590 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 10 client.5250 fetch_fsmap learned FSMap version 31 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 1 -- 172.21.15.5:0/2945388012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x55b8065146b0 con 0x55b806411590 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f156a7fc640 1 -- 172.21.15.5:0/2945388012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1580049470 con 0x55b806411590 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f156a7fc640 1 -- 172.21.15.5:0/2945388012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) ==== 2889+0+0 (secure 0 0 0) 0x7f158003e670 con 0x55b806411590 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 10 client.5250 fetch_fsmap finished waiting for FSMap version 31 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 10 client.5250 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 20 client.5250 populate_metadata read hostname 'smithi005' 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] conn(0x55b8063f0e40 0x55b80681ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 4 client.5250 mds_command: new command op to 5181 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-16T21:33:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f1598bad740 1 -- 172.21.15.5:0/2945388012 --> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b806747e60 con 0x55b8063f0e40 2024-05-16T21:33:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] conn(0x55b8063f0e40 0x55b80681ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f156a7fc640 10 client.5250 ms_handle_connect on v2:172.21.15.5:6834/2190655947 2024-05-16T21:33:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.324+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] conn(0x55b8063f0e40 0x55b80681ae90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d648c06dab835617 server_cookie=f571f05a40f19790 in_seq=0 out_seq=0 2024-05-16T21:33:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f156a7fc640 1 -- 172.21.15.5:0/2945388012 <== mds.0 v2:172.21.15.5:6834/2190655947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b806747e60 con 0x55b8063f0e40 2024-05-16T21:33:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f156a7fc640 10 client.5250 handle_command_reply: tid=0 2024-05-16T21:33:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 client.5250 shutdown 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 -- 172.21.15.5:0/2945388012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 msgr2=0x55b8067fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b8067fb6a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1580000c00 tx=0x7f1580004730 comp rx=0 tx=0).stop 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 -- 172.21.15.5:0/2945388012 shutdown_connections 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] conn(0x55b8063f0e40 0x55b80681ae90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b8067fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b8067fb6a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 --2- 172.21.15.5:0/2945388012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f156a7fc640 0 client.5250 ms_handle_reset on v2:172.21.15.5:6834/2190655947 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 -- 172.21.15.5:0/2945388012 >> 172.21.15.5:0/2945388012 conn(0x55b8064263c0 msgr2=0x55b8067d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 -- 172.21.15.5:0/2945388012 shutdown_connections 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.325+0000 7f1598bad740 1 -- 172.21.15.5:0/2945388012 wait complete. 2024-05-16T21:33:51.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.326+0000 7f1598bad740 20 client.5250 trim_cache size 0 max 16384 2024-05-16T21:33:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.344+0000 7f1598bad740 1 Processor -- start 2024-05-16T21:33:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.345+0000 7f1598bad740 1 -- start start 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1598bad740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1598bad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b80681fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1598bad740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b8068203a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1598bad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1f11a0 con 0x55b806411590 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1598bad740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1e86e0 con 0x55b806432270 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1598bad740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f158c1f0200 con 0x55b8064093b0 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b80681fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b80681fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40794/0 (socket says 172.21.15.5:40794) 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 -- 172.21.15.5:0/1089657136 learned_addr learned my addr 172.21.15.5:0/1089657136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158b7fe640 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 -- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 msgr2=0x55b8067f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158bfff640 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b8068203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 -- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 msgr2=0x55b8068203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b8068203a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 -- 172.21.15.5:0/1089657136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8067d0ef0 con 0x55b806411590 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158b7fe640 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f158affd640 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b80681fe60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f158002a7d0 tx=0x7f158000b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b721ebfe4b943c1b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1570ff9640 1 -- 172.21.15.5:0/1089657136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158004e070 con 0x55b806411590 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1570ff9640 1 -- 172.21.15.5:0/1089657136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158003e670 con 0x55b806411590 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.346+0000 7f1570ff9640 1 -- 172.21.15.5:0/1089657136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158003edb0 con 0x55b806411590 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 -- 172.21.15.5:0/1089657136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 msgr2=0x55b80681fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b80681fe60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f158002a7d0 tx=0x7f158000b050 comp rx=0 tx=0).stop 2024-05-16T21:33:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 -- 172.21.15.5:0/1089657136 shutdown_connections 2024-05-16T21:33:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b8068203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b80681fe60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 --2- 172.21.15.5:0/1089657136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b8067f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 -- 172.21.15.5:0/1089657136 >> 172.21.15.5:0/1089657136 conn(0x55b8064263c0 msgr2=0x55b8067f2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 -- 172.21.15.5:0/1089657136 shutdown_connections 2024-05-16T21:33:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.347+0000 7f1598bad740 1 -- 172.21.15.5:0/1089657136 wait complete. 2024-05-16T21:33:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.348+0000 7f1598bad740 1 -- start start 2024-05-16T21:33:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.348+0000 7f1598bad740 1 Processor -- start 2024-05-16T21:33:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f1598bad740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b80681b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f1598bad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b806880fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f1598bad740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b806881500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f1598bad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b806817c50 con 0x55b806411590 2024-05-16T21:33:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f1598bad740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b80641b850 con 0x55b806432270 2024-05-16T21:33:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f1598bad740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55b806800f90 con 0x55b8064093b0 2024-05-16T21:33:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f1598bad740 10 client.0 _ll_register_callbacks cb 0x7f1580049950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T21:33:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f158affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b806880fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f158affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b806880fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40806/0 (socket says 172.21.15.5:40806) 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.349+0000 7f158affd640 1 -- 172.21.15.5:0/2137427654 learned_addr learned my addr 172.21.15.5:0/2137427654 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b80681b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158bfff640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b806881500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158affd640 1 -- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 msgr2=0x55b80681b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158affd640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b80681b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158affd640 1 -- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 msgr2=0x55b806881500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158affd640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b806881500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158affd640 1 -- 172.21.15.5:0/2137427654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b80681b560 con 0x55b806411590 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b80681b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158bfff640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b806881500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f158affd640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b806880fc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f158004b040 tx=0x7f1580041070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16833c88a9e9f359 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f156a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f156a7fc640 1 -- 172.21.15.5:0/2137427654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580049470 con 0x55b806411590 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f156a7fc640 1 -- 172.21.15.5:0/2137427654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f158003ed80 con 0x55b806411590 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 1 -- 172.21.15.5:0/2137427654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f158003e670 con 0x55b806411590 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f156a7fc640 1 -- 172.21.15.5:0/2137427654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f158006a050 con 0x55b806411590 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 10 client.5256 fetch_fsmap learned FSMap version 31 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 1 -- 172.21.15.5:0/2137427654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x55b806881a40 con 0x55b806411590 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f156a7fc640 1 -- 172.21.15.5:0/2137427654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158003e670 con 0x55b806411590 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f156a7fc640 1 -- 172.21.15.5:0/2137427654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) ==== 2889+0+0 (secure 0 0 0) 0x7f158006d020 con 0x55b806411590 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 10 client.5256 fetch_fsmap finished waiting for FSMap version 31 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 10 client.5256 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 20 client.5256 populate_metadata read hostname 'smithi005' 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] conn(0x55b806829f50 0x55b80682a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 4 client.5256 mds_command: new command op to 5181 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.350+0000 7f1598bad740 1 -- 172.21.15.5:0/2137427654 --> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] -- command(tid 0: {"prefix": "status"}) -- 0x55b806741640 con 0x55b806829f50 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] conn(0x55b806829f50 0x55b80682a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f156a7fc640 10 client.5256 ms_handle_connect on v2:172.21.15.5:6834/2190655947 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f158b7fe640 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] conn(0x55b806829f50 0x55b80682a360 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9917732dc0ba3de0 server_cookie=e92ae9f8dc25ce49 in_seq=0 out_seq=0 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f156a7fc640 1 -- 172.21.15.5:0/2137427654 <== mds.0 v2:172.21.15.5:6834/2190655947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55b806741640 con 0x55b806829f50 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f156a7fc640 10 client.5256 handle_command_reply: tid=0 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 client.5256 shutdown 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 -- 172.21.15.5:0/2137427654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 msgr2=0x55b806880fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b806880fc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f158004b040 tx=0x7f1580041070 comp rx=0 tx=0).stop 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 -- 172.21.15.5:0/2137427654 shutdown_connections 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.5:6834/2190655947,v1:172.21.15.5:6835/2190655947] conn(0x55b806829f50 0x55b80682a360 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b806432270 0x55b806881500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b806411590 0x55b806880fc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f156a7fc640 0 client.5256 ms_handle_reset on v2:172.21.15.5:6834/2190655947 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 --2- 172.21.15.5:0/2137427654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55b8064093b0 0x55b80681b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 -- 172.21.15.5:0/2137427654 >> 172.21.15.5:0/2137427654 conn(0x55b8064263c0 msgr2=0x55b8067f2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.351+0000 7f1598bad740 1 -- 172.21.15.5:0/2137427654 shutdown_connections 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1598bad740 1 -- 172.21.15.5:0/2137427654 wait complete. 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1598bad740 20 client.5256 trim_cache size 0 max 16384 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "4223c61e-038a-4696-b0eb-6b69d601e381", 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-05-16T21:33:51.360 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5181, 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 4.231143586, 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 31, 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 42, 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 42, 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 5.1756185940000003 2024-05-16T21:33:51.361 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T21:33:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 -- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f15780762d0 msgr2=0x7f15780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f15780762d0 0x7f15780787e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1580034000 tx=0x7f158002e000 comp rx=0 tx=0).stop 2024-05-16T21:33:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 -- 172.21.15.5:0/4176205507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 msgr2=0x7f158c0b8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0b8e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f157c00d5f0 tx=0x7f157c00dab0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 -- 172.21.15.5:0/4176205507 shutdown_connections 2024-05-16T21:33:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f15780762d0 0x7f15780787e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c151fc0 0x7f158c1506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c06de40 0x7f158c1e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 --2- 172.21.15.5:0/4176205507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c06da30 0x7f158c0b8e50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 -- 172.21.15.5:0/4176205507 >> 172.21.15.5:0/4176205507 conn(0x7f158c0c3d20 msgr2=0x7f158c0a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 -- 172.21.15.5:0/4176205507 shutdown_connections 2024-05-16T21:33:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.352+0000 7f1591c22640 1 -- 172.21.15.5:0/4176205507 wait complete. 2024-05-16T21:33:51.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.474+0000 7f1ee65b2640 1 Processor -- start 2024-05-16T21:33:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.474+0000 7f1ee65b2640 1 -- start start 2024-05-16T21:33:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1ee65b2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ee00be4f0 0x7f1ee00bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1ee65b2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee014cce0 0x7f1ee00716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1ee65b2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee00720d0 con 0x7f1ee0071be0 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1ee65b2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee00bfa60 con 0x7f1ee00be4f0 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1ee65b2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee0071310 con 0x7f1ee014cce0 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1edffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ee00be4f0 0x7f1ee00bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1edffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ee00be4f0 0x7f1ee00bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40822/0 (socket says 172.21.15.5:40822) 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1edffff640 1 -- 172.21.15.5:0/4069565506 learned_addr learned my addr 172.21.15.5:0/4069565506 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.475+0000 7f1edf7fe640 1 --2- 172.21.15.5:0/4069565506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee014cce0 0x7f1ee00716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.476+0000 7f1edffff640 1 -- 172.21.15.5:0/4069565506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee014cce0 msgr2=0x7f1ee00716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.476+0000 7f1edffff640 1 --2- 172.21.15.5:0/4069565506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee014cce0 0x7f1ee00716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.476+0000 7f1edffff640 1 -- 172.21.15.5:0/4069565506 >> v1:172.21.15.157:6789/0 conn(0x7f1ee0071be0 legacy=0x7f1ee014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.476+0000 7f1edffff640 1 -- 172.21.15.5:0/4069565506 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee00bf6f0 con 0x7f1ee00be4f0 2024-05-16T21:33:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.476+0000 7f1edffff640 1 --2- 172.21.15.5:0/4069565506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee00bfef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009870 tx=0x7f1ed002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303d6a4b5f26111b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.476+0000 7f1edeffd640 1 -- 172.21.15.5:0/4069565506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0037070 con 0x7f1ee00be4f0 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1edeffd640 1 -- 172.21.15.5:0/4069565506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed0032440 con 0x7f1ee00be4f0 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1edeffd640 1 -- 172.21.15.5:0/4069565506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0032810 con 0x7f1ee00be4f0 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1ee65b2640 1 -- 172.21.15.5:0/4069565506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 msgr2=0x7f1ee00bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/4069565506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee00bfef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009870 tx=0x7f1ed002a1c0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1ee65b2640 1 -- 172.21.15.5:0/4069565506 shutdown_connections 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/4069565506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee014cce0 0x7f1ee00716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/4069565506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee00bfef0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1ee65b2640 1 -- 172.21.15.5:0/4069565506 >> 172.21.15.5:0/4069565506 conn(0x7f1ee00c17c0 msgr2=0x7f1ee00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1ee65b2640 1 -- 172.21.15.5:0/4069565506 shutdown_connections 2024-05-16T21:33:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.477+0000 7f1ee65b2640 1 -- 172.21.15.5:0/4069565506 wait complete. 2024-05-16T21:33:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.479+0000 7f1ee65b2640 1 Processor -- start 2024-05-16T21:33:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.479+0000 7f1ee65b2640 1 -- start start 2024-05-16T21:33:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1ee65b2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee0071be0 0x7f1ee00a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1ee65b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee009b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1ee65b2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee014cce0 0x7f1ee01e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1ee65b2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee00c0430 con 0x7f1ee00be4f0 2024-05-16T21:33:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1ee65b2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee00723b0 con 0x7f1ee014cce0 2024-05-16T21:33:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1ee65b2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee00a6c90 con 0x7f1ee0071be0 2024-05-16T21:33:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1edf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee009b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1edf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee009b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40830/0 (socket says 172.21.15.5:40830) 2024-05-16T21:33:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1edf7fe640 1 -- 172.21.15.5:0/2192244937 learned_addr learned my addr 172.21.15.5:0/2192244937 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1edffff640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee0071be0 0x7f1ee00a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.480+0000 7f1ee4b4f640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee014cce0 0x7f1ee01e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edf7fe640 1 -- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee0071be0 msgr2=0x7f1ee00a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edf7fe640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee0071be0 0x7f1ee00a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edf7fe640 1 -- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee014cce0 msgr2=0x7f1ee01e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edf7fe640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee014cce0 0x7f1ee01e59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edf7fe640 1 -- 172.21.15.5:0/2192244937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee00a2f50 con 0x7f1ee00be4f0 2024-05-16T21:33:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edf7fe640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee009b940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800e8a0 tx=0x7f1ec800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edcff9640 1 -- 172.21.15.5:0/2192244937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8017070 con 0x7f1ee00be4f0 2024-05-16T21:33:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edcff9640 1 -- 172.21.15.5:0/2192244937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec800ee90 con 0x7f1ee00be4f0 2024-05-16T21:33:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee0144b30 con 0x7f1ee00be4f0 2024-05-16T21:33:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1edcff9640 1 -- 172.21.15.5:0/2192244937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800cb60 con 0x7f1ee00be4f0 2024-05-16T21:33:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.481+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee00bbbe0 con 0x7f1ee00be4f0 2024-05-16T21:33:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.482+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee0050940 con 0x7f1ee00be4f0 2024-05-16T21:33:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.483+0000 7f1edcff9640 1 -- 172.21.15.5:0/2192244937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ec801a070 con 0x7f1ee00be4f0 2024-05-16T21:33:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.483+0000 7f1edcff9640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ec0076300 0x7f1ec0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.483+0000 7f1edcff9640 1 -- 172.21.15.5:0/2192244937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f1ec8097370 con 0x7f1ee00be4f0 2024-05-16T21:33:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.484+0000 7f1edffff640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ec0076300 0x7f1ec0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.484+0000 7f1edffff640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ec0076300 0x7f1ec0078810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0034000 tx=0x7f1ed002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.488+0000 7f1edcff9640 1 -- 172.21.15.5:0/2192244937 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ec8060620 con 0x7f1ee00be4f0 2024-05-16T21:33:51.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.721+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ee00c0e20 con 0x7f1ee00be4f0 2024-05-16T21:33:51.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.722+0000 7f1edcff9640 1 -- 172.21.15.5:0/2192244937 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+4354 (secure 0 0 0) 0x7f1ec8064920 con 0x7f1ee00be4f0 2024-05-16T21:33:51.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:51.726 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:50.124310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5181,"qdb_cluster":[5181]},"id":3}]} 2024-05-16T21:33:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-05-16T21:33:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ec0076300 msgr2=0x7f1ec0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ec0076300 0x7f1ec0078810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0034000 tx=0x7f1ed002e000 comp rx=0 tx=0).stop 2024-05-16T21:33:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 msgr2=0x7f1ee009b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee009b940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800e8a0 tx=0x7f1ec800ed60 comp rx=0 tx=0).stop 2024-05-16T21:33:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 shutdown_connections 2024-05-16T21:33:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f1ec0076300 0x7f1ec0078810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee014cce0 0x7f1ee01e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee00be4f0 0x7f1ee009b940 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 --2- 172.21.15.5:0/2192244937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ee0071be0 0x7f1ee00a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 >> 172.21.15.5:0/2192244937 conn(0x7f1ee00c17c0 msgr2=0x7f1ee00bcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 shutdown_connections 2024-05-16T21:33:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.724+0000 7f1ee65b2640 1 -- 172.21.15.5:0/2192244937 wait complete. 2024-05-16T21:33:51.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.847+0000 7ff7db972640 1 Processor -- start 2024-05-16T21:33:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.847+0000 7ff7db972640 1 -- start start 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7db972640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d4151fc0 0x7ff7d40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7db972640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff7d406da30 0x7ff7d40be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7db972640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7d406de40 0x7ff7d40bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7db972640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d40bdc10 con 0x7ff7d406de40 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7db972640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d40c36f0 con 0x7ff7d406da30 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7db972640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d4152530 con 0x7ff7d4151fc0 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7d9f0f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7d406de40 0x7ff7d40bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7d9f0f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7d406de40 0x7ff7d40bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40832/0 (socket says 172.21.15.5:40832) 2024-05-16T21:33:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7d9f0f640 1 -- 172.21.15.5:0/4061176911 learned_addr learned my addr 172.21.15.5:0/4061176911 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.848+0000 7ff7d970e640 1 --2- 172.21.15.5:0/4061176911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d4151fc0 0x7ff7d40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.849+0000 7ff7d8f0d640 1 --2- 172.21.15.5:0/4061176911 >> v2:172.21.15.157:3300/0 conn(0x7ff7d406da30 0x7ff7d40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.849+0000 7ff7d9f0f640 1 -- 172.21.15.5:0/4061176911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d4151fc0 msgr2=0x7ff7d40bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.849+0000 7ff7d9f0f640 1 --2- 172.21.15.5:0/4061176911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d4151fc0 0x7ff7d40bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.849+0000 7ff7d9f0f640 1 -- 172.21.15.5:0/4061176911 >> v2:172.21.15.157:3300/0 conn(0x7ff7d406da30 msgr2=0x7ff7d40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.849+0000 7ff7d9f0f640 1 --2- 172.21.15.5:0/4061176911 >> v2:172.21.15.157:3300/0 conn(0x7ff7d406da30 0x7ff7d40be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.849+0000 7ff7d9f0f640 1 -- 172.21.15.5:0/4061176911 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d4152810 con 0x7ff7d406de40 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.849+0000 7ff7d8f0d640 1 --2- 172.21.15.5:0/4061176911 >> v2:172.21.15.157:3300/0 conn(0x7ff7d406da30 0x7ff7d40be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.849+0000 7ff7d9f0f640 1 --2- 172.21.15.5:0/4061176911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d406de40 0x7ff7d40bee80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40c1440 tx=0x7ff7cc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7995b809c27615da server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7cbfff640 1 -- 172.21.15.5:0/4061176911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc036070 con 0x7ff7d406de40 2024-05-16T21:33:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7cbfff640 1 -- 172.21.15.5:0/4061176911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7cc031600 con 0x7ff7d406de40 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7cbfff640 1 -- 172.21.15.5:0/4061176911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0319d0 con 0x7ff7d406de40 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 -- 172.21.15.5:0/4061176911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d406de40 msgr2=0x7ff7d40bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 --2- 172.21.15.5:0/4061176911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d406de40 0x7ff7d40bee80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40c1440 tx=0x7ff7cc02a6a0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 -- 172.21.15.5:0/4061176911 shutdown_connections 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 --2- 172.21.15.5:0/4061176911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d406de40 0x7ff7d40bee80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 --2- 172.21.15.5:0/4061176911 >> v2:172.21.15.157:3300/0 conn(0x7ff7d406da30 0x7ff7d40be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 --2- 172.21.15.5:0/4061176911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d4151fc0 0x7ff7d40bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 -- 172.21.15.5:0/4061176911 >> 172.21.15.5:0/4061176911 conn(0x7ff7d40c3d20 msgr2=0x7ff7d40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 -- 172.21.15.5:0/4061176911 shutdown_connections 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.850+0000 7ff7db972640 1 -- 172.21.15.5:0/4061176911 wait complete. 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.852+0000 7ff7db972640 1 Processor -- start 2024-05-16T21:33:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.852+0000 7ff7db972640 1 -- start start 2024-05-16T21:33:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7db972640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7d406da30 0x7ff7d41511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7db972640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d406de40 0x7ff7d41e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7db972640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d4151fc0 0x7ff7d414a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7db972640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40a3050 con 0x7ff7d4151fc0 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7db972640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40a2ed0 con 0x7ff7d406da30 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7db972640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d414e570 con 0x7ff7d406de40 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7d9f0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d4151fc0 0x7ff7d414a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7d9f0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d4151fc0 0x7ff7d414a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40844/0 (socket says 172.21.15.5:40844) 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7d9f0f640 1 -- 172.21.15.5:0/1125385529 learned_addr learned my addr 172.21.15.5:0/1125385529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7d8f0d640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d406de40 0x7ff7d41e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7d970e640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7d406da30 0x7ff7d41511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7d9f0f640 1 -- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d406de40 msgr2=0x7ff7d41e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.853+0000 7ff7d9f0f640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d406de40 0x7ff7d41e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7d9f0f640 1 -- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7d406da30 msgr2=0x7ff7d41511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7d9f0f640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7d406da30 0x7ff7d41511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7d9f0f640 1 -- 172.21.15.5:0/1125385529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d414ad70 con 0x7ff7d4151fc0 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7d9f0f640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d4151fc0 0x7ff7d414a830 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009f40 tx=0x7ff7cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7c9ffb640 1 -- 172.21.15.5:0/1125385529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc036050 con 0x7ff7d4151fc0 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7c9ffb640 1 -- 172.21.15.5:0/1125385529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7cc042070 con 0x7ff7d4151fc0 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7c9ffb640 1 -- 172.21.15.5:0/1125385529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc009510 con 0x7ff7d4151fc0 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d41e8370 con 0x7ff7d4151fc0 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.854+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d41e8930 con 0x7ff7d4151fc0 2024-05-16T21:33:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.855+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d406a280 con 0x7ff7d4151fc0 2024-05-16T21:33:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.856+0000 7ff7c9ffb640 1 -- 172.21.15.5:0/1125385529 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff7cc007bf0 con 0x7ff7d4151fc0 2024-05-16T21:33:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.856+0000 7ff7c9ffb640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff7b80762d0 0x7ff7b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.856+0000 7ff7c9ffb640 1 -- 172.21.15.5:0/1125385529 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7ff7cc0b8490 con 0x7ff7d4151fc0 2024-05-16T21:33:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.857+0000 7ff7d970e640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff7b80762d0 0x7ff7b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.857+0000 7ff7d970e640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff7b80762d0 0x7ff7b80787e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009a30 tx=0x7ff7d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:51.861+0000 7ff7c9ffb640 1 -- 172.21.15.5:0/1125385529 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff7d406a280 con 0x7ff7d4151fc0 2024-05-16T21:33:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.088+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7d41517a0 con 0x7ff7d4151fc0 2024-05-16T21:33:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.089+0000 7ff7c9ffb640 1 -- 172.21.15.5:0/1125385529 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+4354 (secure 0 0 0) 0x7ff7cc081d90 con 0x7ff7d4151fc0 2024-05-16T21:33:52.091 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:52.091 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:50.124310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5181,"qdb_cluster":[5181]},"id":3}]} 2024-05-16T21:33:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-05-16T21:33:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff7b80762d0 msgr2=0x7ff7b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff7b80762d0 0x7ff7b80787e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009a30 tx=0x7ff7d0008040 comp rx=0 tx=0).stop 2024-05-16T21:33:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d4151fc0 msgr2=0x7ff7d414a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d4151fc0 0x7ff7d414a830 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009f40 tx=0x7ff7cc004a40 comp rx=0 tx=0).stop 2024-05-16T21:33:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 shutdown_connections 2024-05-16T21:33:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff7b80762d0 0x7ff7b80787e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d4151fc0 0x7ff7d414a830 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7d406de40 0x7ff7d41e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 --2- 172.21.15.5:0/1125385529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7d406da30 0x7ff7d41511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 >> 172.21.15.5:0/1125385529 conn(0x7ff7d40c3d20 msgr2=0x7ff7d40c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 shutdown_connections 2024-05-16T21:33:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:52.091+0000 7ff7db972640 1 -- 172.21.15.5:0/1125385529 wait complete. 2024-05-16T21:33:52.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /dir 0 2024-05-16T21:33:52.123 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-05-16T21:33:52.122+0000 7faeb5d34640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T21:33:52.229 INFO:teuthology.orchestra.run.smithi005.stdout:[{"ino":1099511627780,"rdev":0,"ctime":"2024-05-16T21:33:44.402089+0000","btime":"2024-05-16T21:33:44.402089+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-05-16T21:33:44.402089+0000","atime":"2024-05-16T21:33:44.402089+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":16,"file_data_version":0,"xattr_version":1,"backtrace_version":14,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[],"is_subvolume":false}] 2024-05-16T21:33:52.230 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-05-16T21:33:44.402089+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 14, "btime": "2024-05-16T21:33:44.402089+0000", "change_attr": 1, "client_caps": [], "client_ranges": [], "ctime": "2024-05-16T21:33:44.402089+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1316, "ino": 1099511627780, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-05-16T21:33:44.402089+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 16, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-05-16T21:33:52.230 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt purge --force --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-16T21:33:52.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T21:33:52.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-16T21:33:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T21:33:52.760 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-16T21:33:52.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:52.787 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:52.820 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T21:33:52.929 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-16T21:33:52.929 INFO:tasks.cephfs.mount:Terminating background process 2024-05-16T21:33:52.930 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:33:52.930 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:33:52.978 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T21:33:52.979 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T21:33:53.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-16T21:33:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.192+0000 7f0c01f94640 1 Processor -- start 2024-05-16T21:33:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.192+0000 7f0c01f94640 1 -- start start 2024-05-16T21:33:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.193+0000 7f0c01f94640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0bfc14e360 0x7f0bfc1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.193+0000 7f0c01f94640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bfc0c1390 con 0x7f0bfc0bf9b0 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.193+0000 7f0c01f94640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bfc0c0620 con 0x7f0bfc148770 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.193+0000 7f0c01f94640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0bfc151e40 con 0x7f0bfc14e360 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.193+0000 7f0bfb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0bfc14e360 0x7f0bfc1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.193+0000 7f0bfbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0bfc0bf9b0 0x7f0bfc0bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41448/0 (socket says 172.21.15.5:41448) 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.193+0000 7f0bfbfff640 1 -- 172.21.15.5:0/1649795476 learned_addr learned my addr 172.21.15.5:0/1649795476 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.194+0000 7f0bfb7fe640 1 -- 172.21.15.5:0/1649795476 >> v1:172.21.15.157:6789/0 conn(0x7f0bfc148770 legacy=0x7f0bfc0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.194+0000 7f0bfb7fe640 1 -- 172.21.15.5:0/1649795476 >> v1:172.21.15.5:6789/0 conn(0x7f0bfc0bf9b0 legacy=0x7f0bfc0bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.194+0000 7f0bfa7fc640 1 -- 172.21.15.5:0/1649795476 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679172065 0 0) 0x7f0bf4001490 con 0x7f0bfc0bf9b0 2024-05-16T21:33:53.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.194+0000 7f0bfb7fe640 1 -- 172.21.15.5:0/1649795476 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc151ad0 con 0x7f0bfc14e360 2024-05-16T21:33:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.194+0000 7f0bfb7fe640 1 --2- 172.21.15.5:0/1649795476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc1522d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0097d0 tx=0x7f0bec02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbd41bc7d5c39ef server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0bfa7fc640 1 -- 172.21.15.5:0/1649795476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec037070 con 0x7f0bfc14e360 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0bfa7fc640 1 -- 172.21.15.5:0/1649795476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec032640 con 0x7f0bfc14e360 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0bfa7fc640 1 -- 172.21.15.5:0/1649795476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec032a10 con 0x7f0bfc14e360 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0c01f94640 1 -- 172.21.15.5:0/1649795476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 msgr2=0x7f0bfc1522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0c01f94640 1 --2- 172.21.15.5:0/1649795476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc1522d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0097d0 tx=0x7f0bec02a300 comp rx=0 tx=0).stop 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0c01f94640 1 -- 172.21.15.5:0/1649795476 shutdown_connections 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0c01f94640 1 --2- 172.21.15.5:0/1649795476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc1522d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0c01f94640 1 -- 172.21.15.5:0/1649795476 >> 172.21.15.5:0/1649795476 conn(0x7f0bfc0c17c0 msgr2=0x7f0bfc0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0c01f94640 1 -- 172.21.15.5:0/1649795476 shutdown_connections 2024-05-16T21:33:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.195+0000 7f0c01f94640 1 -- 172.21.15.5:0/1649795476 wait complete. 2024-05-16T21:33:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.197+0000 7f0c01f94640 1 Processor -- start 2024-05-16T21:33:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.197+0000 7f0c01f94640 1 -- start start 2024-05-16T21:33:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0c01f94640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bfc0bf9b0 0x7f0bfc138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0c01f94640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bfc148770 0x7f0bfc142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0c01f94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0c01f94640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc159e50 con 0x7f0bfc14e360 2024-05-16T21:33:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0c01f94640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc159cd0 con 0x7f0bfc148770 2024-05-16T21:33:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0c01f94640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0bfc159fd0 con 0x7f0bfc0bf9b0 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0bfbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0bfbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40872/0 (socket says 172.21.15.5:40872) 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0bfbfff640 1 -- 172.21.15.5:0/4149093554 learned_addr learned my addr 172.21.15.5:0/4149093554 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0bfaffd640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bfc148770 0x7f0bfc142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.198+0000 7f0bfb7fe640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bfc0bf9b0 0x7f0bfc138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0bfbfff640 1 -- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bfc0bf9b0 msgr2=0x7f0bfc138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0bfbfff640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bfc0bf9b0 0x7f0bfc138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0bfbfff640 1 -- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bfc148770 msgr2=0x7f0bfc142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0bfbfff640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bfc148770 0x7f0bfc142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0bfbfff640 1 -- 172.21.15.5:0/4149093554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc1393c0 con 0x7f0bfc14e360 2024-05-16T21:33:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0bfbfff640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc150a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c6b0 tx=0x7f0bf400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0be3fff640 1 -- 172.21.15.5:0/4149093554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4018070 con 0x7f0bfc14e360 2024-05-16T21:33:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0be3fff640 1 -- 172.21.15.5:0/4149093554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf4004da0 con 0x7f0bfc14e360 2024-05-16T21:33:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0be3fff640 1 -- 172.21.15.5:0/4149093554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf400a880 con 0x7f0bfc14e360 2024-05-16T21:33:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bfc1425a0 con 0x7f0bfc14e360 2024-05-16T21:33:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.199+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bfc0a5580 con 0x7f0bfc14e360 2024-05-16T21:33:53.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.200+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bfc14bd30 con 0x7f0bfc14e360 2024-05-16T21:33:53.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.201+0000 7f0be3fff640 1 -- 172.21.15.5:0/4149093554 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0bf401b070 con 0x7f0bfc14e360 2024-05-16T21:33:53.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.201+0000 7f0be3fff640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0be80762d0 0x7f0be80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.201+0000 7f0be3fff640 1 -- 172.21.15.5:0/4149093554 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f0bf4096af0 con 0x7f0bfc14e360 2024-05-16T21:33:53.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.202+0000 7f0bfb7fe640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0be80762d0 0x7f0be80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.202+0000 7f0bfb7fe640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0be80762d0 0x7f0be80787e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bec034000 tx=0x7f0bec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:53.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.206+0000 7f0be3fff640 1 -- 172.21.15.5:0/4149093554 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0bfc0c1390 con 0x7f0bfc14e360 2024-05-16T21:33:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.410+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0bfc14f0f0 con 0x7f0bfc14e360 2024-05-16T21:33:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.411+0000 7f0be3fff640 1 -- 172.21.15.5:0/4149093554 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v42) ==== 80+0+120 (secure 0 0 0) 0x7f0bf405fe30 con 0x7f0bfc14e360 2024-05-16T21:33:53.413 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6835/1584346239 2024-05-17T21:33:46.105734+0000 2024-05-16T21:33:53.413 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6834/1584346239 2024-05-17T21:33:46.105734+0000 2024-05-16T21:33:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:listed 2 entries 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0be80762d0 msgr2=0x7f0be80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0be80762d0 0x7f0be80787e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bec034000 tx=0x7f0bec02e000 comp rx=0 tx=0).stop 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 msgr2=0x7f0bfc150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc150a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c6b0 tx=0x7f0bf400cb70 comp rx=0 tx=0).stop 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 shutdown_connections 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0be80762d0 0x7f0be80787e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bfc14e360 0x7f0bfc150a30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bfc148770 0x7f0bfc142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 --2- 172.21.15.5:0/4149093554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bfc0bf9b0 0x7f0bfc138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 >> 172.21.15.5:0/4149093554 conn(0x7f0bfc0c17c0 msgr2=0x7f0bfc13f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 shutdown_connections 2024-05-16T21:33:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.413+0000 7f0c01f94640 1 -- 172.21.15.5:0/4149093554 wait complete. 2024-05-16T21:33:53.426 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-16T21:33:53.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:53.427 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-16T21:33:53.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-05-16T21:33:53.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T21:33:53.522 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-16T21:33:53.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.682+0000 7f8de62d9640 1 Processor -- start 2024-05-16T21:33:53.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.682+0000 7f8de62d9640 1 -- start start 2024-05-16T21:33:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de62d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de00bc1c0 0x7f8de00a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de62d9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8de0146380 0x7f8de0070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de62d9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8de014c8e0 0x7f8de014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de62d9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8de014c450 con 0x7f8de014c8e0 2024-05-16T21:33:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de62d9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8de014c120 con 0x7f8de0146380 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de62d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8de0071e40 con 0x7f8de00bc1c0 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de4876640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8de014c8e0 0x7f8de014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de4876640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8de014c8e0 0x7f8de014ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40878/0 (socket says 172.21.15.5:40878) 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de4876640 1 -- 172.21.15.5:0/3464472408 learned_addr learned my addr 172.21.15.5:0/3464472408 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8ddf7fe640 1 --2- 172.21.15.5:0/3464472408 >> v2:172.21.15.157:3300/0 conn(0x7f8de0146380 0x7f8de0070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8ddffff640 1 --2- 172.21.15.5:0/3464472408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de00bc1c0 0x7f8de00a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de4876640 1 -- 172.21.15.5:0/3464472408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de00bc1c0 msgr2=0x7f8de00a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de4876640 1 --2- 172.21.15.5:0/3464472408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de00bc1c0 0x7f8de00a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de4876640 1 -- 172.21.15.5:0/3464472408 >> v2:172.21.15.157:3300/0 conn(0x7f8de0146380 msgr2=0x7f8de0070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de4876640 1 --2- 172.21.15.5:0/3464472408 >> v2:172.21.15.157:3300/0 conn(0x7f8de0146380 0x7f8de0070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.683+0000 7f8de4876640 1 -- 172.21.15.5:0/3464472408 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de00713d0 con 0x7f8de014c8e0 2024-05-16T21:33:53.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.684+0000 7f8de4876640 1 --2- 172.21.15.5:0/3464472408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de014ccf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8de00732a0 tx=0x7f8dd802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c11085e144632f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.684+0000 7f8ddeffd640 1 -- 172.21.15.5:0/3464472408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8036070 con 0x7f8de014c8e0 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.684+0000 7f8ddeffd640 1 -- 172.21.15.5:0/3464472408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd8031600 con 0x7f8de014c8e0 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.684+0000 7f8ddeffd640 1 -- 172.21.15.5:0/3464472408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80319d0 con 0x7f8de014c8e0 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 -- 172.21.15.5:0/3464472408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 msgr2=0x7f8de014ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 --2- 172.21.15.5:0/3464472408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de014ccf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8de00732a0 tx=0x7f8dd802a6a0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 -- 172.21.15.5:0/3464472408 shutdown_connections 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 --2- 172.21.15.5:0/3464472408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de014ccf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 --2- 172.21.15.5:0/3464472408 >> v2:172.21.15.157:3300/0 conn(0x7f8de0146380 0x7f8de0070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 --2- 172.21.15.5:0/3464472408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de00bc1c0 0x7f8de00a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 -- 172.21.15.5:0/3464472408 >> 172.21.15.5:0/3464472408 conn(0x7f8de00c17c0 msgr2=0x7f8de00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 -- 172.21.15.5:0/3464472408 shutdown_connections 2024-05-16T21:33:53.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.685+0000 7f8de62d9640 1 -- 172.21.15.5:0/3464472408 wait complete. 2024-05-16T21:33:53.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.686+0000 7f8de62d9640 1 Processor -- start 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.687+0000 7f8de62d9640 1 -- start start 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de62d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8de00bc1c0 0x7f8de0144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de62d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de0146380 0x7f8de00a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de62d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de013f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de62d9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8de00bd5f0 con 0x7f8de014c8e0 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de62d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0146790 con 0x7f8de00bc1c0 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de62d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8de00bd770 con 0x7f8de0146380 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de013f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de013f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40890/0 (socket says 172.21.15.5:40890) 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 -- 172.21.15.5:0/4100270054 learned_addr learned my addr 172.21.15.5:0/4100270054 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8ddf7fe640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de0146380 0x7f8de00a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8ddffff640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8de00bc1c0 0x7f8de0144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 -- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de0146380 msgr2=0x7f8de00a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de0146380 0x7f8de00a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 -- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8de00bc1c0 msgr2=0x7f8de0144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8de00bc1c0 0x7f8de0144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 -- 172.21.15.5:0/4100270054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de01450b0 con 0x7f8de014c8e0 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de4876640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de013f850 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009f40 tx=0x7f8dd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8ddcff9640 1 -- 172.21.15.5:0/4100270054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8041020 con 0x7f8de014c8e0 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8ddcff9640 1 -- 172.21.15.5:0/4100270054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd8007780 con 0x7f8de014c8e0 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de00a1e40 con 0x7f8de014c8e0 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.688+0000 7f8ddcff9640 1 -- 172.21.15.5:0/4100270054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8036040 con 0x7f8de014c8e0 2024-05-16T21:33:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.689+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de01458a0 con 0x7f8de014c8e0 2024-05-16T21:33:53.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.689+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de006a280 con 0x7f8de014c8e0 2024-05-16T21:33:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.690+0000 7f8ddcff9640 1 -- 172.21.15.5:0/4100270054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8dd8044020 con 0x7f8de014c8e0 2024-05-16T21:33:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.690+0000 7f8ddcff9640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8dcc0762d0 0x7f8dcc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.691+0000 7f8ddcff9640 1 -- 172.21.15.5:0/4100270054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f8dd80b8260 con 0x7f8de014c8e0 2024-05-16T21:33:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.691+0000 7f8ddffff640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8dcc0762d0 0x7f8dcc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:53.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.691+0000 7f8ddffff640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8dcc0762d0 0x7f8dcc0787e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0004610 tx=0x7f8dd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:53.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.695+0000 7f8ddcff9640 1 -- 172.21.15.5:0/4100270054 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8de006a280 con 0x7f8de014c8e0 2024-05-16T21:33:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.923+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8de0149b20 con 0x7f8de014c8e0 2024-05-16T21:33:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.923+0000 7f8ddcff9640 1 -- 172.21.15.5:0/4100270054 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+4354 (secure 0 0 0) 0x7f8dd804b030 con 0x7f8de014c8e0 2024-05-16T21:33:53.925 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:53.926 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:50.124310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5181,"qdb_cluster":[5181]},"id":3}]} 2024-05-16T21:33:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-05-16T21:33:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8dcc0762d0 msgr2=0x7f8dcc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8dcc0762d0 0x7f8dcc0787e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0004610 tx=0x7f8dd0008040 comp rx=0 tx=0).stop 2024-05-16T21:33:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 msgr2=0x7f8de013f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de013f850 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009f40 tx=0x7f8dd8004a40 comp rx=0 tx=0).stop 2024-05-16T21:33:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 shutdown_connections 2024-05-16T21:33:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8dcc0762d0 0x7f8dcc0787e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8de014c8e0 0x7f8de013f850 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8de0146380 0x7f8de00a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 --2- 172.21.15.5:0/4100270054 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8de00bc1c0 0x7f8de0144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 >> 172.21.15.5:0/4100270054 conn(0x7f8de00c17c0 msgr2=0x7f8de01411c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 shutdown_connections 2024-05-16T21:33:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:53.925+0000 7f8de62d9640 1 -- 172.21.15.5:0/4100270054 wait complete. 2024-05-16T21:33:53.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.048+0000 7f7b8d484640 1 Processor -- start 2024-05-16T21:33:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.048+0000 7f7b8d484640 1 -- start start 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.049+0000 7f7b8d484640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b8814e360 0x7f7b881522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.049+0000 7f7b8d484640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7b88148770 0x7f7b880c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.049+0000 7f7b8d484640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b880bf9b0 0x7f7b880bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.049+0000 7f7b8d484640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7b88151e40 con 0x7f7b8814e360 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.049+0000 7f7b8d484640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7b880c0620 con 0x7f7b88148770 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.049+0000 7f7b8d484640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7b88151ad0 con 0x7f7b880bf9b0 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b86ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b8814e360 0x7f7b881522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b86ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b8814e360 0x7f7b881522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40904/0 (socket says 172.21.15.5:40904) 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b86ffd640 1 -- 172.21.15.5:0/2163383972 learned_addr learned my addr 172.21.15.5:0/2163383972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:54.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b867fc640 1 --2- 172.21.15.5:0/2163383972 >> v2:172.21.15.157:3300/0 conn(0x7f7b88148770 0x7f7b880c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b877fe640 1 --2- 172.21.15.5:0/2163383972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b880bf9b0 0x7f7b880bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b86ffd640 1 -- 172.21.15.5:0/2163383972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b880bf9b0 msgr2=0x7f7b880bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b86ffd640 1 --2- 172.21.15.5:0/2163383972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b880bf9b0 0x7f7b880bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b86ffd640 1 -- 172.21.15.5:0/2163383972 >> v2:172.21.15.157:3300/0 conn(0x7f7b88148770 msgr2=0x7f7b880c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b86ffd640 1 --2- 172.21.15.5:0/2163383972 >> v2:172.21.15.157:3300/0 conn(0x7f7b88148770 0x7f7b880c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.050+0000 7f7b86ffd640 1 -- 172.21.15.5:0/2163383972 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b88152810 con 0x7f7b8814e360 2024-05-16T21:33:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b86ffd640 1 --2- 172.21.15.5:0/2163383972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b8814e360 0x7f7b881522d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7b8814bf30 tx=0x7f7b8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a99ea25d3503275 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b85ffb640 1 -- 172.21.15.5:0/2163383972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80037070 con 0x7f7b8814e360 2024-05-16T21:33:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b85ffb640 1 -- 172.21.15.5:0/2163383972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80032440 con 0x7f7b8814e360 2024-05-16T21:33:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b85ffb640 1 -- 172.21.15.5:0/2163383972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80032810 con 0x7f7b8814e360 2024-05-16T21:33:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b8d484640 1 -- 172.21.15.5:0/2163383972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b8814e360 msgr2=0x7f7b881522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b8d484640 1 --2- 172.21.15.5:0/2163383972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b8814e360 0x7f7b881522d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7b8814bf30 tx=0x7f7b8002a270 comp rx=0 tx=0).stop 2024-05-16T21:33:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b8d484640 1 -- 172.21.15.5:0/2163383972 shutdown_connections 2024-05-16T21:33:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b8d484640 1 --2- 172.21.15.5:0/2163383972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b880bf9b0 0x7f7b880bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b8d484640 1 --2- 172.21.15.5:0/2163383972 >> v2:172.21.15.157:3300/0 conn(0x7f7b88148770 0x7f7b880c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b8d484640 1 --2- 172.21.15.5:0/2163383972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b8814e360 0x7f7b881522d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.051+0000 7f7b8d484640 1 -- 172.21.15.5:0/2163383972 >> 172.21.15.5:0/2163383972 conn(0x7f7b880c17c0 msgr2=0x7f7b880c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.052+0000 7f7b8d484640 1 -- 172.21.15.5:0/2163383972 shutdown_connections 2024-05-16T21:33:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.052+0000 7f7b8d484640 1 -- 172.21.15.5:0/2163383972 wait complete. 2024-05-16T21:33:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.053+0000 7f7b8d484640 1 Processor -- start 2024-05-16T21:33:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.053+0000 7f7b8d484640 1 -- start start 2024-05-16T21:33:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b8d484640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b880bf9b0 0x7f7b880a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b8d484640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b88148770 0x7f7b88072550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b8d484640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b8814e360 0x7f7b8806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b8d484640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7b880c1340 con 0x7f7b880bf9b0 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b8d484640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7b880c11c0 con 0x7f7b88148770 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b8d484640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7b8809fd50 con 0x7f7b8814e360 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b86ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b880bf9b0 0x7f7b880a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b86ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b880bf9b0 0x7f7b880a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40912/0 (socket says 172.21.15.5:40912) 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b86ffd640 1 -- 172.21.15.5:0/1371334791 learned_addr learned my addr 172.21.15.5:0/1371334791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.054+0000 7f7b867fc640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b88148770 0x7f7b88072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b877fe640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b8814e360 0x7f7b8806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b86ffd640 1 -- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b8814e360 msgr2=0x7f7b8806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b86ffd640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b8814e360 0x7f7b8806e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b86ffd640 1 -- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b88148770 msgr2=0x7f7b88072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b86ffd640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b88148770 0x7f7b88072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b86ffd640 1 -- 172.21.15.5:0/1371334791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b88072a90 con 0x7f7b880bf9b0 2024-05-16T21:33:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b877fe640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b8814e360 0x7f7b8806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b86ffd640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b880bf9b0 0x7f7b880a1f80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7b8002a2b0 tx=0x7f7b800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b7f7fe640 1 -- 172.21.15.5:0/1371334791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80041020 con 0x7f7b880bf9b0 2024-05-16T21:33:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b7f7fe640 1 -- 172.21.15.5:0/1371334791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8003d620 con 0x7f7b880bf9b0 2024-05-16T21:33:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8806e5d0 con 0x7f7b880bf9b0 2024-05-16T21:33:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b7f7fe640 1 -- 172.21.15.5:0/1371334791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80037040 con 0x7f7b880bf9b0 2024-05-16T21:33:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.055+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b88071820 con 0x7f7b880bf9b0 2024-05-16T21:33:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.056+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b88050940 con 0x7f7b880bf9b0 2024-05-16T21:33:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.057+0000 7f7b7f7fe640 1 -- 172.21.15.5:0/1371334791 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b80044020 con 0x7f7b880bf9b0 2024-05-16T21:33:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.057+0000 7f7b7f7fe640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7b68076300 0x7f7b68078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.058+0000 7f7b7f7fe640 1 -- 172.21.15.5:0/1371334791 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f7b800b7d10 con 0x7f7b880bf9b0 2024-05-16T21:33:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.058+0000 7f7b867fc640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7b68076300 0x7f7b68078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.058+0000 7f7b867fc640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7b68076300 0x7f7b68078810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7b880c10d0 tx=0x7f7b70009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.062+0000 7f7b7f7fe640 1 -- 172.21.15.5:0/1371334791 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7b8004b030 con 0x7f7b880bf9b0 2024-05-16T21:33:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.293+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b880bf790 con 0x7f7b880bf9b0 2024-05-16T21:33:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.293+0000 7f7b7f7fe640 1 -- 172.21.15.5:0/1371334791 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+4354 (secure 0 0 0) 0x7f7b80081570 con 0x7f7b880bf9b0 2024-05-16T21:33:54.296 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:54.296 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:50.124310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5181,"qdb_cluster":[5181]},"id":3}]} 2024-05-16T21:33:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-05-16T21:33:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.295+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7b68076300 msgr2=0x7f7b68078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.295+0000 7f7b8d484640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7b68076300 0x7f7b68078810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7b880c10d0 tx=0x7f7b70009190 comp rx=0 tx=0).stop 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.295+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b880bf9b0 msgr2=0x7f7b880a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.295+0000 7f7b8d484640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b880bf9b0 0x7f7b880a1f80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7b8002a2b0 tx=0x7f7b800046c0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.295+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 shutdown_connections 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.295+0000 7f7b8d484640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f7b68076300 0x7f7b68078810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.295+0000 7f7b8d484640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b8814e360 0x7f7b8806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.296+0000 7f7b8d484640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b88148770 0x7f7b88072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.296+0000 7f7b8d484640 1 --2- 172.21.15.5:0/1371334791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b880bf9b0 0x7f7b880a1f80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.296+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 >> 172.21.15.5:0/1371334791 conn(0x7f7b880c17c0 msgr2=0x7f7b880c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.296+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 shutdown_connections 2024-05-16T21:33:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.296+0000 7f7b8d484640 1 -- 172.21.15.5:0/1371334791 wait complete. 2024-05-16T21:33:54.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:33:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.418+0000 7f424e896640 1 Processor -- start 2024-05-16T21:33:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.419+0000 7f424e896640 1 -- start start 2024-05-16T21:33:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f424e896640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42480bf5c0 0x7f42480be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f424e896640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4248151b40 con 0x7f424809fd50 2024-05-16T21:33:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f424e896640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4248151e20 con 0x7f42480bfa30 2024-05-16T21:33:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f424e896640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f42481518f0 con 0x7f42480bf5c0 2024-05-16T21:33:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f42477fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f424809fd50 0x7f42480bd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41460/0 (socket says 172.21.15.5:41460) 2024-05-16T21:33:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f42477fe640 1 -- 172.21.15.5:0/3732397900 learned_addr learned my addr 172.21.15.5:0/3732397900 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4247fff640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42480bf5c0 0x7f42480be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637073624 0 0) 0x7f4248151b40 con 0x7f424809fd50 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4230003520 con 0x7f424809fd50 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958512176 0 0) 0x7f4248151e20 con 0x7f42480bfa30 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4248151b40 con 0x7f42480bfa30 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1137498413 0 0) 0x7f4230003520 con 0x7f424809fd50 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42480bf5c0 msgr2=0x7f42480be2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42480bf5c0 0x7f42480be2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 >> v1:172.21.15.157:6789/0 conn(0x7f42480bfa30 legacy=0x7f4248158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42480be820 con 0x7f424809fd50 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.420+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f423c0016f0 con 0x7f424809fd50 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 >> v1:172.21.15.5:6789/0 conn(0x7f424809fd50 legacy=0x7f42480bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4246ffd640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4230003c10 0x7f4230004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4246ffd640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4230004800 0x7f4230004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4246ffd640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230005210 0x7f423000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42481518f0 con 0x7f4230005210 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f423000c0f0 con 0x7f4230003c10 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f423000c2f0 con 0x7f4230004800 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4247fff640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42480bf5c0 0x7f42480be2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f424ce33640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230005210 0x7f423000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f42477fe640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4230004800 0x7f4230004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f4247fff640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4230003c10 0x7f4230004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f424ce33640 1 -- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4230004800 msgr2=0x7f4230004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f424ce33640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4230004800 0x7f4230004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f424ce33640 1 -- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4230003c10 msgr2=0x7f4230004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f424ce33640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4230003c10 0x7f4230004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.421+0000 7f424ce33640 1 -- 172.21.15.5:0/3732397900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4230003520 con 0x7f4230005210 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.422+0000 7f424ce33640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230005210 0x7f423000b9c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4240001fd0 tx=0x7f4230005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f0263beefe7acc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.422+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240001c20 con 0x7f4230005210 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.422+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240006d70 con 0x7f4230005210 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.422+0000 7f4246ffd640 1 -- 172.21.15.5:0/3732397900 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240003bb0 con 0x7f4230005210 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.422+0000 7f424e896640 1 -- 172.21.15.5:0/3732397900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230005210 msgr2=0x7f423000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.422+0000 7f424e896640 1 --2- 172.21.15.5:0/3732397900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4230005210 0x7f423000b9c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4240001fd0 tx=0x7f4230005830 comp rx=0 tx=0).stop 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.422+0000 7f424ce33640 1 -- 172.21.15.5:0/3732397900 reap_dead start 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.423+0000 7f424e896640 1 -- 172.21.15.5:0/3732397900 shutdown_connections 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.423+0000 7f424e896640 1 -- 172.21.15.5:0/3732397900 >> 172.21.15.5:0/3732397900 conn(0x7f42480c17c0 msgr2=0x7f42480c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.423+0000 7f424e896640 1 -- 172.21.15.5:0/3732397900 shutdown_connections 2024-05-16T21:33:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.423+0000 7f424e896640 1 -- 172.21.15.5:0/3732397900 wait complete. 2024-05-16T21:33:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.424+0000 7f424e896640 1 Processor -- start 2024-05-16T21:33:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.424+0000 7f424e896640 1 -- start start 2024-05-16T21:33:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424e896640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42481d90d0 0x7f424814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424e896640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4248142530 0x7f4248142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424e896640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424814c020 0x7f424814c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424e896640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4248152190 con 0x7f424814c020 2024-05-16T21:33:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424e896640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4248152830 con 0x7f4248142530 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424e896640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f42480a0160 con 0x7f42481d90d0 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424ce33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424814c020 0x7f424814c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424ce33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424814c020 0x7f424814c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40926/0 (socket says 172.21.15.5:40926) 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f424ce33640 1 -- 172.21.15.5:0/1074446534 learned_addr learned my addr 172.21.15.5:0/1074446534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.425+0000 7f4247fff640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42481d90d0 0x7f424814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f42477fe640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4248142530 0x7f4248142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f424ce33640 1 -- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42481d90d0 msgr2=0x7f424814d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f424ce33640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42481d90d0 0x7f424814d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f424ce33640 1 -- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4248142530 msgr2=0x7f4248142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f424ce33640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4248142530 0x7f4248142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f424ce33640 1 -- 172.21.15.5:0/1074446534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42481e8090 con 0x7f424814c020 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f424ce33640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424814c020 0x7f424814c430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42400020f0 tx=0x7f4240001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f4244ff9640 1 -- 172.21.15.5:0/1074446534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240001c20 con 0x7f424814c020 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f4244ff9640 1 -- 172.21.15.5:0/1074446534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240040070 con 0x7f424814c020 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42481e8370 con 0x7f424814c020 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f4244ff9640 1 -- 172.21.15.5:0/1074446534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240007d90 con 0x7f424814c020 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.426+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f424814c970 con 0x7f424814c020 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.427+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f424814f2a0 con 0x7f424814c020 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.428+0000 7f4244ff9640 1 -- 172.21.15.5:0/1074446534 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4240039070 con 0x7f424814c020 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.428+0000 7f4244ff9640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42340762d0 0x7f42340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.428+0000 7f4244ff9640 1 -- 172.21.15.5:0/1074446534 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f42400b7040 con 0x7f424814c020 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.429+0000 7f4247fff640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42340762d0 0x7f42340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.429+0000 7f4247fff640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42340762d0 0x7f42340787e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f42480a45b0 tx=0x7f4238009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.433+0000 7f4244ff9640 1 -- 172.21.15.5:0/1074446534 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4240080260 con 0x7f424814c020 2024-05-16T21:33:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.627+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4248050940 con 0x7f424814c020 2024-05-16T21:33:54.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.629+0000 7f4244ff9640 1 -- 172.21.15.5:0/1074446534 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+16692 (secure 0 0 0) 0x7f4240084560 con 0x7f424814c020 2024-05-16T21:33:54.631 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:54.631 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:33:46.105764+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:33:29.941238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T21:33:31.208339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1584346239":"2024-05-17T21:33:46.105734+0000","172.21.15.5:6834/1584346239":"2024-05-17T21:33:46.105734+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.630+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42340762d0 msgr2=0x7f42340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.630+0000 7f424e896640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42340762d0 0x7f42340787e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f42480a45b0 tx=0x7f4238009190 comp rx=0 tx=0).stop 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.630+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424814c020 msgr2=0x7f424814c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.630+0000 7f424e896640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424814c020 0x7f424814c430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42400020f0 tx=0x7f4240001670 comp rx=0 tx=0).stop 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.631+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 shutdown_connections 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.631+0000 7f424e896640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f42340762d0 0x7f42340787e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.631+0000 7f424e896640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424814c020 0x7f424814c430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.631+0000 7f424e896640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4248142530 0x7f4248142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.631+0000 7f424e896640 1 --2- 172.21.15.5:0/1074446534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42481d90d0 0x7f424814d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.631+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 >> 172.21.15.5:0/1074446534 conn(0x7f42480c17c0 msgr2=0x7f42480bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:54.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.631+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 shutdown_connections 2024-05-16T21:33:54.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.631+0000 7f424e896640 1 -- 172.21.15.5:0/1074446534 wait complete. 2024-05-16T21:33:54.644 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-16T21:33:54.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.753+0000 7fbfb5eb6640 1 Processor -- start 2024-05-16T21:33:54.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.753+0000 7fbfb5eb6640 1 -- start start 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.754+0000 7fbfb5eb6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfb014e360 0x7fbfb01522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.754+0000 7fbfb5eb6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb0148770 0x7fbfb00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.754+0000 7fbfb5eb6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb00c0620 con 0x7fbfb00bf9b0 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.754+0000 7fbfb5eb6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb0151e40 con 0x7fbfb014e360 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.754+0000 7fbfb5eb6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb0151ad0 con 0x7fbfb0148770 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfb014e360 0x7fbfb01522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbfb00bf9b0 0x7fbfb00bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41466/0 (socket says 172.21.15.5:41466) 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaffff640 1 -- 172.21.15.5:0/529006783 learned_addr learned my addr 172.21.15.5:0/529006783 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaeffd640 1 --2- 172.21.15.5:0/529006783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb0148770 0x7fbfb00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaf7fe640 1 -- 172.21.15.5:0/529006783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb0148770 msgr2=0x7fbfb00c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:54.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaf7fe640 1 --2- 172.21.15.5:0/529006783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb0148770 0x7fbfb00c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaf7fe640 1 -- 172.21.15.5:0/529006783 >> v1:172.21.15.5:6789/0 conn(0x7fbfb00bf9b0 legacy=0x7fbfb00bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaf7fe640 1 -- 172.21.15.5:0/529006783 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb0152810 con 0x7fbfb014e360 2024-05-16T21:33:54.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfae7fc640 1 -- 172.21.15.5:0/529006783 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1823285914 0 0) 0x7fbfb00c0620 con 0x7fbfb00bf9b0 2024-05-16T21:33:54.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.755+0000 7fbfaeffd640 1 --2- 172.21.15.5:0/529006783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb0148770 0x7fbfb00c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:54.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.756+0000 7fbfaf7fe640 1 --2- 172.21.15.5:0/529006783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb014e360 0x7fbfb01522d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00097a0 tx=0x7fbfa002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511b38a85fddf400 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.756+0000 7fbfae7fc640 1 -- 172.21.15.5:0/529006783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0037070 con 0x7fbfb014e360 2024-05-16T21:33:54.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.756+0000 7fbfae7fc640 1 -- 172.21.15.5:0/529006783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa0032440 con 0x7fbfb014e360 2024-05-16T21:33:54.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.756+0000 7fbfae7fc640 1 -- 172.21.15.5:0/529006783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0032810 con 0x7fbfb014e360 2024-05-16T21:33:54.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.756+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/529006783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb014e360 msgr2=0x7fbfb01522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.756+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/529006783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb014e360 0x7fbfb01522d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00097a0 tx=0x7fbfa002a210 comp rx=0 tx=0).stop 2024-05-16T21:33:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.757+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/529006783 shutdown_connections 2024-05-16T21:33:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.757+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/529006783 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb0148770 0x7fbfb00c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.757+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/529006783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb014e360 0x7fbfb01522d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.757+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/529006783 >> 172.21.15.5:0/529006783 conn(0x7fbfb00c17c0 msgr2=0x7fbfb00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.757+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/529006783 shutdown_connections 2024-05-16T21:33:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.757+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/529006783 wait complete. 2024-05-16T21:33:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.758+0000 7fbfb5eb6640 1 Processor -- start 2024-05-16T21:33:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.758+0000 7fbfb5eb6640 1 -- start start 2024-05-16T21:33:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfb5eb6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfb00bf9b0 0x7fbfb01418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfb5eb6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb0148770 0x7fbfb0071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfb5eb6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb014e360 0x7fbfb00a3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfb5eb6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0158cc0 con 0x7fbfb0148770 2024-05-16T21:33:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfb5eb6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb00c13d0 con 0x7fbfb00bf9b0 2024-05-16T21:33:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfb5eb6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb0158e40 con 0x7fbfb014e360 2024-05-16T21:33:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb0148770 0x7fbfb0071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb0148770 0x7fbfb0071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40942/0 (socket says 172.21.15.5:40942) 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.759+0000 7fbfaeffd640 1 -- 172.21.15.5:0/2198027920 learned_addr learned my addr 172.21.15.5:0/2198027920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaffff640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb014e360 0x7fbfb00a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaf7fe640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfb00bf9b0 0x7fbfb01418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaeffd640 1 -- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb014e360 msgr2=0x7fbfb00a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaeffd640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb014e360 0x7fbfb00a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaeffd640 1 -- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfb00bf9b0 msgr2=0x7fbfb01418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaeffd640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfb00bf9b0 0x7fbfb01418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaeffd640 1 -- 172.21.15.5:0/2198027920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb00721e0 con 0x7fbfb0148770 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaf7fe640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfb00bf9b0 0x7fbfb01418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfaeffd640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb0148770 0x7fbfb0071ca0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400d7d0 tx=0x7fbfa400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbf97fff640 1 -- 172.21.15.5:0/2198027920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004030 con 0x7fbfb0148770 2024-05-16T21:33:54.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbf97fff640 1 -- 172.21.15.5:0/2198027920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa40041d0 con 0x7fbfb0148770 2024-05-16T21:33:54.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb0143290 con 0x7fbfb0148770 2024-05-16T21:33:54.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbf97fff640 1 -- 172.21.15.5:0/2198027920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40096a0 con 0x7fbfb0148770 2024-05-16T21:33:54.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.760+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb01e4550 con 0x7fbfb0148770 2024-05-16T21:33:54.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.761+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb0050940 con 0x7fbfb0148770 2024-05-16T21:33:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.762+0000 7fbf97fff640 1 -- 172.21.15.5:0/2198027920 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbfa4009840 con 0x7fbfb0148770 2024-05-16T21:33:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.762+0000 7fbf97fff640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbf9c0762d0 0x7fbf9c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.762+0000 7fbf97fff640 1 -- 172.21.15.5:0/2198027920 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7fbfa4097980 con 0x7fbfb0148770 2024-05-16T21:33:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.763+0000 7fbfaf7fe640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbf9c0762d0 0x7fbf9c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.763+0000 7fbfaf7fe640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbf9c0762d0 0x7fbf9c0787e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0034000 tx=0x7fbfa002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.767+0000 7fbf97fff640 1 -- 172.21.15.5:0/2198027920 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbfa4061150 con 0x7fbfb0148770 2024-05-16T21:33:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.998+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfb00bf790 con 0x7fbfb0148770 2024-05-16T21:33:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:54.999+0000 7fbf97fff640 1 -- 172.21.15.5:0/2198027920 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+4354 (secure 0 0 0) 0x7fbfa4060a50 con 0x7fbfb0148770 2024-05-16T21:33:55.001 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:55.001 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:50.124310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5181,"qdb_cluster":[5181]},"id":3}]} 2024-05-16T21:33:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbf9c0762d0 msgr2=0x7fbf9c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbf9c0762d0 0x7fbf9c0787e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0034000 tx=0x7fbfa002e000 comp rx=0 tx=0).stop 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb0148770 msgr2=0x7fbfb0071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb0148770 0x7fbfb0071ca0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400d7d0 tx=0x7fbfa400dc90 comp rx=0 tx=0).stop 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 shutdown_connections 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fbf9c0762d0 0x7fbf9c0787e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbfb014e360 0x7fbfb00a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb0148770 0x7fbfb0071ca0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 --2- 172.21.15.5:0/2198027920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfb00bf9b0 0x7fbfb01418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 >> 172.21.15.5:0/2198027920 conn(0x7fbfb00c17c0 msgr2=0x7fbfb00a65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 shutdown_connections 2024-05-16T21:33:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.001+0000 7fbfb5eb6640 1 -- 172.21.15.5:0/2198027920 wait complete. 2024-05-16T21:33:55.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T21:33:55.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.123+0000 7f45ed615640 1 Processor -- start 2024-05-16T21:33:55.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.123+0000 7f45ed615640 1 -- start start 2024-05-16T21:33:55.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.124+0000 7f45ed615640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45e8151fc0 0x7f45e80bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.124+0000 7f45ed615640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e80c36f0 con 0x7f45e80bf050 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.124+0000 7f45ed615640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e8152530 con 0x7f45e806da30 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.124+0000 7f45ed615640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f45e80bdc10 con 0x7f45e8151fc0 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.124+0000 7f45e6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45e8151fc0 0x7f45e80bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.124+0000 7f45e77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f45e80bf050 0x7f45e8158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41482/0 (socket says 172.21.15.5:41482) 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.124+0000 7f45e77fe640 1 -- 172.21.15.5:0/70138844 learned_addr learned my addr 172.21.15.5:0/70138844 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.125+0000 7f45e6ffd640 1 -- 172.21.15.5:0/70138844 >> v1:172.21.15.157:6789/0 conn(0x7f45e806da30 legacy=0x7f45e80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.125+0000 7f45e6ffd640 1 -- 172.21.15.5:0/70138844 >> v1:172.21.15.5:6789/0 conn(0x7f45e80bf050 legacy=0x7f45e8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.125+0000 7f45e5ffb640 1 -- 172.21.15.5:0/70138844 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418291736 0 0) 0x7f45e8152530 con 0x7f45e806da30 2024-05-16T21:33:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.125+0000 7f45e6ffd640 1 -- 172.21.15.5:0/70138844 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e8152810 con 0x7f45e8151fc0 2024-05-16T21:33:55.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.125+0000 7f45e6ffd640 1 --2- 172.21.15.5:0/70138844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e80bd6d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f45e00097a0 tx=0x7f45e002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f8c985610b1d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45e5ffb640 1 -- 172.21.15.5:0/70138844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0037070 con 0x7f45e8151fc0 2024-05-16T21:33:55.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45e5ffb640 1 -- 172.21.15.5:0/70138844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e002adc0 con 0x7f45e8151fc0 2024-05-16T21:33:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45e5ffb640 1 -- 172.21.15.5:0/70138844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0032660 con 0x7f45e8151fc0 2024-05-16T21:33:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45ed615640 1 -- 172.21.15.5:0/70138844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 msgr2=0x7f45e80bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45ed615640 1 --2- 172.21.15.5:0/70138844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e80bd6d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f45e00097a0 tx=0x7f45e002a130 comp rx=0 tx=0).stop 2024-05-16T21:33:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45ed615640 1 -- 172.21.15.5:0/70138844 shutdown_connections 2024-05-16T21:33:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45ed615640 1 --2- 172.21.15.5:0/70138844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e80bd6d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45ed615640 1 -- 172.21.15.5:0/70138844 >> 172.21.15.5:0/70138844 conn(0x7f45e80c3d20 msgr2=0x7f45e80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45ed615640 1 -- 172.21.15.5:0/70138844 shutdown_connections 2024-05-16T21:33:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.126+0000 7f45ed615640 1 -- 172.21.15.5:0/70138844 wait complete. 2024-05-16T21:33:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.128+0000 7f45ed615640 1 Processor -- start 2024-05-16T21:33:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.128+0000 7f45ed615640 1 -- start start 2024-05-16T21:33:55.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45ed615640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e806da30 0x7f45e81d9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45ed615640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45e80bf050 0x7f45e81d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45ed615640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e81d83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45ed615640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80a3050 con 0x7f45e8151fc0 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45ed615640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80a2ed0 con 0x7f45e806da30 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45ed615640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f45e806de40 con 0x7f45e80bf050 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e81d83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e81d83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40958/0 (socket says 172.21.15.5:40958) 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45e77fe640 1 -- 172.21.15.5:0/2664023610 learned_addr learned my addr 172.21.15.5:0/2664023610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45e6ffd640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e806da30 0x7f45e81d9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.129+0000 7f45e67fc640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45e80bf050 0x7f45e81d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45e77fe640 1 -- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45e80bf050 msgr2=0x7f45e81d79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45e77fe640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45e80bf050 0x7f45e81d79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45e77fe640 1 -- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e806da30 msgr2=0x7f45e81d9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45e77fe640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e806da30 0x7f45e81d9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45e77fe640 1 -- 172.21.15.5:0/2664023610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e81d7f20 con 0x7f45e8151fc0 2024-05-16T21:33:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45e77fe640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e81d83b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45d800cbf0 tx=0x7f45d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45cf7fe640 1 -- 172.21.15.5:0/2664023610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8017070 con 0x7f45e8151fc0 2024-05-16T21:33:55.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45cf7fe640 1 -- 172.21.15.5:0/2664023610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d800ad50 con 0x7f45e8151fc0 2024-05-16T21:33:55.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45cf7fe640 1 -- 172.21.15.5:0/2664023610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8012620 con 0x7f45e8151fc0 2024-05-16T21:33:55.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e81d88f0 con 0x7f45e8151fc0 2024-05-16T21:33:55.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.130+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e81e43d0 con 0x7f45e8151fc0 2024-05-16T21:33:55.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.131+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e80c10e0 con 0x7f45e8151fc0 2024-05-16T21:33:55.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.132+0000 7f45cf7fe640 1 -- 172.21.15.5:0/2664023610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f45d801a070 con 0x7f45e8151fc0 2024-05-16T21:33:55.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.132+0000 7f45cf7fe640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f45d40762d0 0x7f45d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.133+0000 7f45cf7fe640 1 -- 172.21.15.5:0/2664023610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f45d80973f0 con 0x7f45e8151fc0 2024-05-16T21:33:55.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.133+0000 7f45e6ffd640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f45d40762d0 0x7f45d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.133+0000 7f45e6ffd640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f45d40762d0 0x7f45d40787e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f45e0034000 tx=0x7f45e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.137+0000 7f45cf7fe640 1 -- 172.21.15.5:0/2664023610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f45e80c10e0 con 0x7f45e8151fc0 2024-05-16T21:33:55.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.368+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45e806eb40 con 0x7f45e8151fc0 2024-05-16T21:33:55.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.369+0000 7f45cf7fe640 1 -- 172.21.15.5:0/2664023610 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+4354 (secure 0 0 0) 0x7f45d8060690 con 0x7f45e8151fc0 2024-05-16T21:33:55.371 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:55.371 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T21:33:32.258682+0000","modified":"2024-05-16T21:33:50.124310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/2190655947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2190655947},{"type":"v1","addr":"172.21.15.5:6835","nonce":2190655947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5181,"qdb_cluster":[5181]},"id":3}]} 2024-05-16T21:33:55.371 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-05-16T21:33:55.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f45d40762d0 msgr2=0x7f45d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f45d40762d0 0x7f45d40787e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f45e0034000 tx=0x7f45e002e000 comp rx=0 tx=0).stop 2024-05-16T21:33:55.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 msgr2=0x7f45e81d83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e81d83b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45d800cbf0 tx=0x7f45d800a430 comp rx=0 tx=0).stop 2024-05-16T21:33:55.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 shutdown_connections 2024-05-16T21:33:55.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f45d40762d0 0x7f45d40787e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e8151fc0 0x7f45e81d83b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45e80bf050 0x7f45e81d79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 --2- 172.21.15.5:0/2664023610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e806da30 0x7f45e81d9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 >> 172.21.15.5:0/2664023610 conn(0x7f45e80c3d20 msgr2=0x7f45e80c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:55.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 shutdown_connections 2024-05-16T21:33:55.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.371+0000 7f45ed615640 1 -- 172.21.15.5:0/2664023610 wait complete. 2024-05-16T21:33:55.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T21:33:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.494+0000 7f2e895ff640 1 Processor -- start 2024-05-16T21:33:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.494+0000 7f2e895ff640 1 -- start start 2024-05-16T21:33:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e895ff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8406e650 0x7f2e84148420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e895ff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e8414e570 0x7f2e8414e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e895ff640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e84070ef0 con 0x7f2e840bc450 2024-05-16T21:33:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e895ff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2e8406eb10 con 0x7f2e8414e570 2024-05-16T21:33:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e895ff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8406edf0 con 0x7f2e8406e650 2024-05-16T21:33:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e837fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e8414e570 0x7f2e8414e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e837fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e8414e570 0x7f2e8414e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40968/0 (socket says 172.21.15.5:40968) 2024-05-16T21:33:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e837fe640 1 -- 172.21.15.5:0/3477243198 learned_addr learned my addr 172.21.15.5:0/3477243198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e82ffd640 1 --2- 172.21.15.5:0/3477243198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8406e650 0x7f2e84148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e837fe640 1 -- 172.21.15.5:0/3477243198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8406e650 msgr2=0x7f2e84148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e837fe640 1 --2- 172.21.15.5:0/3477243198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8406e650 0x7f2e84148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e837fe640 1 -- 172.21.15.5:0/3477243198 >> v1:172.21.15.157:6789/0 conn(0x7f2e840bc450 legacy=0x7f2e840707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e837fe640 1 -- 172.21.15.5:0/3477243198 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8406f0d0 con 0x7f2e8414e570 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.495+0000 7f2e82ffd640 1 --2- 172.21.15.5:0/3477243198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8406e650 0x7f2e84148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.496+0000 7f2e837fe640 1 --2- 172.21.15.5:0/3477243198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8414e570 0x7f2e8414e980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009e50 tx=0x7f2e7c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c1d0f239f2e2e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.496+0000 7f2e827fc640 1 -- 172.21.15.5:0/3477243198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c036070 con 0x7f2e8414e570 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.496+0000 7f2e827fc640 1 -- 172.21.15.5:0/3477243198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c031600 con 0x7f2e8414e570 2024-05-16T21:33:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.496+0000 7f2e827fc640 1 -- 172.21.15.5:0/3477243198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0319d0 con 0x7f2e8414e570 2024-05-16T21:33:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.497+0000 7f2e895ff640 1 -- 172.21.15.5:0/3477243198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8414e570 msgr2=0x7f2e8414e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.497+0000 7f2e895ff640 1 --2- 172.21.15.5:0/3477243198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8414e570 0x7f2e8414e980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009e50 tx=0x7f2e7c02a710 comp rx=0 tx=0).stop 2024-05-16T21:33:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.497+0000 7f2e895ff640 1 -- 172.21.15.5:0/3477243198 shutdown_connections 2024-05-16T21:33:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.497+0000 7f2e895ff640 1 --2- 172.21.15.5:0/3477243198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8414e570 0x7f2e8414e980 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.497+0000 7f2e895ff640 1 --2- 172.21.15.5:0/3477243198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8406e650 0x7f2e84148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.497+0000 7f2e895ff640 1 -- 172.21.15.5:0/3477243198 >> 172.21.15.5:0/3477243198 conn(0x7f2e840c1590 msgr2=0x7f2e840c19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.497+0000 7f2e895ff640 1 -- 172.21.15.5:0/3477243198 shutdown_connections 2024-05-16T21:33:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.497+0000 7f2e895ff640 1 -- 172.21.15.5:0/3477243198 wait complete. 2024-05-16T21:33:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.499+0000 7f2e895ff640 1 Processor -- start 2024-05-16T21:33:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.499+0000 7f2e895ff640 1 -- start start 2024-05-16T21:33:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e895ff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e840bc450 0x7f2e8413d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e895ff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8414e570 0x7f2e840c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e895ff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8413c9a0 0x7f2e84137250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e895ff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8406f720 con 0x7f2e8413c9a0 2024-05-16T21:33:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e895ff640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2e840bc860 con 0x7f2e840bc450 2024-05-16T21:33:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e895ff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2e84158a20 con 0x7f2e8414e570 2024-05-16T21:33:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8413c9a0 0x7f2e84137250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8413c9a0 0x7f2e84137250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40972/0 (socket says 172.21.15.5:40972) 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 -- 172.21.15.5:0/4193727252 learned_addr learned my addr 172.21.15.5:0/4193727252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e82ffd640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e840bc450 0x7f2e8413d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e7bfff640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8414e570 0x7f2e840c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 -- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8414e570 msgr2=0x7f2e840c05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8414e570 0x7f2e840c05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 -- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e840bc450 msgr2=0x7f2e8413d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e840bc450 0x7f2e8413d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 -- 172.21.15.5:0/4193727252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e840c0b00 con 0x7f2e8413c9a0 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e82ffd640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e840bc450 0x7f2e8413d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e7bfff640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8414e570 0x7f2e840c05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e837fe640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8413c9a0 0x7f2e84137250 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009f70 tx=0x7f2e7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/4193727252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c036050 con 0x7f2e8413c9a0 2024-05-16T21:33:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/4193727252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c042070 con 0x7f2e8413c9a0 2024-05-16T21:33:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e840a1320 con 0x7f2e8413c9a0 2024-05-16T21:33:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/4193727252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c009510 con 0x7f2e8413c9a0 2024-05-16T21:33:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.500+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e841473e0 con 0x7f2e8413c9a0 2024-05-16T21:33:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.501+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e840a14f0 con 0x7f2e8413c9a0 2024-05-16T21:33:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.502+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/4193727252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e7c007bd0 con 0x7f2e8413c9a0 2024-05-16T21:33:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.502+0000 7f2e7b7fe640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2e640762d0 0x7f2e640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.503+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/4193727252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7f2e7c0b8530 con 0x7f2e8413c9a0 2024-05-16T21:33:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.503+0000 7f2e82ffd640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2e640762d0 0x7f2e640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.503+0000 7f2e82ffd640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2e640762d0 0x7f2e640787e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e74006fd0 tx=0x7f2e74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.507+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/4193727252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e7c081e30 con 0x7f2e8413c9a0 2024-05-16T21:33:55.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.703+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e8406f510 con 0x7f2e8413c9a0 2024-05-16T21:33:55.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.705+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/4193727252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+16692 (secure 0 0 0) 0x7f2e8406f510 con 0x7f2e8413c9a0 2024-05-16T21:33:55.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T21:33:55.707 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:33:46.105764+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T21:33:29.941238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T21:33:31.208339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1584346239":"2024-05-17T21:33:46.105734+0000","172.21.15.5:6834/1584346239":"2024-05-17T21:33:46.105734+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T21:33:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2e640762d0 msgr2=0x7f2e640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2e640762d0 0x7f2e640787e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e74006fd0 tx=0x7f2e74008040 comp rx=0 tx=0).stop 2024-05-16T21:33:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8413c9a0 msgr2=0x7f2e84137250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8413c9a0 0x7f2e84137250 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009f70 tx=0x7f2e7c004a40 comp rx=0 tx=0).stop 2024-05-16T21:33:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 shutdown_connections 2024-05-16T21:33:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2e640762d0 0x7f2e640787e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e8413c9a0 0x7f2e84137250 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e8414e570 0x7f2e840c05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 --2- 172.21.15.5:0/4193727252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e840bc450 0x7f2e8413d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 >> 172.21.15.5:0/4193727252 conn(0x7f2e840c1590 msgr2=0x7f2e84144a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 shutdown_connections 2024-05-16T21:33:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.707+0000 7f2e895ff640 1 -- 172.21.15.5:0/4193727252 wait complete. 2024-05-16T21:33:55.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-16T21:33:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.831+0000 7ff71639d640 1 Processor -- start 2024-05-16T21:33:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.831+0000 7ff71639d640 1 -- start start 2024-05-16T21:33:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff71639d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 0x7ff710144de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff71639d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff71014e340 0x7ff710073580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff71639d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff710073ac0 0x7ff71014afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff71639d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff71014f200 con 0x7ff710073ac0 2024-05-16T21:33:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff71639d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff710074c60 con 0x7ff71014e340 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff71639d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff71014e8d0 con 0x7ff7100a1c40 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff715b9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff710073ac0 0x7ff71014afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff715b9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff710073ac0 0x7ff71014afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40984/0 (socket says 172.21.15.5:40984) 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff715b9c640 1 -- 172.21.15.5:0/2377592520 learned_addr learned my addr 172.21.15.5:0/2377592520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff714b9a640 1 --2- 172.21.15.5:0/2377592520 >> v2:172.21.15.157:3300/0 conn(0x7ff71014e340 0x7ff710073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff715b9c640 1 -- 172.21.15.5:0/2377592520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 msgr2=0x7ff710144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff715b9c640 1 --2- 172.21.15.5:0/2377592520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 0x7ff710144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff715b9c640 1 -- 172.21.15.5:0/2377592520 >> v2:172.21.15.157:3300/0 conn(0x7ff71014e340 msgr2=0x7ff710073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff715b9c640 1 --2- 172.21.15.5:0/2377592520 >> v2:172.21.15.157:3300/0 conn(0x7ff71014e340 0x7ff710073580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.832+0000 7ff715b9c640 1 -- 172.21.15.5:0/2377592520 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71014ebb0 con 0x7ff710073ac0 2024-05-16T21:33:55.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.833+0000 7ff715b9c640 1 --2- 172.21.15.5:0/2377592520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710073ac0 0x7ff71014afe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff710070ef0 tx=0x7ff70802c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35c60af9e318cfe server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.833+0000 7ff707fff640 1 -- 172.21.15.5:0/2377592520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708039070 con 0x7ff710073ac0 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.833+0000 7ff707fff640 1 -- 172.21.15.5:0/2377592520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff708009600 con 0x7ff710073ac0 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.833+0000 7ff707fff640 1 -- 172.21.15.5:0/2377592520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7080099f0 con 0x7ff710073ac0 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 -- 172.21.15.5:0/2377592520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710073ac0 msgr2=0x7ff71014afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 --2- 172.21.15.5:0/2377592520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710073ac0 0x7ff71014afe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff710070ef0 tx=0x7ff70802c810 comp rx=0 tx=0).stop 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 -- 172.21.15.5:0/2377592520 shutdown_connections 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 --2- 172.21.15.5:0/2377592520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710073ac0 0x7ff71014afe0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 --2- 172.21.15.5:0/2377592520 >> v2:172.21.15.157:3300/0 conn(0x7ff71014e340 0x7ff710073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 --2- 172.21.15.5:0/2377592520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 0x7ff710144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 -- 172.21.15.5:0/2377592520 >> 172.21.15.5:0/2377592520 conn(0x7ff7100bcfc0 msgr2=0x7ff7100bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 -- 172.21.15.5:0/2377592520 shutdown_connections 2024-05-16T21:33:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.834+0000 7ff71639d640 1 -- 172.21.15.5:0/2377592520 wait complete. 2024-05-16T21:33:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.835+0000 7ff71639d640 1 Processor -- start 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.835+0000 7ff71639d640 1 -- start start 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.836+0000 7ff71639d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff710073ac0 0x7ff7101e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.836+0000 7ff71639d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 0x7ff7100a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.836+0000 7ff71639d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71014e340 0x7ff7100b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.836+0000 7ff71639d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff71014b6a0 con 0x7ff71014e340 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.836+0000 7ff71639d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff71014b520 con 0x7ff710073ac0 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.836+0000 7ff71639d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff71014b820 con 0x7ff7100a1c40 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71014e340 0x7ff7100b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71014e340 0x7ff7100b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40994/0 (socket says 172.21.15.5:40994) 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 -- 172.21.15.5:0/3938192380 learned_addr learned my addr 172.21.15.5:0/3938192380 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff71539b640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff710073ac0 0x7ff7101e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff714b9a640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 0x7ff7100a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 -- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 msgr2=0x7ff7100a6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 0x7ff7100a6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 -- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff710073ac0 msgr2=0x7ff7101e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff710073ac0 0x7ff7101e44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 -- 172.21.15.5:0/3938192380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7100a6590 con 0x7ff71014e340 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff715b9c640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71014e340 0x7ff7100b8b40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff70800d240 tx=0x7ff708004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff705ffb640 1 -- 172.21.15.5:0/3938192380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708039050 con 0x7ff71014e340 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff705ffb640 1 -- 172.21.15.5:0/3938192380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff708045070 con 0x7ff71014e340 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7101e3a10 con 0x7ff71014e340 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.837+0000 7ff705ffb640 1 -- 172.21.15.5:0/3938192380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70800b720 con 0x7ff71014e340 2024-05-16T21:33:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.838+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7100a5970 con 0x7ff71014e340 2024-05-16T21:33:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.838+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff710050860 con 0x7ff71014e340 2024-05-16T21:33:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.839+0000 7ff705ffb640 1 -- 172.21.15.5:0/3938192380 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff708004260 con 0x7ff71014e340 2024-05-16T21:33:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.840+0000 7ff705ffb640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff6f40762d0 0x7ff6f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.840+0000 7ff705ffb640 1 -- 172.21.15.5:0/3938192380 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5795+0+0 (secure 0 0 0) 0x7ff7080ba690 con 0x7ff71014e340 2024-05-16T21:33:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.840+0000 7ff71539b640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff6f40762d0 0x7ff6f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.840+0000 7ff71539b640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff6f40762d0 0x7ff6f40787e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff71006f440 tx=0x7ff70c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:55.844+0000 7ff705ffb640 1 -- 172.21.15.5:0/3938192380 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff708083810 con 0x7ff71014e340 2024-05-16T21:33:56.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.075+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff710070bf0 con 0x7ff71014e340 2024-05-16T21:33:56.077 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-05-16T21:33:56.076+0000 7fcd599bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-16T21:33:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.077+0000 7ff705ffb640 1 -- 172.21.15.5:0/3938192380 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7ff708087b10 con 0x7ff71014e340 2024-05-16T21:33:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-16T21:33:56.082 INFO:tasks.ceph.mds.c.smithi005.stderr: -2234> 2024-05-16T21:33:49.125+0000 7faeb1d2c640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-05-16T21:33:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff6f40762d0 msgr2=0x7ff6f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff6f40762d0 0x7ff6f40787e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff71006f440 tx=0x7ff70c009060 comp rx=0 tx=0).stop 2024-05-16T21:33:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71014e340 msgr2=0x7ff7100b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71014e340 0x7ff7100b8b40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff70800d240 tx=0x7ff708004a40 comp rx=0 tx=0).stop 2024-05-16T21:33:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 shutdown_connections 2024-05-16T21:33:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7ff6f40762d0 0x7ff6f40787e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71014e340 0x7ff7100b8b40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7100a1c40 0x7ff7100a6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 --2- 172.21.15.5:0/3938192380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff710073ac0 0x7ff7101e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 >> 172.21.15.5:0/3938192380 conn(0x7ff7100bcfc0 msgr2=0x7ff7100bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 shutdown_connections 2024-05-16T21:33:56.084 INFO:tasks.ceph.mds.c.smithi005.stderr: -2162> 2024-05-16T21:33:49.125+0000 7faeb1d2c640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000003 2024-05-16T21:33:56.084 INFO:tasks.ceph.mds.c.smithi005.stderr: -2124> 2024-05-16T21:33:49.126+0000 7faeb1d2c640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000002 2024-05-16T21:33:56.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.081+0000 7ff71639d640 1 -- 172.21.15.5:0/3938192380 wait complete. 2024-05-16T21:33:56.085 INFO:tasks.ceph.mds.c.smithi005.stderr: -815> 2024-05-16T21:33:52.122+0000 7faeb5d34640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T21:33:56.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-16T21:33:56.139 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-05-16T21:33:56.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.209+0000 7f2b26fee640 1 Processor -- start 2024-05-16T21:33:56.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.209+0000 7f2b26fee640 1 -- start start 2024-05-16T21:33:56.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b26fee640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bd6d0 0x7f2b200be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b26fee640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b200bee80 0x7f2b20158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b26fee640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2006e140 con 0x7f2b20151fc0 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b26fee640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2b200c36f0 con 0x7f2b200bee80 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b26fee640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2b20152530 con 0x7f2b200bd6d0 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b2558b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b200bee80 0x7f2b20158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b24d8a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b20151fc0 0x7f2b2006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41502/0 (socket says 172.21.15.5:41502) 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b24d8a640 1 -- 172.21.15.5:0/1218799259 learned_addr learned my addr 172.21.15.5:0/1218799259 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b1ffff640 1 --2- 172.21.15.5:0/1218799259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bd6d0 0x7f2b200be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b2558b640 1 -- 172.21.15.5:0/1218799259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bd6d0 msgr2=0x7f2b200be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b2558b640 1 --2- 172.21.15.5:0/1218799259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bd6d0 0x7f2b200be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b2558b640 1 -- 172.21.15.5:0/1218799259 >> v1:172.21.15.5:6789/0 conn(0x7f2b20151fc0 legacy=0x7f2b2006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b2558b640 1 -- 172.21.15.5:0/1218799259 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b20152810 con 0x7f2b200bee80 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.211+0000 7f2b1f7fe640 1 -- 172.21.15.5:0/1218799259 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135561654 0 0) 0x7f2b10001110 con 0x7f2b20151fc0 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.212+0000 7f2b2558b640 1 --2- 172.21.15.5:0/1218799259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b200bee80 0x7f2b20158e90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009d90 tx=0x7f2b1802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedb8de28514fd95 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.212+0000 7f2b1f7fe640 1 -- 172.21.15.5:0/1218799259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18007740 con 0x7f2b200bee80 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.212+0000 7f2b1f7fe640 1 -- 172.21.15.5:0/1218799259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b180078e0 con 0x7f2b200bee80 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.212+0000 7f2b1f7fe640 1 -- 172.21.15.5:0/1218799259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18007cb0 con 0x7f2b200bee80 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.213+0000 7f2b26fee640 1 -- 172.21.15.5:0/1218799259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b200bee80 msgr2=0x7f2b20158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.213+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1218799259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b200bee80 0x7f2b20158e90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009d90 tx=0x7f2b1802a660 comp rx=0 tx=0).stop 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.213+0000 7f2b26fee640 1 -- 172.21.15.5:0/1218799259 shutdown_connections 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.213+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1218799259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b200bee80 0x7f2b20158e90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.213+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1218799259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bd6d0 0x7f2b200be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.213+0000 7f2b26fee640 1 -- 172.21.15.5:0/1218799259 >> 172.21.15.5:0/1218799259 conn(0x7f2b200c3d20 msgr2=0x7f2b200c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.213+0000 7f2b26fee640 1 -- 172.21.15.5:0/1218799259 shutdown_connections 2024-05-16T21:33:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.213+0000 7f2b26fee640 1 -- 172.21.15.5:0/1218799259 wait complete. 2024-05-16T21:33:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.214+0000 7f2b26fee640 1 Processor -- start 2024-05-16T21:33:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.214+0000 7f2b26fee640 1 -- start start 2024-05-16T21:33:56.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.215+0000 7f2b26fee640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b200bd6d0 0x7f2b201e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.215+0000 7f2b26fee640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bee80 0x7f2b200a2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.215+0000 7f2b26fee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b20151fc0 0x7f2b2014b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b26fee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200bdae0 con 0x7f2b20151fc0 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b26fee640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200c0070 con 0x7f2b200bd6d0 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b26fee640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2b200a2ed0 con 0x7f2b200bee80 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b20151fc0 0x7f2b2014b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b20151fc0 0x7f2b2014b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41024/0 (socket says 172.21.15.5:41024) 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 -- 172.21.15.5:0/1022426008 learned_addr learned my addr 172.21.15.5:0/1022426008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b24d8a640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b200bd6d0 0x7f2b201e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b1ffff640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bee80 0x7f2b200a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 -- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bee80 msgr2=0x7f2b200a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bee80 0x7f2b200a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 -- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b200bd6d0 msgr2=0x7f2b201e4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b200bd6d0 0x7f2b201e4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 -- 172.21.15.5:0/1022426008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b201e5080 con 0x7f2b20151fc0 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b2558b640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b20151fc0 0x7f2b2014b510 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009eb0 tx=0x7f2b18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b1d7fa640 1 -- 172.21.15.5:0/1022426008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1803f070 con 0x7f2b20151fc0 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b1d7fa640 1 -- 172.21.15.5:0/1022426008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b18031bc0 con 0x7f2b20151fc0 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2014dee0 con 0x7f2b20151fc0 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b1d7fa640 1 -- 172.21.15.5:0/1022426008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18009450 con 0x7f2b20151fc0 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.216+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b200ba180 con 0x7f2b20151fc0 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.217+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b20050940 con 0x7f2b20151fc0 2024-05-16T21:33:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.218+0000 7f2b1d7fa640 1 -- 172.21.15.5:0/1022426008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b18044460 con 0x7f2b20151fc0 2024-05-16T21:33:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.218+0000 7f2b1d7fa640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b0c0762d0 0x7f2b0c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.219+0000 7f2b1d7fa640 1 -- 172.21.15.5:0/1022426008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5881+0+0 (secure 0 0 0) 0x7f2b180b8db0 con 0x7f2b20151fc0 2024-05-16T21:33:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.219+0000 7f2b24d8a640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b0c0762d0 0x7f2b0c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.219+0000 7f2b24d8a640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b0c0762d0 0x7f2b0c0787e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b10007fd0 tx=0x7f2b10007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.223+0000 7f2b1d7fa640 1 -- 172.21.15.5:0/1022426008 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2b18081f80 con 0x7f2b20151fc0 2024-05-16T21:33:56.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:33:56.289 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:33:56.291 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:33:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:56.455+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2b2006eb40 con 0x7f2b20151fc0 2024-05-16T21:33:57.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.078+0000 7f2b1d7fa640 1 -- 172.21.15.5:0/1022426008 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f2b18086280 con 0x7f2b20151fc0 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b0c0762d0 msgr2=0x7f2b0c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b0c0762d0 0x7f2b0c0787e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b10007fd0 tx=0x7f2b10007de0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b20151fc0 msgr2=0x7f2b2014b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b20151fc0 0x7f2b2014b510 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009eb0 tx=0x7f2b18004a40 comp rx=0 tx=0).stop 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 shutdown_connections 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f2b0c0762d0 0x7f2b0c0787e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b20151fc0 0x7f2b2014b510 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b200bee80 0x7f2b200a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 --2- 172.21.15.5:0/1022426008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b200bd6d0 0x7f2b201e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 >> 172.21.15.5:0/1022426008 conn(0x7f2b200c3d20 msgr2=0x7f2b200c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 shutdown_connections 2024-05-16T21:33:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.082+0000 7f2b26fee640 1 -- 172.21.15.5:0/1022426008 wait complete. 2024-05-16T21:33:57.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-16T21:33:57.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.218+0000 7f4a352d9640 1 Processor -- start 2024-05-16T21:33:57.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.218+0000 7f4a352d9640 1 -- start start 2024-05-16T21:33:57.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a352d9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a300bf050 0x7f4a30159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a352d9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3006e140 con 0x7f4a30151fc0 2024-05-16T21:33:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a352d9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a300c36f0 con 0x7f4a300bd6d0 2024-05-16T21:33:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a352d9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4a30152530 con 0x7f4a300bf050 2024-05-16T21:33:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a2f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a300bf050 0x7f4a30159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a2effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4a30151fc0 0x7f4a3006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59056/0 (socket says 172.21.15.5:59056) 2024-05-16T21:33:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a2effd640 1 -- 172.21.15.5:0/2273777540 learned_addr learned my addr 172.21.15.5:0/2273777540 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a2f7fe640 1 -- 172.21.15.5:0/2273777540 >> v1:172.21.15.157:6789/0 conn(0x7f4a300bd6d0 legacy=0x7f4a300be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a2f7fe640 1 -- 172.21.15.5:0/2273777540 >> v1:172.21.15.5:6789/0 conn(0x7f4a30151fc0 legacy=0x7f4a3006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a2e7fc640 1 -- 172.21.15.5:0/2273777540 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951122912 0 0) 0x7f4a20001110 con 0x7f4a30151fc0 2024-05-16T21:33:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.219+0000 7f4a2f7fe640 1 -- 172.21.15.5:0/2273777540 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a30152810 con 0x7f4a300bf050 2024-05-16T21:33:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.220+0000 7f4a2f7fe640 1 --2- 172.21.15.5:0/2273777540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a30159ea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009d90 tx=0x7f4a2802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a9fcce01812467 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.220+0000 7f4a2e7fc640 1 -- 172.21.15.5:0/2273777540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28007740 con 0x7f4a300bf050 2024-05-16T21:33:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.220+0000 7f4a2e7fc640 1 -- 172.21.15.5:0/2273777540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a280078e0 con 0x7f4a300bf050 2024-05-16T21:33:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.220+0000 7f4a2e7fc640 1 -- 172.21.15.5:0/2273777540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28007cb0 con 0x7f4a300bf050 2024-05-16T21:33:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.221+0000 7f4a352d9640 1 -- 172.21.15.5:0/2273777540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 msgr2=0x7f4a30159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.221+0000 7f4a352d9640 1 --2- 172.21.15.5:0/2273777540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a30159ea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009d90 tx=0x7f4a2802a6f0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.221+0000 7f4a352d9640 1 -- 172.21.15.5:0/2273777540 shutdown_connections 2024-05-16T21:33:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.221+0000 7f4a352d9640 1 --2- 172.21.15.5:0/2273777540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a30159ea0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.221+0000 7f4a352d9640 1 -- 172.21.15.5:0/2273777540 >> 172.21.15.5:0/2273777540 conn(0x7f4a300c3d20 msgr2=0x7f4a300c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.221+0000 7f4a352d9640 1 -- 172.21.15.5:0/2273777540 shutdown_connections 2024-05-16T21:33:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.221+0000 7f4a352d9640 1 -- 172.21.15.5:0/2273777540 wait complete. 2024-05-16T21:33:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.223+0000 7f4a352d9640 1 Processor -- start 2024-05-16T21:33:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.223+0000 7f4a352d9640 1 -- start start 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a352d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a300bd6d0 0x7f4a300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a352d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a300b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a352d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a30151fc0 0x7f4a300b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a352d9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300a2ed0 con 0x7f4a300bf050 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a352d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300bdae0 con 0x7f4a300bd6d0 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a352d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4a300a3050 con 0x7f4a30151fc0 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a27fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a300b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a300bd6d0 0x7f4a300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a27fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a300b7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34864/0 (socket says 172.21.15.5:34864) 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a27fff640 1 -- 172.21.15.5:0/3627333458 learned_addr learned my addr 172.21.15.5:0/3627333458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a2f7fe640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a30151fc0 0x7f4a300b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a27fff640 1 -- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a30151fc0 msgr2=0x7f4a300b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a27fff640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a30151fc0 0x7f4a300b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a27fff640 1 -- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a300bd6d0 msgr2=0x7f4a300b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a27fff640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a300bd6d0 0x7f4a300b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a27fff640 1 -- 172.21.15.5:0/3627333458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a300b8fe0 con 0x7f4a300bf050 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.224+0000 7f4a2effd640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a300bd6d0 0x7f4a300b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.225+0000 7f4a27fff640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a300b7710 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c3a0 tx=0x7f4a1800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.225+0000 7f4a277fe640 1 -- 172.21.15.5:0/3627333458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18017070 con 0x7f4a300bf050 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.225+0000 7f4a277fe640 1 -- 172.21.15.5:0/3627333458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a180052d0 con 0x7f4a300bf050 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.225+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a300b7c50 con 0x7f4a300bf050 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.225+0000 7f4a277fe640 1 -- 172.21.15.5:0/3627333458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a180037f0 con 0x7f4a300bf050 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.225+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a301e4b90 con 0x7f4a300bf050 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.226+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3014eda0 con 0x7f4a300bf050 2024-05-16T21:33:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.227+0000 7f4a277fe640 1 -- 172.21.15.5:0/3627333458 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4a1801a070 con 0x7f4a300bf050 2024-05-16T21:33:57.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.227+0000 7f4a277fe640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4a100762d0 0x7f4a100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:57.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.227+0000 7f4a277fe640 1 -- 172.21.15.5:0/3627333458 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5881+0+0 (secure 0 0 0) 0x7f4a180969b0 con 0x7f4a300bf050 2024-05-16T21:33:57.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.227+0000 7f4a2effd640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4a100762d0 0x7f4a100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:57.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.228+0000 7f4a2effd640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4a100762d0 0x7f4a100787e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a20000f60 tx=0x7f4a20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:57.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.232+0000 7f4a277fe640 1 -- 172.21.15.5:0/3627333458 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4a1805fb80 con 0x7f4a300bf050 2024-05-16T21:33:57.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:57.423+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4a30050940 con 0x7f4a300bf050 2024-05-16T21:33:58.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.155+0000 7f4a277fe640 1 -- 172.21.15.5:0/3627333458 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) ==== 181+0+0 (secure 0 0 0) 0x7f4a18068250 con 0x7f4a300bf050 2024-05-16T21:33:58.157 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-05-16T21:33:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4a100762d0 msgr2=0x7f4a100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4a100762d0 0x7f4a100787e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a20000f60 tx=0x7f4a20009040 comp rx=0 tx=0).stop 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 msgr2=0x7f4a300b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a300b7710 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c3a0 tx=0x7f4a1800c860 comp rx=0 tx=0).stop 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 shutdown_connections 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4a100762d0 0x7f4a100787e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a30151fc0 0x7f4a300b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a300bf050 0x7f4a300b7710 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 --2- 172.21.15.5:0/3627333458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a300bd6d0 0x7f4a300b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.159+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 >> 172.21.15.5:0/3627333458 conn(0x7f4a300c3d20 msgr2=0x7f4a300be940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.160+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 shutdown_connections 2024-05-16T21:33:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.160+0000 7f4a352d9640 1 -- 172.21.15.5:0/3627333458 wait complete. 2024-05-16T21:33:58.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-16T21:33:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.297+0000 7f5ee3ec6640 1 Processor -- start 2024-05-16T21:33:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.298+0000 7f5ee3ec6640 1 -- start start 2024-05-16T21:33:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee3ec6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc148770 0x7f5edc0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee3ec6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5edc0bf9b0 0x7f5edc0bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee3ec6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5edc0c0620 con 0x7f5edc14e360 2024-05-16T21:33:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee3ec6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5edc151e40 con 0x7f5edc0bf9b0 2024-05-16T21:33:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee3ec6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5edc151ad0 con 0x7f5edc148770 2024-05-16T21:33:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee1c62640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5edc14e360 0x7f5edc1522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59060/0 (socket says 172.21.15.5:59060) 2024-05-16T21:33:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee1c62640 1 -- 172.21.15.5:0/3159766590 learned_addr learned my addr 172.21.15.5:0/3159766590 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee2463640 1 --2- 172.21.15.5:0/3159766590 >> v2:172.21.15.5:3300/0 conn(0x7f5edc0bf9b0 0x7f5edc0bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee1461640 1 --2- 172.21.15.5:0/3159766590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc148770 0x7f5edc0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee0c60640 1 -- 172.21.15.5:0/3159766590 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2251228207 0 0) 0x7f5edc0c0620 con 0x7f5edc14e360 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee0c60640 1 -- 172.21.15.5:0/3159766590 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec4003520 con 0x7f5edc14e360 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee2463640 1 -- 172.21.15.5:0/3159766590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc148770 msgr2=0x7f5edc0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee2463640 1 --2- 172.21.15.5:0/3159766590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc148770 0x7f5edc0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee2463640 1 -- 172.21.15.5:0/3159766590 >> v1:172.21.15.5:6789/0 conn(0x7f5edc14e360 legacy=0x7f5edc1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.299+0000 7f5ee2463640 1 -- 172.21.15.5:0/3159766590 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5edc0c0300 con 0x7f5edc0bf9b0 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.300+0000 7f5ee2463640 1 --2- 172.21.15.5:0/3159766590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc0bf9b0 0x7f5edc0bfdc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40097a0 tx=0x7f5ed402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53fa23594699ec8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.300+0000 7f5ee0c60640 1 -- 172.21.15.5:0/3159766590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4037070 con 0x7f5edc0bf9b0 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.300+0000 7f5ee0c60640 1 -- 172.21.15.5:0/3159766590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed4032440 con 0x7f5edc0bf9b0 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.300+0000 7f5ee0c60640 1 -- 172.21.15.5:0/3159766590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4032810 con 0x7f5edc0bf9b0 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.301+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/3159766590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc0bf9b0 msgr2=0x7f5edc0bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.301+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/3159766590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc0bf9b0 0x7f5edc0bfdc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40097a0 tx=0x7f5ed402a210 comp rx=0 tx=0).stop 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.301+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/3159766590 shutdown_connections 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.301+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/3159766590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc0bf9b0 0x7f5edc0bfdc0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.301+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/3159766590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc148770 0x7f5edc0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.301+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/3159766590 >> 172.21.15.5:0/3159766590 conn(0x7f5edc0c17c0 msgr2=0x7f5edc0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.301+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/3159766590 shutdown_connections 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.301+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/3159766590 wait complete. 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.302+0000 7f5ee3ec6640 1 Processor -- start 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.302+0000 7f5ee3ec6640 1 -- start start 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.303+0000 7f5ee3ec6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc0bf9b0 0x7f5edc142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.303+0000 7f5ee3ec6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc148770 0x7f5edc1e7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.303+0000 7f5ee3ec6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5edc14e360 0x7f5edc13f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.303+0000 7f5ee3ec6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc158cc0 con 0x7f5edc148770 2024-05-16T21:33:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee3ec6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc0c13d0 con 0x7f5edc14e360 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee3ec6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5edc158e40 con 0x7f5edc0bf9b0 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc148770 0x7f5edc1e7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc148770 0x7f5edc1e7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34886/0 (socket says 172.21.15.5:34886) 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 -- 172.21.15.5:0/495612575 learned_addr learned my addr 172.21.15.5:0/495612575 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1c62640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc0bf9b0 0x7f5edc142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee2463640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5edc14e360 0x7f5edc13f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 -- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc0bf9b0 msgr2=0x7f5edc142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc0bf9b0 0x7f5edc142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 -- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5edc14e360 msgr2=0x7f5edc13f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5edc14e360 0x7f5edc13f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 -- 172.21.15.5:0/495612575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5edc143070 con 0x7f5edc148770 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee2463640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5edc14e360 0x7f5edc13f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T21:33:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee1461640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc148770 0x7f5edc1e7970 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000e870 tx=0x7f5ed000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5eda7fc640 1 -- 172.21.15.5:0/495612575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0017070 con 0x7f5edc148770 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5eda7fc640 1 -- 172.21.15.5:0/495612575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed000ee60 con 0x7f5edc148770 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5edc1e7eb0 con 0x7f5edc148770 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5eda7fc640 1 -- 172.21.15.5:0/495612575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000cb00 con 0x7f5edc148770 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.304+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5edc14f8a0 con 0x7f5edc148770 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.305+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5edc140c90 con 0x7f5edc148770 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.306+0000 7f5eda7fc640 1 -- 172.21.15.5:0/495612575 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5ed001a070 con 0x7f5edc148770 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.307+0000 7f5eda7fc640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ec80762d0 0x7f5ec80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.307+0000 7f5eda7fc640 1 -- 172.21.15.5:0/495612575 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5443+0+0 (secure 0 0 0) 0x7f5ed0097300 con 0x7f5edc148770 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.307+0000 7f5ee1c62640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ec80762d0 0x7f5ec80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.307+0000 7f5ee1c62640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ec80762d0 0x7f5ec80787e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc001780 tx=0x7f5ecc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.311+0000 7f5eda7fc640 1 -- 172.21.15.5:0/495612575 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5edc140c90 con 0x7f5edc148770 2024-05-16T21:33:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:58.502+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5edc050940 con 0x7f5edc148770 2024-05-16T21:33:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.157+0000 7f5eda7fc640 1 -- 172.21.15.5:0/495612575 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) ==== 169+0+0 (secure 0 0 0) 0x7f5ed0060d60 con 0x7f5edc148770 2024-05-16T21:33:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-05-16T21:33:59.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.164+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ec80762d0 msgr2=0x7f5ec80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.164+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ec80762d0 0x7f5ec80787e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc001780 tx=0x7f5ecc009040 comp rx=0 tx=0).stop 2024-05-16T21:33:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.164+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc148770 msgr2=0x7f5edc1e7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.164+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc148770 0x7f5edc1e7970 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000e870 tx=0x7f5ed000ed30 comp rx=0 tx=0).stop 2024-05-16T21:33:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.165+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 shutdown_connections 2024-05-16T21:33:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.165+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ec80762d0 0x7f5ec80787e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.165+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5edc14e360 0x7f5edc13f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.165+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc148770 0x7f5edc1e7970 secure :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000e870 tx=0x7f5ed000ed30 comp rx=0 tx=0).stop 2024-05-16T21:33:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.165+0000 7f5ee3ec6640 1 --2- 172.21.15.5:0/495612575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5edc0bf9b0 0x7f5edc142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.165+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 >> 172.21.15.5:0/495612575 conn(0x7f5edc0c17c0 msgr2=0x7f5edc140580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.165+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 shutdown_connections 2024-05-16T21:33:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.165+0000 7f5ee3ec6640 1 -- 172.21.15.5:0/495612575 wait complete. 2024-05-16T21:33:59.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-16T21:33:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.304+0000 7fea3be84640 1 Processor -- start 2024-05-16T21:33:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.304+0000 7fea3be84640 1 -- start start 2024-05-16T21:33:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea3be84640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea34148910 0x7fea3414e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea3be84640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea340ba800 con 0x7fea340a9060 2024-05-16T21:33:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea3be84640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea340b8a30 con 0x7fea3414eba0 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea3be84640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fea340b8d10 con 0x7fea34148910 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea39c20640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea340a9060 0x7fea340ba0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59064/0 (socket says 172.21.15.5:59064) 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea39c20640 1 -- 172.21.15.5:0/3431815118 learned_addr learned my addr 172.21.15.5:0/3431815118 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea3941f640 1 --2- 172.21.15.5:0/3431815118 >> v2:172.21.15.5:3300/0 conn(0x7fea34148910 0x7fea3414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea38c1e640 1 -- 172.21.15.5:0/3431815118 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536350584 0 0) 0x7fea30001110 con 0x7fea340a9060 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea38c1e640 1 -- 172.21.15.5:0/3431815118 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea20003520 con 0x7fea340a9060 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea3941f640 1 -- 172.21.15.5:0/3431815118 >> v1:172.21.15.157:6789/0 conn(0x7fea3414eba0 legacy=0x7fea34158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea3941f640 1 -- 172.21.15.5:0/3431815118 >> v1:172.21.15.5:6789/0 conn(0x7fea340a9060 legacy=0x7fea340ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.305+0000 7fea3941f640 1 -- 172.21.15.5:0/3431815118 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea340b8ff0 con 0x7fea34148910 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.306+0000 7fea3941f640 1 --2- 172.21.15.5:0/3431815118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea34148910 0x7fea3414e660 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fea240097a0 tx=0x7fea2402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7b7f2497c4cab8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.306+0000 7fea38c1e640 1 -- 172.21.15.5:0/3431815118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24037070 con 0x7fea34148910 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.306+0000 7fea38c1e640 1 -- 172.21.15.5:0/3431815118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea24032640 con 0x7fea34148910 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.306+0000 7fea38c1e640 1 -- 172.21.15.5:0/3431815118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24032a10 con 0x7fea34148910 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.307+0000 7fea3be84640 1 -- 172.21.15.5:0/3431815118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea34148910 msgr2=0x7fea3414e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.307+0000 7fea3be84640 1 --2- 172.21.15.5:0/3431815118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea34148910 0x7fea3414e660 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fea240097a0 tx=0x7fea2402a2c0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.307+0000 7fea3be84640 1 -- 172.21.15.5:0/3431815118 shutdown_connections 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.307+0000 7fea3be84640 1 --2- 172.21.15.5:0/3431815118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea34148910 0x7fea3414e660 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.307+0000 7fea3be84640 1 -- 172.21.15.5:0/3431815118 >> 172.21.15.5:0/3431815118 conn(0x7fea340c07c0 msgr2=0x7fea340c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.307+0000 7fea3be84640 1 -- 172.21.15.5:0/3431815118 shutdown_connections 2024-05-16T21:33:59.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.307+0000 7fea3be84640 1 -- 172.21.15.5:0/3431815118 wait complete. 2024-05-16T21:33:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.309+0000 7fea3be84640 1 Processor -- start 2024-05-16T21:33:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.309+0000 7fea3be84640 1 -- start start 2024-05-16T21:33:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3be84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea340a9060 0x7fea341438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3be84640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea34148910 0x7fea340c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3be84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea3414eba0 0x7fea341e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3be84640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea3408d400 con 0x7fea3414eba0 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3be84640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fea3414efb0 con 0x7fea34148910 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3be84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fea3408d580 con 0x7fea340a9060 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea3414eba0 0x7fea341e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea3414eba0 0x7fea341e7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34894/0 (socket says 172.21.15.5:34894) 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 -- 172.21.15.5:0/1847889964 learned_addr learned my addr 172.21.15.5:0/1847889964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3941f640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea34148910 0x7fea340c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea39c20640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea340a9060 0x7fea341438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 -- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea340a9060 msgr2=0x7fea341438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea340a9060 0x7fea341438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 -- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea34148910 msgr2=0x7fea340c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea34148910 0x7fea340c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 -- 172.21.15.5:0/1847889964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea340c3610 con 0x7fea3414eba0 2024-05-16T21:33:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea39c20640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea340a9060 0x7fea341438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T21:33:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.310+0000 7fea3a421640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea3414eba0 0x7fea341e7fc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c700 tx=0x7fea2c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.311+0000 7fea2a7fc640 1 -- 172.21.15.5:0/1847889964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c003b70 con 0x7fea3414eba0 2024-05-16T21:33:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.311+0000 7fea2a7fc640 1 -- 172.21.15.5:0/1847889964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea2c003d10 con 0x7fea3414eba0 2024-05-16T21:33:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.311+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea34149c50 con 0x7fea3414eba0 2024-05-16T21:33:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.311+0000 7fea2a7fc640 1 -- 172.21.15.5:0/1847889964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00aa50 con 0x7fea3414eba0 2024-05-16T21:33:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.311+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea3414b610 con 0x7fea3414eba0 2024-05-16T21:33:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.312+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea34149a60 con 0x7fea3414eba0 2024-05-16T21:33:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.313+0000 7fea2a7fc640 1 -- 172.21.15.5:0/1847889964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea2c00abf0 con 0x7fea3414eba0 2024-05-16T21:33:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.313+0000 7fea2a7fc640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fea18076300 0x7fea18078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.313+0000 7fea2a7fc640 1 -- 172.21.15.5:0/1847889964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fea2c097240 con 0x7fea3414eba0 2024-05-16T21:33:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.313+0000 7fea39c20640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fea18076300 0x7fea18078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.314+0000 7fea39c20640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fea18076300 0x7fea18078810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fea300013f0 tx=0x7fea30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.318+0000 7fea2a7fc640 1 -- 172.21.15.5:0/1847889964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fea2c060db0 con 0x7fea3414eba0 2024-05-16T21:33:59.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.511+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fea340ba9e0 con 0x7fea3414eba0 2024-05-16T21:33:59.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.515+0000 7fea2a7fc640 1 -- 172.21.15.5:0/1847889964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fea2c0606b0 con 0x7fea3414eba0 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.516+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fea18076300 msgr2=0x7fea18078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fea18076300 0x7fea18078810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fea300013f0 tx=0x7fea30009040 comp rx=0 tx=0).stop 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea3414eba0 msgr2=0x7fea341e7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea3414eba0 0x7fea341e7fc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c700 tx=0x7fea2c00cbc0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 shutdown_connections 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fea18076300 0x7fea18078810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea3414eba0 0x7fea341e7fc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea34148910 0x7fea340c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 --2- 172.21.15.5:0/1847889964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea340a9060 0x7fea341438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 >> 172.21.15.5:0/1847889964 conn(0x7fea340c07c0 msgr2=0x7fea34146df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 shutdown_connections 2024-05-16T21:33:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.517+0000 7fea3be84640 1 -- 172.21.15.5:0/1847889964 wait complete. 2024-05-16T21:33:59.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery' 2024-05-16T21:33:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.638+0000 7f08b73dc640 1 Processor -- start 2024-05-16T21:33:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.639+0000 7f08b73dc640 1 -- start start 2024-05-16T21:33:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b73dc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b00bd440 0x7f08b00bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b73dc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f08b00b8d70 0x7f08b00b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b73dc640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b00bdd90 con 0x7f08b014e530 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b73dc640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f08b00b88e0 con 0x7f08b00b8d70 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b73dc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08b014ece0 con 0x7f08b00bd440 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b4977640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b00bd440 0x7f08b00bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b4977640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b00bd440 0x7f08b00bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:58324/0 (socket says 172.21.15.5:58324) 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b5979640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f08b00b8d70 0x7f08b00b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b5178640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f08b014e530 0x7f08b00ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:56578/0 (socket says 172.21.15.5:56578) 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08b4977640 1 -- 172.21.15.5:0/1050087609 learned_addr learned my addr 172.21.15.5:0/1050087609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.640+0000 7f08affff640 1 -- 172.21.15.5:0/1050087609 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837289995 0 0) 0x7f08b00bdd90 con 0x7f08b014e530 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.641+0000 7f08b4977640 1 -- 172.21.15.5:0/1050087609 >> v2:172.21.15.157:3300/0 conn(0x7f08b00b8d70 msgr2=0x7f08b00b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.641+0000 7f08b4977640 1 --2- 172.21.15.5:0/1050087609 >> v2:172.21.15.157:3300/0 conn(0x7f08b00b8d70 0x7f08b00b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.641+0000 7f08b4977640 1 -- 172.21.15.5:0/1050087609 >> v1:172.21.15.157:6789/0 conn(0x7f08b014e530 legacy=0x7f08b00ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.641+0000 7f08b4977640 1 -- 172.21.15.5:0/1050087609 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b014efc0 con 0x7f08b00bd440 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.641+0000 7f08b4977640 1 --2- 172.21.15.5:0/1050087609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b00bd440 0x7f08b00bd850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009870 tx=0x7f08a402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a61f636814f3aba7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.641+0000 7f08affff640 1 -- 172.21.15.5:0/1050087609 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4037070 con 0x7f08b00bd440 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08affff640 1 -- 172.21.15.5:0/1050087609 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a4032440 con 0x7f08b00bd440 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08affff640 1 -- 172.21.15.5:0/1050087609 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4032810 con 0x7f08b00bd440 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08b73dc640 1 -- 172.21.15.5:0/1050087609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b00bd440 msgr2=0x7f08b00bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08b73dc640 1 --2- 172.21.15.5:0/1050087609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b00bd440 0x7f08b00bd850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009870 tx=0x7f08a402a270 comp rx=0 tx=0).stop 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08b73dc640 1 -- 172.21.15.5:0/1050087609 shutdown_connections 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08b73dc640 1 --2- 172.21.15.5:0/1050087609 >> v2:172.21.15.157:3300/0 conn(0x7f08b00b8d70 0x7f08b00b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08b73dc640 1 --2- 172.21.15.5:0/1050087609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b00bd440 0x7f08b00bd850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08b73dc640 1 -- 172.21.15.5:0/1050087609 >> 172.21.15.5:0/1050087609 conn(0x7f08b00c0570 msgr2=0x7f08b00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08b73dc640 1 -- 172.21.15.5:0/1050087609 shutdown_connections 2024-05-16T21:33:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.642+0000 7f08b73dc640 1 -- 172.21.15.5:0/1050087609 wait complete. 2024-05-16T21:33:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.644+0000 7f08b73dc640 1 Processor -- start 2024-05-16T21:33:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.644+0000 7f08b73dc640 1 -- start start 2024-05-16T21:33:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b73dc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08b00b8d70 0x7f08b01e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b73dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b00bd440 0x7f08b013f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b73dc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b014e530 0x7f08b013db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b73dc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08b00b96c0 con 0x7f08b00bd440 2024-05-16T21:33:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b73dc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08b00bbb70 con 0x7f08b00b8d70 2024-05-16T21:33:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b73dc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08b014e940 con 0x7f08b014e530 2024-05-16T21:33:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b4977640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b00bd440 0x7f08b013f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b4977640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b00bd440 0x7f08b013f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34904/0 (socket says 172.21.15.5:34904) 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b4977640 1 -- 172.21.15.5:0/3859838247 learned_addr learned my addr 172.21.15.5:0/3859838247 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b5979640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b014e530 0x7f08b013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b5178640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08b00b8d70 0x7f08b01e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b4977640 1 -- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b014e530 msgr2=0x7f08b013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b4977640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b014e530 0x7f08b013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b4977640 1 -- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08b00b8d70 msgr2=0x7f08b01e4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b4977640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08b00b8d70 0x7f08b01e4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.645+0000 7f08b4977640 1 -- 172.21.15.5:0/3859838247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b01e4840 con 0x7f08b00bd440 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.646+0000 7f08b4977640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b00bd440 0x7f08b013f4c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009870 tx=0x7f08a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.646+0000 7f08adffb640 1 -- 172.21.15.5:0/3859838247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4041020 con 0x7f08b00bd440 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.646+0000 7f08adffb640 1 -- 172.21.15.5:0/3859838247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a4030640 con 0x7f08b00bd440 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.646+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b0152760 con 0x7f08b00bd440 2024-05-16T21:33:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.646+0000 7f08adffb640 1 -- 172.21.15.5:0/3859838247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4037040 con 0x7f08b00bd440 2024-05-16T21:33:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.646+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b0141360 con 0x7f08b00bd440 2024-05-16T21:33:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.647+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b0068d10 con 0x7f08b00bd440 2024-05-16T21:33:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.648+0000 7f08adffb640 1 -- 172.21.15.5:0/3859838247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f08a4044020 con 0x7f08b00bd440 2024-05-16T21:33:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.648+0000 7f08adffb640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f089c0762d0 0x7f089c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T21:33:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.649+0000 7f08adffb640 1 -- 172.21.15.5:0/3859838247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f08a40b7820 con 0x7f08b00bd440 2024-05-16T21:33:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.649+0000 7f08b5178640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f089c0762d0 0x7f089c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T21:33:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.649+0000 7f08b5178640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f089c0762d0 0x7f089c0787e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f08a8000fb0 tx=0x7f08a8007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T21:33:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.653+0000 7f08adffb640 1 -- 172.21.15.5:0/3859838247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f08b0068d10 con 0x7f08b00bd440 2024-05-16T21:33:59.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:33:59.920+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery"]} v 0) -- 0x7f08b0050940 con 0x7f08b00bd440 2024-05-16T21:34:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.169+0000 7f08adffb640 1 -- 172.21.15.5:0/3859838247 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery"]}]=0 v109) ==== 154+0+0 (secure 0 0 0) 0x7f08a404b070 con 0x7f08b00bd440 2024-05-16T21:34:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f089c0762d0 msgr2=0x7f089c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f089c0762d0 0x7f089c0787e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f08a8000fb0 tx=0x7f08a8007d70 comp rx=0 tx=0).stop 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b00bd440 msgr2=0x7f08b013f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b00bd440 0x7f08b013f4c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009870 tx=0x7f08a40046c0 comp rx=0 tx=0).stop 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 shutdown_connections 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f089c0762d0 0x7f089c0787e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08b014e530 0x7f08b013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b00bd440 0x7f08b013f4c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 --2- 172.21.15.5:0/3859838247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08b00b8d70 0x7f08b01e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 >> 172.21.15.5:0/3859838247 conn(0x7f08b00c0570 msgr2=0x7f08b0068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 shutdown_connections 2024-05-16T21:34:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T21:34:00.172+0000 7f08b73dc640 1 -- 172.21.15.5:0/3859838247 wait complete. 2024-05-16T21:34:00.186 INFO:tasks.cephfs_test_runner:That alternate_name can be recovered from the journal. ... FAIL 2024-05-16T21:34:00.186 INFO:tasks.cephfs_test_runner: 2024-05-16T21:34:00.186 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner:That alternate_name can be recovered from the journal. 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa/tasks/cephfs/test_fscrypt.py", line 87, in test_fscrypt_journal_recovery 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner: verify_alternate_name() 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa/tasks/cephfs/test_fscrypt.py", line 65, in verify_alternate_name 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner: self.assertEqual(len(dirfrags), 1) 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner:AssertionError: 0 != 1 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner: 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner:Ran 2 tests in 81.938s 2024-05-16T21:34:00.187 INFO:tasks.cephfs_test_runner: 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner: 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner:That alternate_name can be recovered from the journal. 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa/tasks/cephfs/test_fscrypt.py", line 87, in test_fscrypt_journal_recovery 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner: verify_alternate_name() 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa/tasks/cephfs/test_fscrypt.py", line 65, in verify_alternate_name 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner: self.assertEqual(len(dirfrags), 1) 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner:AssertionError: 0 != 1 2024-05-16T21:34:00.188 INFO:tasks.cephfs_test_runner: 2024-05-16T21:34:00.189 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T21:34:00.425 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=11e7594b5c844b05bf26c186e650a3bc Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_69a8de64df0b2e98d8ada0e9865445fd4329357b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T21:34:00.427 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-16T21:34:00.436 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-16T21:34:00.444 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task sleep... 2024-05-16T21:34:00.445 INFO:teuthology.task.sleep:Sleeping for 3600 seconds 2024-05-16T21:34:26.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:34:26.523 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:34:26.527 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:34:56.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:34:56.662 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:34:56.664 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:35:26.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:35:26.790 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:35:26.793 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:35:56.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:35:56.931 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:35:56.934 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:36:27.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:36:27.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:36:27.104 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:36:57.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:36:57.238 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:36:57.241 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:37:27.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:37:27.376 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:37:27.379 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:37:57.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:37:57.504 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:37:57.507 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:38:27.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:38:27.630 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:38:27.632 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:38:57.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:38:57.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:38:57.821 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:39:27.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:39:27.989 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:39:27.992 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:39:58.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:39:58.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:39:58.128 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:40:28.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:40:28.296 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:40:28.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:40:58.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:40:58.416 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:40:58.419 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:41:28.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:41:28.547 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:41:28.550 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:41:58.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:41:58.703 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:41:58.705 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:42:28.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:42:28.839 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:42:28.842 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:42:58.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:42:58.985 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:42:58.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:43:29.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:43:29.115 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:43:29.117 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:43:59.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:43:59.270 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:43:59.272 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:44:29.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:44:29.404 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:44:29.407 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:44:59.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:44:59.541 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:44:59.544 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:45:29.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:45:29.705 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:45:29.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:45:59.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:45:59.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:45:59.879 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:46:29.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:46:29.998 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:46:30.000 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:47:00.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:47:00.129 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:47:00.131 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:47:30.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:47:30.270 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:47:30.273 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:48:00.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:48:00.472 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:48:00.474 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:48:30.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:48:30.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:48:30.628 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:49:00.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:49:00.764 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:49:00.766 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:49:31.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:49:31.048 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:49:31.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:50:01.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:50:01.195 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:50:01.197 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:50:31.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:50:31.336 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:50:31.339 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:51:01.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:51:01.490 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:51:01.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:51:31.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:51:31.651 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:51:31.654 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:52:01.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:52:01.784 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:52:01.787 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:52:31.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:52:31.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:52:31.924 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:53:02.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:53:02.234 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:53:02.237 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:53:32.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:53:32.363 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:53:32.366 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:54:02.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:54:02.510 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:54:02.513 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:54:32.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:54:32.638 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:54:32.641 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:55:02.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:55:02.803 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:55:02.805 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:55:32.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:55:32.943 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:55:32.946 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:56:03.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:56:03.075 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:56:03.078 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:56:33.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:56:33.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:56:33.209 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:57:03.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:57:03.335 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:57:03.338 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:57:33.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:57:33.480 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:57:33.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:58:03.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:58:03.645 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:58:03.648 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:58:33.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:58:33.774 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:58:33.776 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:59:03.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:59:03.910 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:59:03.914 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:59:34.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:59:34.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T21:59:34.052 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:00:04.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:00:04.180 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:00:04.183 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:00:34.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:00:34.308 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:00:34.311 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:01:04.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:01:04.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:01:04.441 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:01:34.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:01:34.576 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:01:34.579 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:02:04.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:02:04.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:02:04.750 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:02:34.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:02:34.884 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:02:34.887 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:03:05.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:03:05.016 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:03:05.018 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:03:35.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:03:35.146 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:03:35.149 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:04:05.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:04:05.375 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:04:05.377 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:04:35.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:04:35.571 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:04:35.574 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:05:05.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:05:05.768 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:05:05.771 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:05:36.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:05:36.027 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:05:36.030 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:06:06.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:06:06.217 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:06:06.220 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:06:36.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:06:36.431 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:06:36.434 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:07:06.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:07:06.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:07:06.628 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:07:36.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:07:36.806 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:07:36.808 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:08:07.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:08:07.019 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:08:07.021 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:08:37.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:08:37.222 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:08:37.225 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:09:07.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:09:07.426 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:09:07.429 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:09:37.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:09:37.613 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:09:37.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:10:07.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:10:07.801 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:10:07.804 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:10:38.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:10:38.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:10:38.018 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:11:08.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:11:08.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:11:08.228 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:11:38.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:11:38.413 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:11:38.416 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:12:08.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:12:08.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:12:08.604 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:12:38.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:12:38.805 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:12:38.807 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:13:09.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:13:09.029 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:13:09.032 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:13:39.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:13:39.232 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:13:39.234 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:14:09.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:14:09.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:14:09.447 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:14:39.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:14:39.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:14:39.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:15:09.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:15:09.844 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:15:09.847 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:15:40.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:15:40.032 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:15:40.035 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:16:10.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:16:10.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:16:10.239 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:16:40.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:16:40.441 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:16:40.444 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:17:10.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:17:10.644 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:17:10.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:17:40.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:17:40.839 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:17:40.842 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:18:11.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:18:11.019 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:18:11.022 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:18:41.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:18:41.240 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:18:41.243 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:19:11.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:19:11.461 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:19:11.464 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:19:41.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:19:41.665 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:19:41.668 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:20:11.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:20:11.871 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:20:11.873 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:20:42.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:20:42.073 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:20:42.076 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:21:12.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:21:12.294 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:21:12.297 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:21:42.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:21:42.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:21:42.492 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:22:12.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:22:12.685 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:22:12.688 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:22:42.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:22:42.891 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:22:42.893 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:23:13.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:23:13.094 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:23:13.097 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:23:43.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:23:43.322 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:23:43.325 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:24:13.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:24:13.553 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:24:13.555 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:24:43.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:24:43.756 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:24:43.759 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:25:13.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:25:13.977 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:25:13.980 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:25:44.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:25:44.172 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:25:44.175 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:14.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:14.352 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:14.354 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:44.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:44.538 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:44.541 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:14.756 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:14.760 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:14.763 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:44.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:44.980 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:44.983 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:15.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:15.185 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:15.187 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:45.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:45.381 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:45.383 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:15.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:15.600 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:15.603 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:45.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:45.787 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:45.790 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:30:15.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:30:15.992 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:30:15.995 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:30:46.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:30:46.205 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:30:46.208 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:16.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:16.418 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:16.420 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:46.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:46.613 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:46.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:16.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:16.793 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:16.796 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:47.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:47.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:47.024 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:17.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:17.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:17.220 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:47.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:47.430 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:47.432 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:00.446 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-16T22:34:00.457 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-16T22:34:00.457 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-16T22:34:00.457 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:34:00.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052711,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497968k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248980k,nr_inodes=812245,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497968k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-05-16T22:34:00.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:00.516 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-05-16T22:34:00.567 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-16T22:34:00.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:00.569 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-16T22:34:00.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:00.643 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-05-16T22:34:00.770 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-16T22:34:00.779 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T22:34:00.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:34:00.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.906+0000 7fb5d559f640 1 Processor -- start 2024-05-16T22:34:00.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.906+0000 7fb5d559f640 1 -- start start 2024-05-16T22:34:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5d559f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb5d00bae80 0x7fb5d00c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5d559f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0148010 0x7fb5d0148420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5d559f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d00c0ae0 con 0x7fb5d0151930 2024-05-16T22:34:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5d559f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d00bbe40 con 0x7fb5d00bae80 2024-05-16T22:34:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5d559f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d00bd220 con 0x7fb5d0148010 2024-05-16T22:34:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5cf7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0148010 0x7fb5d0148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5cffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb5d00bae80 0x7fb5d00c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5cf7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0148010 0x7fb5d0148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51542/0 (socket says 172.21.15.5:51542) 2024-05-16T22:34:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5cf7fe640 1 -- 172.21.15.5:0/1195110548 learned_addr learned my addr 172.21.15.5:0/1195110548 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.907+0000 7fb5d4d9e640 1 --1- 172.21.15.5:0/1195110548 >> v1:172.21.15.157:6789/0 conn(0x7fb5d0151930 0x7fb5d0151d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:52014/0 (socket says 172.21.15.5:52014) 2024-05-16T22:34:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.908+0000 7fb5cf7fe640 1 -- 172.21.15.5:0/1195110548 >> v2:172.21.15.157:3300/0 conn(0x7fb5d00bae80 msgr2=0x7fb5d00c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.908+0000 7fb5cf7fe640 1 --2- 172.21.15.5:0/1195110548 >> v2:172.21.15.157:3300/0 conn(0x7fb5d00bae80 0x7fb5d00c05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.908+0000 7fb5cf7fe640 1 -- 172.21.15.5:0/1195110548 >> v1:172.21.15.157:6789/0 conn(0x7fb5d0151930 legacy=0x7fb5d0151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.908+0000 7fb5cf7fe640 1 -- 172.21.15.5:0/1195110548 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d00bc090 con 0x7fb5d0148010 2024-05-16T22:34:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.908+0000 7fb5cffff640 1 --2- 172.21.15.5:0/1195110548 >> v2:172.21.15.157:3300/0 conn(0x7fb5d00bae80 0x7fb5d00c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:34:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.908+0000 7fb5cf7fe640 1 --2- 172.21.15.5:0/1195110548 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0148010 0x7fb5d0148420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009870 tx=0x7fb5c402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351b060bade89d3e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5ceffd640 1 -- 172.21.15.5:0/1195110548 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4037070 con 0x7fb5d0148010 2024-05-16T22:34:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5ceffd640 1 -- 172.21.15.5:0/1195110548 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c4032440 con 0x7fb5d0148010 2024-05-16T22:34:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5ceffd640 1 -- 172.21.15.5:0/1195110548 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4032810 con 0x7fb5d0148010 2024-05-16T22:34:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5d559f640 1 -- 172.21.15.5:0/1195110548 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0148010 msgr2=0x7fb5d0148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5d559f640 1 --2- 172.21.15.5:0/1195110548 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0148010 0x7fb5d0148420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009870 tx=0x7fb5c402a1c0 comp rx=0 tx=0).stop 2024-05-16T22:34:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5d559f640 1 -- 172.21.15.5:0/1195110548 shutdown_connections 2024-05-16T22:34:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5d559f640 1 --2- 172.21.15.5:0/1195110548 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0148010 0x7fb5d0148420 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5d559f640 1 --2- 172.21.15.5:0/1195110548 >> v2:172.21.15.157:3300/0 conn(0x7fb5d00bae80 0x7fb5d00c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5d559f640 1 -- 172.21.15.5:0/1195110548 >> 172.21.15.5:0/1195110548 conn(0x7fb5d0073ff0 msgr2=0x7fb5d0074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5d559f640 1 -- 172.21.15.5:0/1195110548 shutdown_connections 2024-05-16T22:34:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.909+0000 7fb5d559f640 1 -- 172.21.15.5:0/1195110548 wait complete. 2024-05-16T22:34:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.911+0000 7fb5d559f640 1 Processor -- start 2024-05-16T22:34:00.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.911+0000 7fb5d559f640 1 -- start start 2024-05-16T22:34:00.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.912+0000 7fb5d559f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5d00bae80 0x7fb5d014f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.912+0000 7fb5d559f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5d0148010 0x7fb5d0147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.912+0000 7fb5d559f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0151930 0x7fb5d0135140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.912+0000 7fb5d559f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00bfe20 con 0x7fb5d00bae80 2024-05-16T22:34:00.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.912+0000 7fb5d559f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00bc650 con 0x7fb5d0148010 2024-05-16T22:34:00.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.912+0000 7fb5d559f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d00bb5e0 con 0x7fb5d0151930 2024-05-16T22:34:00.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5d00bae80 0x7fb5d014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5d00bae80 0x7fb5d014f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47556/0 (socket says 172.21.15.5:47556) 2024-05-16T22:34:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 -- 172.21.15.5:0/2462284974 learned_addr learned my addr 172.21.15.5:0/2462284974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5d4d9e640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0151930 0x7fb5d0135140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cf7fe640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5d0148010 0x7fb5d0147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 -- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0151930 msgr2=0x7fb5d0135140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0151930 0x7fb5d0135140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 -- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5d0148010 msgr2=0x7fb5d0147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5d0148010 0x7fb5d0147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 -- 172.21.15.5:0/2462284974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d01507d0 con 0x7fb5d00bae80 2024-05-16T22:34:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5cffff640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5d00bae80 0x7fb5d014f230 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000e960 tx=0x7fb5c000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5ccff9640 1 -- 172.21.15.5:0/2462284974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0017070 con 0x7fb5d00bae80 2024-05-16T22:34:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5ccff9640 1 -- 172.21.15.5:0/2462284974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c000ca00 con 0x7fb5d00bae80 2024-05-16T22:34:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d0149ed0 con 0x7fb5d00bae80 2024-05-16T22:34:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5ccff9640 1 -- 172.21.15.5:0/2462284974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000cdd0 con 0x7fb5d00bae80 2024-05-16T22:34:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.913+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d014a490 con 0x7fb5d00bae80 2024-05-16T22:34:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.915+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d01455a0 con 0x7fb5d00bae80 2024-05-16T22:34:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.915+0000 7fb5ccff9640 1 -- 172.21.15.5:0/2462284974 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb5c001a070 con 0x7fb5d00bae80 2024-05-16T22:34:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.916+0000 7fb5ccff9640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb5bc0762d0 0x7fb5bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.916+0000 7fb5ccff9640 1 -- 172.21.15.5:0/2462284974 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fb5c0097240 con 0x7fb5d00bae80 2024-05-16T22:34:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.916+0000 7fb5cf7fe640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb5bc0762d0 0x7fb5bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.917+0000 7fb5cf7fe640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb5bc0762d0 0x7fb5bc0787e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4034000 tx=0x7fb5c402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:00.921+0000 7fb5ccff9640 1 -- 172.21.15.5:0/2462284974 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb5d01455a0 con 0x7fb5d00bae80 2024-05-16T22:34:01.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.107+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5d0141c90 con 0x7fb5bc0762d0 2024-05-16T22:34:01.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.108+0000 7fb5ccff9640 1 -- 172.21.15.5:0/2462284974 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7fb5d0141c90 con 0x7fb5bc0762d0 2024-05-16T22:34:01.108 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T22:34:01.108 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T22:34:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb5bc0762d0 msgr2=0x7fb5bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb5bc0762d0 0x7fb5bc0787e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4034000 tx=0x7fb5c402e000 comp rx=0 tx=0).stop 2024-05-16T22:34:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5d00bae80 msgr2=0x7fb5d014f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5d00bae80 0x7fb5d014f230 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000e960 tx=0x7fb5c000ee20 comp rx=0 tx=0).stop 2024-05-16T22:34:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 shutdown_connections 2024-05-16T22:34:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fb5bc0762d0 0x7fb5bc0787e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5d0151930 0x7fb5d0135140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5d0148010 0x7fb5d0147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 --2- 172.21.15.5:0/2462284974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5d00bae80 0x7fb5d014f230 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 >> 172.21.15.5:0/2462284974 conn(0x7fb5d0073ff0 msgr2=0x7fb5d0144e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:01.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 shutdown_connections 2024-05-16T22:34:01.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.111+0000 7fb5d559f640 1 -- 172.21.15.5:0/2462284974 wait complete. 2024-05-16T22:34:01.121 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1893,"stamp":"2024-05-16T22:33:59.212342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254804,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719916,"statfs":{"total":773094113280,"available":772833193984,"internally_reserved":0,"allocated":5480448,"data_stored":2907640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002585"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-16T22:30:24.470099+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T22:30:24.470099+0000","last_peered":"2024-05-16T22:30:24.470099+0000","last_clean":"2024-05-16T22:30:24.470099+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T22:30:24.470099+0000","last_undegraded":"2024-05-16T22:30:24.470099+0000","last_fullsized":"2024-05-16T22:30:24.470099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575593,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575593,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:34:01.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:34:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.234+0000 7f512acc6640 1 Processor -- start 2024-05-16T22:34:01.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.234+0000 7f512acc6640 1 -- start start 2024-05-16T22:34:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f512acc6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51240bd440 0x7f51240bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f512acc6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51240bdd90 con 0x7f51240b8d70 2024-05-16T22:34:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f512acc6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512414ece0 con 0x7f512414e530 2024-05-16T22:34:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f512acc6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f51240b88e0 con 0x7f51240bd440 2024-05-16T22:34:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f5123fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51240bd440 0x7f51240bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f5129263640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f51240b8d70 0x7f51240b9180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49854/0 (socket says 172.21.15.5:49854) 2024-05-16T22:34:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f5123fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51240bd440 0x7f51240bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47570/0 (socket says 172.21.15.5:47570) 2024-05-16T22:34:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f5129263640 1 -- 172.21.15.5:0/4174847154 learned_addr learned my addr 172.21.15.5:0/4174847154 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f5123fff640 1 -- 172.21.15.5:0/4174847154 >> v1:172.21.15.157:6789/0 conn(0x7f512414e530 legacy=0x7f51240ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f5123fff640 1 -- 172.21.15.5:0/4174847154 >> v1:172.21.15.5:6789/0 conn(0x7f51240b8d70 legacy=0x7f51240b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.235+0000 7f5123fff640 1 -- 172.21.15.5:0/4174847154 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512414efc0 con 0x7f51240bd440 2024-05-16T22:34:01.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.236+0000 7f5123fff640 1 --2- 172.21.15.5:0/4174847154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240bd440 0x7f51240bd850 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f51180097a0 tx=0x7f511802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef46cdf565dff10a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.236+0000 7f51237fe640 1 -- 172.21.15.5:0/4174847154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118037070 con 0x7f51240bd440 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.236+0000 7f51237fe640 1 -- 172.21.15.5:0/4174847154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5118032440 con 0x7f51240bd440 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.236+0000 7f51237fe640 1 -- 172.21.15.5:0/4174847154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118032810 con 0x7f51240bd440 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.237+0000 7f512acc6640 1 -- 172.21.15.5:0/4174847154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240bd440 msgr2=0x7f51240bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.237+0000 7f512acc6640 1 --2- 172.21.15.5:0/4174847154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240bd440 0x7f51240bd850 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f51180097a0 tx=0x7f511802a230 comp rx=0 tx=0).stop 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.237+0000 7f512acc6640 1 -- 172.21.15.5:0/4174847154 shutdown_connections 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.237+0000 7f512acc6640 1 --2- 172.21.15.5:0/4174847154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240bd440 0x7f51240bd850 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.237+0000 7f512acc6640 1 -- 172.21.15.5:0/4174847154 >> 172.21.15.5:0/4174847154 conn(0x7f51240c0570 msgr2=0x7f51240c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:01.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.237+0000 7f512acc6640 1 -- 172.21.15.5:0/4174847154 shutdown_connections 2024-05-16T22:34:01.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.237+0000 7f512acc6640 1 -- 172.21.15.5:0/4174847154 wait complete. 2024-05-16T22:34:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.238+0000 7f512acc6640 1 Processor -- start 2024-05-16T22:34:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.238+0000 7f512acc6640 1 -- start start 2024-05-16T22:34:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f512acc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240b8d70 0x7f512414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f512acc6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51240bd440 0x7f51241e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f512acc6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f512414e530 0x7f512413dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f512acc6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f512414e940 con 0x7f51240b8d70 2024-05-16T22:34:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f512acc6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f51240bbb70 con 0x7f512414e530 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f512acc6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f512414eac0 con 0x7f51240bd440 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240b8d70 0x7f512414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240b8d70 0x7f512414d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47580/0 (socket says 172.21.15.5:47580) 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 -- 172.21.15.5:0/3024516870 learned_addr learned my addr 172.21.15.5:0/3024516870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5129263640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f512414e530 0x7f512413dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5123fff640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51240bd440 0x7f51241e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 -- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51240bd440 msgr2=0x7f51241e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51240bd440 0x7f51241e7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 -- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f512414e530 msgr2=0x7f512413dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f512414e530 0x7f512413dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 -- 172.21.15.5:0/3024516870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512414db10 con 0x7f51240b8d70 2024-05-16T22:34:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5123fff640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51240bd440 0x7f51241e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:34:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5129263640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f512414e530 0x7f512413dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:34:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f5128a62640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240b8d70 0x7f512414d5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f511400c3c0 tx=0x7f511400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f51217fa640 1 -- 172.21.15.5:0/3024516870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114017070 con 0x7f51240b8d70 2024-05-16T22:34:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f51217fa640 1 -- 172.21.15.5:0/3024516870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51140052d0 con 0x7f51240b8d70 2024-05-16T22:34:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f51217fa640 1 -- 172.21.15.5:0/3024516870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114003640 con 0x7f51240b8d70 2024-05-16T22:34:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.240+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51241e8800 con 0x7f51240b8d70 2024-05-16T22:34:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.241+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512414caf0 con 0x7f51240b8d70 2024-05-16T22:34:01.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.241+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5124050940 con 0x7f51240b8d70 2024-05-16T22:34:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.242+0000 7f51217fa640 1 -- 172.21.15.5:0/3024516870 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f511401a070 con 0x7f51240b8d70 2024-05-16T22:34:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.243+0000 7f51217fa640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f51100762d0 0x7f51100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.243+0000 7f51217fa640 1 -- 172.21.15.5:0/3024516870 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f51140965b0 con 0x7f51240b8d70 2024-05-16T22:34:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.243+0000 7f5123fff640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f51100762d0 0x7f51100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.243+0000 7f5123fff640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f51100762d0 0x7f51100787e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5118034000 tx=0x7f511802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.247+0000 7f51217fa640 1 -- 172.21.15.5:0/3024516870 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f511405fad0 con 0x7f51240b8d70 2024-05-16T22:34:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.434+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51240c2020 con 0x7f51100762d0 2024-05-16T22:34:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.435+0000 7f51217fa640 1 -- 172.21.15.5:0/3024516870 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7f51240c2020 con 0x7f51100762d0 2024-05-16T22:34:01.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T22:34:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T22:34:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f51100762d0 msgr2=0x7f51100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f51100762d0 0x7f51100787e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5118034000 tx=0x7f511802e000 comp rx=0 tx=0).stop 2024-05-16T22:34:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240b8d70 msgr2=0x7f512414d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240b8d70 0x7f512414d5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f511400c3c0 tx=0x7f511400c880 comp rx=0 tx=0).stop 2024-05-16T22:34:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 shutdown_connections 2024-05-16T22:34:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f51100762d0 0x7f51100787e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f512414e530 0x7f512413dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51240bd440 0x7f51241e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 --2- 172.21.15.5:0/3024516870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51240b8d70 0x7f512414d5d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 >> 172.21.15.5:0/3024516870 conn(0x7f51240c0570 msgr2=0x7f5124068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 shutdown_connections 2024-05-16T22:34:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.437+0000 7f512acc6640 1 -- 172.21.15.5:0/3024516870 wait complete. 2024-05-16T22:34:01.447 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1894,"stamp":"2024-05-16T22:34:01.212762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254804,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719916,"statfs":{"total":773094113280,"available":772833193984,"internally_reserved":0,"allocated":5480448,"data_stored":2907640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002605"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-16T22:30:24.470099+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T22:30:24.470099+0000","last_peered":"2024-05-16T22:30:24.470099+0000","last_clean":"2024-05-16T22:30:24.470099+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T22:30:24.470099+0000","last_undegraded":"2024-05-16T22:30:24.470099+0000","last_fullsized":"2024-05-16T22:30:24.470099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575594,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575594,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:34:01.448 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T22:34:01.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:34:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.560+0000 7f47f66f2640 1 Processor -- start 2024-05-16T22:34:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.560+0000 7f47f66f2640 1 -- start start 2024-05-16T22:34:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47f66f2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47f0151fc0 0x7f47f00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47f66f2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f00c36f0 con 0x7f47f006da30 2024-05-16T22:34:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47f66f2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f0152530 con 0x7f47f00bf050 2024-05-16T22:34:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47f66f2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f47f00bdc10 con 0x7f47f0151fc0 2024-05-16T22:34:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47f0151fc0 0x7f47f00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47ef7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47f006da30 0x7f47f00be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49870/0 (socket says 172.21.15.5:49870) 2024-05-16T22:34:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47ef7fe640 1 -- 172.21.15.5:0/3163455144 learned_addr learned my addr 172.21.15.5:0/3163455144 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47effff640 1 -- 172.21.15.5:0/3163455144 >> v1:172.21.15.157:6789/0 conn(0x7f47f00bf050 legacy=0x7f47f0158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47effff640 1 -- 172.21.15.5:0/3163455144 >> v1:172.21.15.5:6789/0 conn(0x7f47f006da30 legacy=0x7f47f00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.561+0000 7f47effff640 1 -- 172.21.15.5:0/3163455144 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f0152810 con 0x7f47f0151fc0 2024-05-16T22:34:01.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.562+0000 7f47effff640 1 --2- 172.21.15.5:0/3163455144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f0151fc0 0x7f47f00bd6d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097a0 tx=0x7f47e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e111c1c72561cd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.562+0000 7f47eeffd640 1 -- 172.21.15.5:0/3163455144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0037070 con 0x7f47f0151fc0 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.562+0000 7f47eeffd640 1 -- 172.21.15.5:0/3163455144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e0032440 con 0x7f47f0151fc0 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.562+0000 7f47eeffd640 1 -- 172.21.15.5:0/3163455144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0032810 con 0x7f47f0151fc0 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.563+0000 7f47f66f2640 1 -- 172.21.15.5:0/3163455144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f0151fc0 msgr2=0x7f47f00bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.563+0000 7f47f66f2640 1 --2- 172.21.15.5:0/3163455144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f0151fc0 0x7f47f00bd6d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097a0 tx=0x7f47e002a180 comp rx=0 tx=0).stop 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.563+0000 7f47f66f2640 1 -- 172.21.15.5:0/3163455144 shutdown_connections 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.563+0000 7f47f66f2640 1 --2- 172.21.15.5:0/3163455144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f0151fc0 0x7f47f00bd6d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.563+0000 7f47f66f2640 1 -- 172.21.15.5:0/3163455144 >> 172.21.15.5:0/3163455144 conn(0x7f47f00c3d20 msgr2=0x7f47f00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.563+0000 7f47f66f2640 1 -- 172.21.15.5:0/3163455144 shutdown_connections 2024-05-16T22:34:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.563+0000 7f47f66f2640 1 -- 172.21.15.5:0/3163455144 wait complete. 2024-05-16T22:34:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.564+0000 7f47f66f2640 1 Processor -- start 2024-05-16T22:34:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.565+0000 7f47f66f2640 1 -- start start 2024-05-16T22:34:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47f66f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f006da30 0x7f47f00a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47f66f2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47f00bf050 0x7f47f00b8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47f66f2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47f0151fc0 0x7f47f014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47f66f2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00a3050 con 0x7f47f006da30 2024-05-16T22:34:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47f66f2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00a2ed0 con 0x7f47f0151fc0 2024-05-16T22:34:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47f66f2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f47f006de40 con 0x7f47f00bf050 2024-05-16T22:34:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f006da30 0x7f47f00a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f006da30 0x7f47f00a3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47604/0 (socket says 172.21.15.5:47604) 2024-05-16T22:34:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 -- 172.21.15.5:0/3813076294 learned_addr learned my addr 172.21.15.5:0/3813076294 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47f4c8f640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47f0151fc0 0x7f47f014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 -- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47f00bf050 msgr2=0x7f47f00b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47f00bf050 0x7f47f00b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 -- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47f0151fc0 msgr2=0x7f47f014b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47f0151fc0 0x7f47f014b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 -- 172.21.15.5:0/3813076294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f00a3fb0 con 0x7f47f006da30 2024-05-16T22:34:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47effff640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f006da30 0x7f47f00a3a70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097a0 tx=0x7f47e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47ecff9640 1 -- 172.21.15.5:0/3813076294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0041070 con 0x7f47f006da30 2024-05-16T22:34:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47ecff9640 1 -- 172.21.15.5:0/3813076294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e003c870 con 0x7f47f006da30 2024-05-16T22:34:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47ecff9640 1 -- 172.21.15.5:0/3813076294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0037040 con 0x7f47f006da30 2024-05-16T22:34:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.566+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f00b8d50 con 0x7f47f006da30 2024-05-16T22:34:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.567+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f014ee80 con 0x7f47f006da30 2024-05-16T22:34:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.568+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f0050940 con 0x7f47f006da30 2024-05-16T22:34:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.568+0000 7f47ecff9640 1 -- 172.21.15.5:0/3813076294 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47e0044070 con 0x7f47f006da30 2024-05-16T22:34:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.569+0000 7f47ecff9640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f47dc076300 0x7f47dc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.569+0000 7f47ecff9640 1 -- 172.21.15.5:0/3813076294 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f47e00b7e20 con 0x7f47f006da30 2024-05-16T22:34:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.569+0000 7f47ef7fe640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f47dc076300 0x7f47dc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.570+0000 7f47ef7fe640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f47dc076300 0x7f47dc078810 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000f60 tx=0x7f47e4007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.574+0000 7f47ecff9640 1 -- 172.21.15.5:0/3813076294 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f47e0081ab0 con 0x7f47f006da30 2024-05-16T22:34:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.760+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47f006eb40 con 0x7f47dc076300 2024-05-16T22:34:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.761+0000 7f47ecff9640 1 -- 172.21.15.5:0/3813076294 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7f47e4019430 con 0x7f47dc076300 2024-05-16T22:34:01.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T22:34:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T22:34:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f47dc076300 msgr2=0x7f47dc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f47dc076300 0x7f47dc078810 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000f60 tx=0x7f47e4007a80 comp rx=0 tx=0).stop 2024-05-16T22:34:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f006da30 msgr2=0x7f47f00a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f006da30 0x7f47f00a3a70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097a0 tx=0x7f47e00046c0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 shutdown_connections 2024-05-16T22:34:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f47dc076300 0x7f47dc078810 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47f0151fc0 0x7f47f014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47f00bf050 0x7f47f00b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 --2- 172.21.15.5:0/3813076294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f006da30 0x7f47f00a3a70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 >> 172.21.15.5:0/3813076294 conn(0x7f47f00c3d20 msgr2=0x7f47f00c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 shutdown_connections 2024-05-16T22:34:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.764+0000 7f47f66f2640 1 -- 172.21.15.5:0/3813076294 wait complete. 2024-05-16T22:34:01.774 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1894,"stamp":"2024-05-16T22:34:01.212762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254804,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719916,"statfs":{"total":773094113280,"available":772833193984,"internally_reserved":0,"allocated":5480448,"data_stored":2907640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002605"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-16T22:30:24.470099+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T22:30:24.470099+0000","last_peered":"2024-05-16T22:30:24.470099+0000","last_clean":"2024-05-16T22:30:24.470099+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T22:30:24.470099+0000","last_undegraded":"2024-05-16T22:30:24.470099+0000","last_fullsized":"2024-05-16T22:30:24.470099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575594,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575594,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:34:01.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:34:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.887+0000 7f32437a8640 1 Processor -- start 2024-05-16T22:34:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.887+0000 7f32437a8640 1 -- start start 2024-05-16T22:34:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.888+0000 7f32437a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c151fc0 0x7f323c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.888+0000 7f32437a8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f323c06da30 0x7f323c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.888+0000 7f32437a8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f323c06de40 0x7f323c0bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.888+0000 7f32437a8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f323c0bdc10 con 0x7f323c06de40 2024-05-16T22:34:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.888+0000 7f32437a8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f323c0c36f0 con 0x7f323c06da30 2024-05-16T22:34:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.888+0000 7f32437a8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f323c152530 con 0x7f323c151fc0 2024-05-16T22:34:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241d45640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f323c06de40 0x7f323c0bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241d45640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f323c06de40 0x7f323c0bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47608/0 (socket says 172.21.15.5:47608) 2024-05-16T22:34:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241d45640 1 -- 172.21.15.5:0/688480114 learned_addr learned my addr 172.21.15.5:0/688480114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3240d43640 1 --2- 172.21.15.5:0/688480114 >> v2:172.21.15.157:3300/0 conn(0x7f323c06da30 0x7f323c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241544640 1 --2- 172.21.15.5:0/688480114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c151fc0 0x7f323c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241d45640 1 -- 172.21.15.5:0/688480114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c151fc0 msgr2=0x7f323c0bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241d45640 1 --2- 172.21.15.5:0/688480114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c151fc0 0x7f323c0bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241d45640 1 -- 172.21.15.5:0/688480114 >> v2:172.21.15.157:3300/0 conn(0x7f323c06da30 msgr2=0x7f323c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241d45640 1 --2- 172.21.15.5:0/688480114 >> v2:172.21.15.157:3300/0 conn(0x7f323c06da30 0x7f323c0be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.889+0000 7f3241d45640 1 -- 172.21.15.5:0/688480114 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c152810 con 0x7f323c06de40 2024-05-16T22:34:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.890+0000 7f3241d45640 1 --2- 172.21.15.5:0/688480114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06de40 0x7f323c0bee80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f323c0c1440 tx=0x7f322c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af07de6b9f26a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.890+0000 7f323bfff640 1 -- 172.21.15.5:0/688480114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c036070 con 0x7f323c06de40 2024-05-16T22:34:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.890+0000 7f323bfff640 1 -- 172.21.15.5:0/688480114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f322c031600 con 0x7f323c06de40 2024-05-16T22:34:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.890+0000 7f323bfff640 1 -- 172.21.15.5:0/688480114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c0319d0 con 0x7f323c06de40 2024-05-16T22:34:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.890+0000 7f32437a8640 1 -- 172.21.15.5:0/688480114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06de40 msgr2=0x7f323c0bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.890+0000 7f32437a8640 1 --2- 172.21.15.5:0/688480114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06de40 0x7f323c0bee80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f323c0c1440 tx=0x7f322c02a6a0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.891+0000 7f32437a8640 1 -- 172.21.15.5:0/688480114 shutdown_connections 2024-05-16T22:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.891+0000 7f32437a8640 1 --2- 172.21.15.5:0/688480114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06de40 0x7f323c0bee80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.891+0000 7f32437a8640 1 --2- 172.21.15.5:0/688480114 >> v2:172.21.15.157:3300/0 conn(0x7f323c06da30 0x7f323c0be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.891+0000 7f32437a8640 1 --2- 172.21.15.5:0/688480114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c151fc0 0x7f323c0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.891+0000 7f32437a8640 1 -- 172.21.15.5:0/688480114 >> 172.21.15.5:0/688480114 conn(0x7f323c0c3d20 msgr2=0x7f323c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.891+0000 7f32437a8640 1 -- 172.21.15.5:0/688480114 shutdown_connections 2024-05-16T22:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.891+0000 7f32437a8640 1 -- 172.21.15.5:0/688480114 wait complete. 2024-05-16T22:34:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.892+0000 7f32437a8640 1 Processor -- start 2024-05-16T22:34:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.892+0000 7f32437a8640 1 -- start start 2024-05-16T22:34:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f32437a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06da30 0x7f323c0bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f32437a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c06de40 0x7f323c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f32437a8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f323c151fc0 0x7f323c14a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f32437a8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0a3050 con 0x7f323c06da30 2024-05-16T22:34:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f32437a8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0a2ed0 con 0x7f323c151fc0 2024-05-16T22:34:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f32437a8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f323c14e570 con 0x7f323c06de40 2024-05-16T22:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f3241544640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06da30 0x7f323c0bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f3241544640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06da30 0x7f323c0bcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47622/0 (socket says 172.21.15.5:47622) 2024-05-16T22:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f3241544640 1 -- 172.21.15.5:0/1306180912 learned_addr learned my addr 172.21.15.5:0/1306180912 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f3240d43640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c06de40 0x7f323c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.893+0000 7f3241d45640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f323c151fc0 0x7f323c14a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3241544640 1 -- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c06de40 msgr2=0x7f323c14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3241544640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c06de40 0x7f323c14d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3241544640 1 -- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f323c151fc0 msgr2=0x7f323c14a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3241544640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f323c151fc0 0x7f323c14a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3241544640 1 -- 172.21.15.5:0/1306180912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c14dc60 con 0x7f323c06da30 2024-05-16T22:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3241544640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06da30 0x7f323c0bcd10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f323400e870 tx=0x7f323400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3239ffb640 1 -- 172.21.15.5:0/1306180912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234017070 con 0x7f323c06da30 2024-05-16T22:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3239ffb640 1 -- 172.21.15.5:0/1306180912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323400c940 con 0x7f323c06da30 2024-05-16T22:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323c0b9810 con 0x7f323c06da30 2024-05-16T22:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f3239ffb640 1 -- 172.21.15.5:0/1306180912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323400cd30 con 0x7f323c06da30 2024-05-16T22:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.894+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323c0ba250 con 0x7f323c06da30 2024-05-16T22:34:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.895+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f323c050940 con 0x7f323c06da30 2024-05-16T22:34:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.896+0000 7f3239ffb640 1 -- 172.21.15.5:0/1306180912 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f323401a070 con 0x7f323c06da30 2024-05-16T22:34:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.897+0000 7f3239ffb640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f32280762d0 0x7f32280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.897+0000 7f3239ffb640 1 -- 172.21.15.5:0/1306180912 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f32340974b0 con 0x7f323c06da30 2024-05-16T22:34:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.897+0000 7f3240d43640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f32280762d0 0x7f32280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.897+0000 7f3240d43640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f32280762d0 0x7f32280787e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f323c08dd70 tx=0x7f3230009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:01.901+0000 7f3239ffb640 1 -- 172.21.15.5:0/1306180912 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3234060af0 con 0x7f323c06da30 2024-05-16T22:34:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.094+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f323c06eb40 con 0x7f323c06da30 2024-05-16T22:34:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.095+0000 7f3239ffb640 1 -- 172.21.15.5:0/1306180912 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+13098 (secure 0 0 0) 0x7f3234064df0 con 0x7f323c06da30 2024-05-16T22:34:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T22:34:02.094 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":45,"fsid":"4223c61e-038a-4696-b0eb-6b69d601e381","created":"2024-05-16T21:31:58.047208+0000","modified":"2024-05-16T21:33:59.156080+0000","last_up_change":"2024-05-16T21:32:08.736295+0000","last_in_change":"2024-05-16T21:32:00.281340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T21:32:10.378693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40b0bbbf-ea89-4e11-95c8-1b6172a5cc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6801","nonce":971514196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6803","nonce":971514196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6807","nonce":971514196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":971514196},{"type":"v1","addr":"172.21.15.5:6805","nonce":971514196}]},"public_addr":"172.21.15.5:6801/971514196","cluster_addr":"172.21.15.5:6803/971514196","heartbeat_back_addr":"172.21.15.5:6807/971514196","heartbeat_front_addr":"172.21.15.5:6805/971514196","state":["exists","up"]},{"osd":1,"uuid":"e53ef5cc-2a70-418c-b2fa-ea6e25c94912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6825","nonce":1146909345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6827","nonce":1146909345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6831","nonce":1146909345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1146909345},{"type":"v1","addr":"172.21.15.5:6829","nonce":1146909345}]},"public_addr":"172.21.15.5:6825/1146909345","cluster_addr":"172.21.15.5:6827/1146909345","heartbeat_back_addr":"172.21.15.5:6831/1146909345","heartbeat_front_addr":"172.21.15.5:6829/1146909345","state":["exists","up"]},{"osd":2,"uuid":"06dca2f1-dc2c-4264-8589-5667e239f106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6817","nonce":2608436175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6819","nonce":2608436175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6823","nonce":2608436175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2608436175},{"type":"v1","addr":"172.21.15.5:6821","nonce":2608436175}]},"public_addr":"172.21.15.5:6817/2608436175","cluster_addr":"172.21.15.5:6819/2608436175","heartbeat_back_addr":"172.21.15.5:6823/2608436175","heartbeat_front_addr":"172.21.15.5:6821/2608436175","state":["exists","up"]},{"osd":3,"uuid":"9f89cec3-d102-42f6-baee-3650e29b31b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6809","nonce":1040173321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6811","nonce":1040173321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6815","nonce":1040173321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1040173321},{"type":"v1","addr":"172.21.15.5:6813","nonce":1040173321}]},"public_addr":"172.21.15.5:6809/1040173321","cluster_addr":"172.21.15.5:6811/1040173321","heartbeat_back_addr":"172.21.15.5:6815/1040173321","heartbeat_front_addr":"172.21.15.5:6813/1040173321","state":["exists","up"]},{"osd":4,"uuid":"1ed0bc49-d3a6-4caa-b24d-0fb9f83152bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6825","nonce":3329892271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6827","nonce":3329892271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6831","nonce":3329892271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3329892271},{"type":"v1","addr":"172.21.15.157:6829","nonce":3329892271}]},"public_addr":"172.21.15.157:6825/3329892271","cluster_addr":"172.21.15.157:6827/3329892271","heartbeat_back_addr":"172.21.15.157:6831/3329892271","heartbeat_front_addr":"172.21.15.157:6829/3329892271","state":["exists","up"]},{"osd":5,"uuid":"184dc921-f299-4041-b72b-d06a3f1bde9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6809","nonce":2462600028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6811","nonce":2462600028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6815","nonce":2462600028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2462600028},{"type":"v1","addr":"172.21.15.157:6813","nonce":2462600028}]},"public_addr":"172.21.15.157:6809/2462600028","cluster_addr":"172.21.15.157:6811/2462600028","heartbeat_back_addr":"172.21.15.157:6815/2462600028","heartbeat_front_addr":"172.21.15.157:6813/2462600028","state":["exists","up"]},{"osd":6,"uuid":"cdba81e7-7752-4507-91d8-92610089ae57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6801","nonce":3966496545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6803","nonce":3966496545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6807","nonce":3966496545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3966496545},{"type":"v1","addr":"172.21.15.157:6805","nonce":3966496545}]},"public_addr":"172.21.15.157:6801/3966496545","cluster_addr":"172.21.15.157:6803/3966496545","heartbeat_back_addr":"172.21.15.157:6807/3966496545","heartbeat_front_addr":"172.21.15.157:6805/3966496545","state":["exists","up"]},{"osd":7,"uuid":"15b15ba1-109b-4af6-8f67-b3a736a52c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6817","nonce":3015790228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6819","nonce":3015790228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6823","nonce":3015790228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3015790228},{"type":"v1","addr":"172.21.15.157:6821","nonce":3015790228}]},"public_addr":"172.21.15.157:6817/3015790228","cluster_addr":"172.21.15.157:6819/3015790228","heartbeat_back_addr":"172.21.15.157:6823/3015790228","heartbeat_front_addr":"172.21.15.157:6821/3015790228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.396665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.455680+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.483292+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.526578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.509067+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.548337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T21:32:05.462834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/2190655947":"2024-05-17T21:33:56.076856+0000","172.21.15.5:6834/2190655947":"2024-05-17T21:33:56.076856+0000","172.21.15.5:6835/1584346239":"2024-05-17T21:33:46.105734+0000","172.21.15.5:6834/1584346239":"2024-05-17T21:33:46.105734+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:34:02.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f32280762d0 msgr2=0x7f32280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:02.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f32280762d0 0x7f32280787e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f323c08dd70 tx=0x7f3230009190 comp rx=0 tx=0).stop 2024-05-16T22:34:02.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06da30 msgr2=0x7f323c0bcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:02.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06da30 0x7f323c0bcd10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f323400e870 tx=0x7f323400ec70 comp rx=0 tx=0).stop 2024-05-16T22:34:02.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 shutdown_connections 2024-05-16T22:34:02.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f32280762d0 0x7f32280787e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:02.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f323c151fc0 0x7f323c14a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:02.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f323c06de40 0x7f323c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:02.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 --2- 172.21.15.5:0/1306180912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06da30 0x7f323c0bcd10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:02.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 >> 172.21.15.5:0/1306180912 conn(0x7f323c0c3d20 msgr2=0x7f323c0c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:02.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 shutdown_connections 2024-05-16T22:34:02.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:02.097+0000 7f32437a8640 1 -- 172.21.15.5:0/1306180912 wait complete. 2024-05-16T22:34:03.108 INFO:tasks.ceph:Scrubbing osd.0 2024-05-16T22:34:03.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-16T22:34:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.239+0000 7f666db08640 1 Processor -- start 2024-05-16T22:34:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.239+0000 7f666db08640 1 -- start start 2024-05-16T22:34:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.240+0000 7f666db08640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6668151fc0 0x7f66680bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.240+0000 7f666db08640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66680bf050 0x7f6668158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.240+0000 7f666db08640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66680c36f0 con 0x7f666806da30 2024-05-16T22:34:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.240+0000 7f666db08640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f66680bdc10 con 0x7f6668151fc0 2024-05-16T22:34:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.240+0000 7f666db08640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6668152530 con 0x7f66680bf050 2024-05-16T22:34:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.240+0000 7f66677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6668151fc0 0x7f66680bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.241+0000 7f6666ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f666806da30 0x7f66680be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49886/0 (socket says 172.21.15.5:49886) 2024-05-16T22:34:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.241+0000 7f6666ffd640 1 -- 172.21.15.5:0/4118312655 learned_addr learned my addr 172.21.15.5:0/4118312655 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.241+0000 7f66677fe640 1 -- 172.21.15.5:0/4118312655 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66680bf050 msgr2=0x7f6668158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.241+0000 7f66677fe640 1 --2- 172.21.15.5:0/4118312655 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66680bf050 0x7f6668158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.241+0000 7f66677fe640 1 -- 172.21.15.5:0/4118312655 >> v1:172.21.15.5:6789/0 conn(0x7f666806da30 legacy=0x7f66680be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.241+0000 7f66677fe640 1 -- 172.21.15.5:0/4118312655 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6668152810 con 0x7f6668151fc0 2024-05-16T22:34:03.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f66677fe640 1 --2- 172.21.15.5:0/4118312655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6668151fc0 0x7f66680bd6d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f66580097a0 tx=0x7f665802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509087c5bf42ea79 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f66667fc640 1 -- 172.21.15.5:0/4118312655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658037070 con 0x7f6668151fc0 2024-05-16T22:34:03.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f66667fc640 1 -- 172.21.15.5:0/4118312655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665802ae50 con 0x7f6668151fc0 2024-05-16T22:34:03.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f66667fc640 1 -- 172.21.15.5:0/4118312655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658032660 con 0x7f6668151fc0 2024-05-16T22:34:03.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f666db08640 1 -- 172.21.15.5:0/4118312655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6668151fc0 msgr2=0x7f66680bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f666db08640 1 --2- 172.21.15.5:0/4118312655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6668151fc0 0x7f66680bd6d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f66580097a0 tx=0x7f665802a100 comp rx=0 tx=0).stop 2024-05-16T22:34:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f666db08640 1 -- 172.21.15.5:0/4118312655 shutdown_connections 2024-05-16T22:34:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f666db08640 1 --2- 172.21.15.5:0/4118312655 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66680bf050 0x7f6668158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f666db08640 1 --2- 172.21.15.5:0/4118312655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6668151fc0 0x7f66680bd6d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.242+0000 7f666db08640 1 -- 172.21.15.5:0/4118312655 >> 172.21.15.5:0/4118312655 conn(0x7f66680c3d20 msgr2=0x7f66680c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.243+0000 7f666db08640 1 -- 172.21.15.5:0/4118312655 shutdown_connections 2024-05-16T22:34:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.243+0000 7f666db08640 1 -- 172.21.15.5:0/4118312655 wait complete. 2024-05-16T22:34:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.244+0000 7f666db08640 1 Processor -- start 2024-05-16T22:34:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.244+0000 7f666db08640 1 -- start start 2024-05-16T22:34:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f666db08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f666806da30 0x7f66680b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f666db08640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66680bf050 0x7f666814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f666db08640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6668151fc0 0x7f666814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f666db08640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f66680a3050 con 0x7f666806da30 2024-05-16T22:34:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f666db08640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f66680a2ed0 con 0x7f66680bf050 2024-05-16T22:34:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f666db08640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f666806de40 con 0x7f6668151fc0 2024-05-16T22:34:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f66677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f666806da30 0x7f66680b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f66677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f666806da30 0x7f66680b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47642/0 (socket says 172.21.15.5:47642) 2024-05-16T22:34:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.245+0000 7f66677fe640 1 -- 172.21.15.5:0/2726228730 learned_addr learned my addr 172.21.15.5:0/2726228730 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f6666ffd640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66680bf050 0x7f666814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f6667fff640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6668151fc0 0x7f666814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f66677fe640 1 -- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6668151fc0 msgr2=0x7f666814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f66677fe640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6668151fc0 0x7f666814b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f66677fe640 1 -- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66680bf050 msgr2=0x7f666814c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f66677fe640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66680bf050 0x7f666814c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f66677fe640 1 -- 172.21.15.5:0/2726228730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66680b7b50 con 0x7f666806da30 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f66677fe640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f666806da30 0x7f66680b7610 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f66580097a0 tx=0x7f66580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658042070 con 0x7f666806da30 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665803e670 con 0x7f666806da30 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666814c780 con 0x7f666806da30 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658037040 con 0x7f666806da30 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.246+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66681e8360 con 0x7f666806da30 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.247+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66680c10e0 con 0x7f666806da30 2024-05-16T22:34:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.248+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6658045070 con 0x7f666806da30 2024-05-16T22:34:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.248+0000 7f664ffff640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6654076300 0x7f6654078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.248+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f66580b8190 con 0x7f666806da30 2024-05-16T22:34:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.249+0000 7f6666ffd640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6654076300 0x7f6654078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.249+0000 7f664ffff640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7f665407c2b0 0x7f665407e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.249+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f665804dec0 con 0x7f665407c2b0 2024-05-16T22:34:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.249+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f66580b8540 con 0x7f666806da30 2024-05-16T22:34:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.249+0000 7f6667fff640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7f665407c2b0 0x7f665407e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.249+0000 7f6667fff640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7f665407c2b0 0x7f665407e700 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.249+0000 7f6666ffd640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6654076300 0x7f6654078810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f666814de00 tx=0x7f665c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.250+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 <== osd.0 v2:172.21.15.5:6800/971514196 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f665804dec0 con 0x7f665407c2b0 2024-05-16T22:34:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.263+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 --> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66680bca20 con 0x7f665407c2b0 2024-05-16T22:34:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.263+0000 7f664ffff640 1 -- 172.21.15.5:0/2726228730 <== osd.0 v2:172.21.15.5:6800/971514196 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f66680bca20 con 0x7f665407c2b0 2024-05-16T22:34:03.263 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T22:34:03.263 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T22:34:03.263 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T22:34:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7f665407c2b0 msgr2=0x7f665407e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.5:6800/971514196,v1:172.21.15.5:6801/971514196] conn(0x7f665407c2b0 0x7f665407e700 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6654076300 msgr2=0x7f6654078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f6654076300 0x7f6654078810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f666814de00 tx=0x7f665c009040 comp rx=0 tx=0).stop 2024-05-16T22:34:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f666806da30 msgr2=0x7f66680b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 --2- 172.21.15.5:0/2726228730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f666806da30 0x7f66680b7610 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f66580097a0 tx=0x7f66580046c0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f6667fff640 1 -- 172.21.15.5:0/2726228730 reap_dead start 2024-05-16T22:34:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 shutdown_connections 2024-05-16T22:34:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 >> 172.21.15.5:0/2726228730 conn(0x7f66680c3d20 msgr2=0x7f66680c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 shutdown_connections 2024-05-16T22:34:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.264+0000 7f666db08640 1 -- 172.21.15.5:0/2726228730 wait complete. 2024-05-16T22:34:03.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-16T22:34:03.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.387+0000 7fdc5c229640 1 Processor -- start 2024-05-16T22:34:03.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.387+0000 7fdc5c229640 1 -- start start 2024-05-16T22:34:03.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc5c229640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540bb490 0x7fdc540b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc5c229640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc540bba80 con 0x7fdc540b4500 2024-05-16T22:34:03.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc5c229640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc540bbd20 con 0x7fdc540b9ee0 2024-05-16T22:34:03.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc5c229640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdc540b4f60 con 0x7fdc540bb490 2024-05-16T22:34:03.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc59fc5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdc540b4500 0x7fdc5406faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49896/0 (socket says 172.21.15.5:49896) 2024-05-16T22:34:03.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc59fc5640 1 -- 172.21.15.5:0/4214131332 learned_addr learned my addr 172.21.15.5:0/4214131332 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:03.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc597c4640 1 --2- 172.21.15.5:0/4214131332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540bb490 0x7fdc540b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc58fc3640 1 -- 172.21.15.5:0/4214131332 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727710963 0 0) 0x7fdc540bba80 con 0x7fdc540b4500 2024-05-16T22:34:03.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.388+0000 7fdc58fc3640 1 -- 172.21.15.5:0/4214131332 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc40003520 con 0x7fdc540b4500 2024-05-16T22:34:03.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.389+0000 7fdc58fc3640 1 -- 172.21.15.5:0/4214131332 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945280543 0 0) 0x7fdc540bbd20 con 0x7fdc540b9ee0 2024-05-16T22:34:03.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.389+0000 7fdc58fc3640 1 -- 172.21.15.5:0/4214131332 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc540bba80 con 0x7fdc540b9ee0 2024-05-16T22:34:03.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.389+0000 7fdc58fc3640 1 -- 172.21.15.5:0/4214131332 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3616363816 0 0) 0x7fdc40003520 con 0x7fdc540b4500 2024-05-16T22:34:03.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.389+0000 7fdc597c4640 1 -- 172.21.15.5:0/4214131332 >> v1:172.21.15.157:6789/0 conn(0x7fdc540b9ee0 legacy=0x7fdc540a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.389+0000 7fdc597c4640 1 -- 172.21.15.5:0/4214131332 >> v1:172.21.15.5:6789/0 conn(0x7fdc540b4500 legacy=0x7fdc5406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.389+0000 7fdc597c4640 1 -- 172.21.15.5:0/4214131332 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc540b5240 con 0x7fdc540bb490 2024-05-16T22:34:03.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.389+0000 7fdc597c4640 1 --2- 172.21.15.5:0/4214131332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540bb490 0x7fdc540b5760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc440097d0 tx=0x7fdc4402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a28f1d24394a8c57 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc58fc3640 1 -- 172.21.15.5:0/4214131332 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44037070 con 0x7fdc540bb490 2024-05-16T22:34:03.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc58fc3640 1 -- 172.21.15.5:0/4214131332 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4402acc0 con 0x7fdc540bb490 2024-05-16T22:34:03.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc58fc3640 1 -- 172.21.15.5:0/4214131332 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50001710 con 0x7fdc540bb490 2024-05-16T22:34:03.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc5c229640 1 -- 172.21.15.5:0/4214131332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540bb490 msgr2=0x7fdc540b5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc5c229640 1 --2- 172.21.15.5:0/4214131332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540bb490 0x7fdc540b5760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc440097d0 tx=0x7fdc4402a230 comp rx=0 tx=0).stop 2024-05-16T22:34:03.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc5c229640 1 -- 172.21.15.5:0/4214131332 shutdown_connections 2024-05-16T22:34:03.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc5c229640 1 --2- 172.21.15.5:0/4214131332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540bb490 0x7fdc540b5760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc5c229640 1 -- 172.21.15.5:0/4214131332 >> 172.21.15.5:0/4214131332 conn(0x7fdc540a1ac0 msgr2=0x7fdc540bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:03.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc5c229640 1 -- 172.21.15.5:0/4214131332 shutdown_connections 2024-05-16T22:34:03.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.390+0000 7fdc5c229640 1 -- 172.21.15.5:0/4214131332 wait complete. 2024-05-16T22:34:03.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.392+0000 7fdc5c229640 1 Processor -- start 2024-05-16T22:34:03.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.392+0000 7fdc5c229640 1 -- start start 2024-05-16T22:34:03.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc5c229640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc540b4500 0x7fdc5409f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc5c229640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540b9ee0 0x7fdc5409e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc5c229640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc540bb490 0x7fdc541e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc5c229640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdc540a46e0 con 0x7fdc540b4500 2024-05-16T22:34:03.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc5c229640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdc540ba2f0 con 0x7fdc540bb490 2024-05-16T22:34:03.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc5c229640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdc540a4860 con 0x7fdc540b9ee0 2024-05-16T22:34:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc59fc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc540b4500 0x7fdc5409f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc59fc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc540b4500 0x7fdc5409f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47650/0 (socket says 172.21.15.5:47650) 2024-05-16T22:34:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc59fc5640 1 -- 172.21.15.5:0/3910096723 learned_addr learned my addr 172.21.15.5:0/3910096723 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc597c4640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540b9ee0 0x7fdc5409e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc5a7c6640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc540bb490 0x7fdc541e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc59fc5640 1 -- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540b9ee0 msgr2=0x7fdc5409e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc59fc5640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540b9ee0 0x7fdc5409e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc59fc5640 1 -- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc540bb490 msgr2=0x7fdc541e4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc59fc5640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc540bb490 0x7fdc541e4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.393+0000 7fdc59fc5640 1 -- 172.21.15.5:0/3910096723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5409fb20 con 0x7fdc540b4500 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.394+0000 7fdc59fc5640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc540b4500 0x7fdc5409f5e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc50007fc0 tx=0x7fdc5000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.394+0000 7fdc4a7fc640 1 -- 172.21.15.5:0/3910096723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500074e0 con 0x7fdc540b4500 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.394+0000 7fdc4a7fc640 1 -- 172.21.15.5:0/3910096723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc50016070 con 0x7fdc540b4500 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.394+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5409b940 con 0x7fdc540b4500 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.394+0000 7fdc4a7fc640 1 -- 172.21.15.5:0/3910096723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50004a20 con 0x7fdc540b4500 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.394+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc54149ee0 con 0x7fdc540b4500 2024-05-16T22:34:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.395+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5409bb10 con 0x7fdc540b4500 2024-05-16T22:34:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.395+0000 7fdc4a7fc640 1 -- 172.21.15.5:0/3910096723 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc50004bc0 con 0x7fdc540b4500 2024-05-16T22:34:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.396+0000 7fdc4a7fc640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdc380762d0 0x7fdc380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.396+0000 7fdc4a7fc640 1 -- 172.21.15.5:0/3910096723 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fdc50098df0 con 0x7fdc540b4500 2024-05-16T22:34:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.396+0000 7fdc597c4640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdc380762d0 0x7fdc380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.397+0000 7fdc597c4640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdc380762d0 0x7fdc380787e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdc44034000 tx=0x7fdc4402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.401+0000 7fdc4a7fc640 1 -- 172.21.15.5:0/3910096723 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc50062300 con 0x7fdc540b4500 2024-05-16T22:34:03.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.590+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fdc540a01d0 con 0x7fdc380762d0 2024-05-16T22:34:03.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.591+0000 7fdc4a7fc640 1 -- 172.21.15.5:0/3910096723 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc440324c0 con 0x7fdc380762d0 2024-05-16T22:34:03.590 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-05-16T22:34:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdc380762d0 msgr2=0x7fdc380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdc380762d0 0x7fdc380787e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdc44034000 tx=0x7fdc4402e000 comp rx=0 tx=0).stop 2024-05-16T22:34:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc540b4500 msgr2=0x7fdc5409f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc540b4500 0x7fdc5409f5e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc50007fc0 tx=0x7fdc5000c960 comp rx=0 tx=0).stop 2024-05-16T22:34:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 shutdown_connections 2024-05-16T22:34:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdc380762d0 0x7fdc380787e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc540bb490 0x7fdc541e4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc540b9ee0 0x7fdc5409e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 --2- 172.21.15.5:0/3910096723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc540b4500 0x7fdc5409f5e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 >> 172.21.15.5:0/3910096723 conn(0x7fdc540a1ac0 msgr2=0x7fdc540bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:03.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 shutdown_connections 2024-05-16T22:34:03.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.593+0000 7fdc5c229640 1 -- 172.21.15.5:0/3910096723 wait complete. 2024-05-16T22:34:03.603 INFO:tasks.ceph:Scrubbing osd.1 2024-05-16T22:34:03.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-16T22:34:03.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.720+0000 7eff14fb2640 1 Processor -- start 2024-05-16T22:34:03.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.720+0000 7eff14fb2640 1 -- start start 2024-05-16T22:34:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff14fb2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 0x7eff101522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff14fb2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff10148770 0x7eff100c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff14fb2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7eff100bf9b0 0x7eff100bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff14fb2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7eff10151e40 con 0x7eff10148770 2024-05-16T22:34:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff14fb2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7eff100c0620 con 0x7eff100bf9b0 2024-05-16T22:34:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff14fb2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff10151ad0 con 0x7eff1014e360 2024-05-16T22:34:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff07fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff10148770 0x7eff100c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff07fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff10148770 0x7eff100c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47660/0 (socket says 172.21.15.5:47660) 2024-05-16T22:34:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff07fff640 1 -- 172.21.15.5:0/2418372603 learned_addr learned my addr 172.21.15.5:0/2418372603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff0e59c640 1 --2- 172.21.15.5:0/2418372603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 0x7eff101522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff0ed9d640 1 --2- 172.21.15.5:0/2418372603 >> v2:172.21.15.157:3300/0 conn(0x7eff100bf9b0 0x7eff100bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff07fff640 1 -- 172.21.15.5:0/2418372603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 msgr2=0x7eff101522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff07fff640 1 --2- 172.21.15.5:0/2418372603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 0x7eff101522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff07fff640 1 -- 172.21.15.5:0/2418372603 >> v2:172.21.15.157:3300/0 conn(0x7eff100bf9b0 msgr2=0x7eff100bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff07fff640 1 --2- 172.21.15.5:0/2418372603 >> v2:172.21.15.157:3300/0 conn(0x7eff100bf9b0 0x7eff100bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff07fff640 1 -- 172.21.15.5:0/2418372603 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff10152810 con 0x7eff10148770 2024-05-16T22:34:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.721+0000 7eff0ed9d640 1 --2- 172.21.15.5:0/2418372603 >> v2:172.21.15.157:3300/0 conn(0x7eff100bf9b0 0x7eff100bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.722+0000 7eff07fff640 1 --2- 172.21.15.5:0/2418372603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 0x7eff100c0c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efef8009870 tx=0x7efef802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b346ab0efc9659 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.722+0000 7eff0dd9b640 1 -- 172.21.15.5:0/2418372603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8037070 con 0x7eff10148770 2024-05-16T22:34:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.722+0000 7eff0dd9b640 1 -- 172.21.15.5:0/2418372603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef8032440 con 0x7eff10148770 2024-05-16T22:34:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.722+0000 7eff0dd9b640 1 -- 172.21.15.5:0/2418372603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8032810 con 0x7eff10148770 2024-05-16T22:34:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 -- 172.21.15.5:0/2418372603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 msgr2=0x7eff100c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 --2- 172.21.15.5:0/2418372603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 0x7eff100c0c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efef8009870 tx=0x7efef802a2a0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 -- 172.21.15.5:0/2418372603 shutdown_connections 2024-05-16T22:34:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 --2- 172.21.15.5:0/2418372603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 0x7eff100c0c80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 --2- 172.21.15.5:0/2418372603 >> v2:172.21.15.157:3300/0 conn(0x7eff100bf9b0 0x7eff100bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 --2- 172.21.15.5:0/2418372603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 0x7eff101522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 -- 172.21.15.5:0/2418372603 >> 172.21.15.5:0/2418372603 conn(0x7eff100c17c0 msgr2=0x7eff100c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 -- 172.21.15.5:0/2418372603 shutdown_connections 2024-05-16T22:34:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.723+0000 7eff14fb2640 1 -- 172.21.15.5:0/2418372603 wait complete. 2024-05-16T22:34:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.725+0000 7eff14fb2640 1 Processor -- start 2024-05-16T22:34:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.725+0000 7eff14fb2640 1 -- start start 2024-05-16T22:34:03.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff14fb2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff100bf9b0 0x7eff101d7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff14fb2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 0x7eff101e4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff14fb2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 0x7eff101e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff14fb2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff100c1340 con 0x7eff10148770 2024-05-16T22:34:03.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff14fb2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff100c11c0 con 0x7eff100bf9b0 2024-05-16T22:34:03.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff14fb2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff1009fd50 con 0x7eff1014e360 2024-05-16T22:34:03.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 0x7eff101e4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 0x7eff101e4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47676/0 (socket says 172.21.15.5:47676) 2024-05-16T22:34:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 -- 172.21.15.5:0/2737709523 learned_addr learned my addr 172.21.15.5:0/2737709523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff0e59c640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff100bf9b0 0x7eff101d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff0ed9d640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 0x7eff101e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 -- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 msgr2=0x7eff101e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1014e360 0x7eff101e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 -- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff100bf9b0 msgr2=0x7eff101d7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff100bf9b0 0x7eff101d7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 -- 172.21.15.5:0/2737709523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff101d7e70 con 0x7eff10148770 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.726+0000 7eff07fff640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 0x7eff101e4ee0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efef802a2e0 tx=0x7efef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.727+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8041020 con 0x7eff10148770 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.727+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef80306c0 con 0x7eff10148770 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.727+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8037040 con 0x7eff10148770 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.727+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff101e5420 con 0x7eff10148770 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.727+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff100a4270 con 0x7eff10148770 2024-05-16T22:34:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.728+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff10050940 con 0x7eff10148770 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.728+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efef8044020 con 0x7eff10148770 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.729+0000 7eff06ffd640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efef0076300 0x7efef0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.729+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7efef80b7ec0 con 0x7eff10148770 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.729+0000 7eff06ffd640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7efef007c2b0 0x7efef007e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.729+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 --> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efef803ee50 con 0x7efef007c2b0 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.729+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7efef80b8350 con 0x7eff10148770 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.729+0000 7eff0e59c640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efef0076300 0x7efef0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.729+0000 7eff0ed9d640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7efef007c2b0 0x7efef007e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.730+0000 7eff0ed9d640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7efef007c2b0 0x7efef007e700 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.730+0000 7eff0e59c640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efef0076300 0x7efef0078810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff000079a0 tx=0x7eff00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.730+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 <== osd.1 v2:172.21.15.5:6824/1146909345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efef803ee50 con 0x7efef007c2b0 2024-05-16T22:34:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.743+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 --> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7eff10071ba0 con 0x7efef007c2b0 2024-05-16T22:34:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff06ffd640 1 -- 172.21.15.5:0/2737709523 <== osd.1 v2:172.21.15.5:6824/1146909345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7eff10071ba0 con 0x7efef007c2b0 2024-05-16T22:34:03.743 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T22:34:03.743 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T22:34:03.743 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T22:34:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7efef007c2b0 msgr2=0x7efef007e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.5:6824/1146909345,v1:172.21.15.5:6825/1146909345] conn(0x7efef007c2b0 0x7efef007e700 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efef0076300 msgr2=0x7efef0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7efef0076300 0x7efef0078810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff000079a0 tx=0x7eff00008040 comp rx=0 tx=0).stop 2024-05-16T22:34:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 msgr2=0x7eff101e4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 --2- 172.21.15.5:0/2737709523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff10148770 0x7eff101e4ee0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efef802a2e0 tx=0x7efef80046c0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff0ed9d640 1 -- 172.21.15.5:0/2737709523 reap_dead start 2024-05-16T22:34:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 shutdown_connections 2024-05-16T22:34:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 >> 172.21.15.5:0/2737709523 conn(0x7eff100c17c0 msgr2=0x7eff100be5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 shutdown_connections 2024-05-16T22:34:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.744+0000 7eff14fb2640 1 -- 172.21.15.5:0/2737709523 wait complete. 2024-05-16T22:34:03.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-16T22:34:03.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.867+0000 7f0edad34640 1 Processor -- start 2024-05-16T22:34:03.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.867+0000 7f0edad34640 1 -- start start 2024-05-16T22:34:03.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0edad34640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed40bd6d0 0x7f0ed40be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0edad34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ed40bee80 0x7f0ed4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0edad34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed406e140 con 0x7f0ed4151fc0 2024-05-16T22:34:03.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0edad34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed40c36f0 con 0x7f0ed40bee80 2024-05-16T22:34:03.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0edad34640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed4152530 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed92d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ed40bee80 0x7f0ed4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed8ad0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0ed4151fc0 0x7f0ed406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49912/0 (socket says 172.21.15.5:49912) 2024-05-16T22:34:03.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed8ad0640 1 -- 172.21.15.5:0/2267690042 learned_addr learned my addr 172.21.15.5:0/2267690042 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:03.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed3fff640 1 --2- 172.21.15.5:0/2267690042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed40bd6d0 0x7f0ed40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed92d1640 1 -- 172.21.15.5:0/2267690042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed40bd6d0 msgr2=0x7f0ed40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:03.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed92d1640 1 --2- 172.21.15.5:0/2267690042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed40bd6d0 0x7f0ed40be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed92d1640 1 -- 172.21.15.5:0/2267690042 >> v1:172.21.15.5:6789/0 conn(0x7f0ed4151fc0 legacy=0x7f0ed406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed92d1640 1 -- 172.21.15.5:0/2267690042 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed4152810 con 0x7f0ed40bee80 2024-05-16T22:34:03.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.868+0000 7f0ed37fe640 1 -- 172.21.15.5:0/2267690042 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668423855 0 0) 0x7f0ec8001110 con 0x7f0ed4151fc0 2024-05-16T22:34:03.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.869+0000 7f0ed92d1640 1 --2- 172.21.15.5:0/2267690042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bee80 0x7f0ed4158e90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009d90 tx=0x7f0ecc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3dd4684d913e54 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.869+0000 7f0ed37fe640 1 -- 172.21.15.5:0/2267690042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc007740 con 0x7f0ed40bee80 2024-05-16T22:34:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.869+0000 7f0ed37fe640 1 -- 172.21.15.5:0/2267690042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ecc0078e0 con 0x7f0ed40bee80 2024-05-16T22:34:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.869+0000 7f0ed37fe640 1 -- 172.21.15.5:0/2267690042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc007cb0 con 0x7f0ed40bee80 2024-05-16T22:34:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.870+0000 7f0edad34640 1 -- 172.21.15.5:0/2267690042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bee80 msgr2=0x7f0ed4158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.870+0000 7f0edad34640 1 --2- 172.21.15.5:0/2267690042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bee80 0x7f0ed4158e90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009d90 tx=0x7f0ecc02a660 comp rx=0 tx=0).stop 2024-05-16T22:34:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.870+0000 7f0edad34640 1 -- 172.21.15.5:0/2267690042 shutdown_connections 2024-05-16T22:34:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.870+0000 7f0edad34640 1 --2- 172.21.15.5:0/2267690042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bee80 0x7f0ed4158e90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.870+0000 7f0edad34640 1 --2- 172.21.15.5:0/2267690042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed40bd6d0 0x7f0ed40be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.870+0000 7f0edad34640 1 -- 172.21.15.5:0/2267690042 >> 172.21.15.5:0/2267690042 conn(0x7f0ed40c3d20 msgr2=0x7f0ed40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.870+0000 7f0edad34640 1 -- 172.21.15.5:0/2267690042 shutdown_connections 2024-05-16T22:34:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.870+0000 7f0edad34640 1 -- 172.21.15.5:0/2267690042 wait complete. 2024-05-16T22:34:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.871+0000 7f0edad34640 1 Processor -- start 2024-05-16T22:34:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.871+0000 7f0edad34640 1 -- start start 2024-05-16T22:34:03.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0edad34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bd6d0 0x7f0ed409dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0edad34640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed40bee80 0x7f0ed409cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0edad34640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed4151fc0 0x7f0ed40a2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0edad34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed40bdae0 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0edad34640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed40c0070 con 0x7f0ed40bee80 2024-05-16T22:34:03.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0edad34640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed40a2ed0 con 0x7f0ed4151fc0 2024-05-16T22:34:03.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bd6d0 0x7f0ed409dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bd6d0 0x7f0ed409dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47694/0 (socket says 172.21.15.5:47694) 2024-05-16T22:34:03.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 -- 172.21.15.5:0/1099983837 learned_addr learned my addr 172.21.15.5:0/1099983837 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:03.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed3fff640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed40bee80 0x7f0ed409cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed92d1640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed4151fc0 0x7f0ed40a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 -- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed4151fc0 msgr2=0x7f0ed40a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed4151fc0 0x7f0ed40a2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 -- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed40bee80 msgr2=0x7f0ed409cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed40bee80 0x7f0ed409cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 -- 172.21.15.5:0/1099983837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed40a2cc0 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed8ad0640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bd6d0 0x7f0ed409dc40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800c410 tx=0x7f0ec800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed17fa640 1 -- 172.21.15.5:0/1099983837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80074e0 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed17fa640 1 -- 172.21.15.5:0/1099983837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec80047e0 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed40b6920 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.873+0000 7f0ed17fa640 1 -- 172.21.15.5:0/1099983837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8004bd0 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.874+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed414eac0 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.875+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed414ec90 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.875+0000 7f0ed17fa640 1 -- 172.21.15.5:0/1099983837 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ec8011070 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.876+0000 7f0ed17fa640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0eb80762d0 0x7f0eb80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:03.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.876+0000 7f0ed17fa640 1 -- 172.21.15.5:0/1099983837 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f0ec8096f60 con 0x7f0ed40bd6d0 2024-05-16T22:34:03.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.876+0000 7f0ed3fff640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0eb80762d0 0x7f0eb80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:03.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.877+0000 7f0ed3fff640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0eb80762d0 0x7f0eb80787e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0006fd0 tx=0x7f0ec0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:03.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:03.881+0000 7f0ed17fa640 1 -- 172.21.15.5:0/1099983837 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ed406e140 con 0x7f0ed40bd6d0 2024-05-16T22:34:04.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.070+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0ed406eb40 con 0x7f0eb80762d0 2024-05-16T22:34:04.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.071+0000 7f0ed17fa640 1 -- 172.21.15.5:0/1099983837 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0ed406eb40 con 0x7f0eb80762d0 2024-05-16T22:34:04.070 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-05-16T22:34:04.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0eb80762d0 msgr2=0x7f0eb80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0eb80762d0 0x7f0eb80787e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0006fd0 tx=0x7f0ec0008040 comp rx=0 tx=0).stop 2024-05-16T22:34:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bd6d0 msgr2=0x7f0ed409dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bd6d0 0x7f0ed409dc40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800c410 tx=0x7f0ec800c8d0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 shutdown_connections 2024-05-16T22:34:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0eb80762d0 0x7f0eb80787e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ed4151fc0 0x7f0ed40a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed40bee80 0x7f0ed409cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 --2- 172.21.15.5:0/1099983837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed40bd6d0 0x7f0ed409dc40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 >> 172.21.15.5:0/1099983837 conn(0x7f0ed40c3d20 msgr2=0x7f0ed40c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:04.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 shutdown_connections 2024-05-16T22:34:04.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.073+0000 7f0edad34640 1 -- 172.21.15.5:0/1099983837 wait complete. 2024-05-16T22:34:04.083 INFO:tasks.ceph:Scrubbing osd.2 2024-05-16T22:34:04.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-16T22:34:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.200+0000 7f4ccf1ce640 1 Processor -- start 2024-05-16T22:34:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.200+0000 7f4ccf1ce640 1 -- start start 2024-05-16T22:34:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4ccf1ce640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4cc814ed70 0x7f4cc8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4ccf1ce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc80ba800 con 0x7f4cc8148910 2024-05-16T22:34:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4ccf1ce640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc80b8a30 con 0x7f4cc80a9060 2024-05-16T22:34:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4ccf1ce640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc80b8d10 con 0x7f4cc814ed70 2024-05-16T22:34:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4cc7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4cc8148910 0x7f4cc814e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49924/0 (socket says 172.21.15.5:49924) 2024-05-16T22:34:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4cc7fff640 1 -- 172.21.15.5:0/1402567027 learned_addr learned my addr 172.21.15.5:0/1402567027 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4ccd76b640 1 --2- 172.21.15.5:0/1402567027 >> v2:172.21.15.157:3300/0 conn(0x7f4cc814ed70 0x7f4cc8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700030641 0 0) 0x7f4cb8001490 con 0x7f4cc8148910 2024-05-16T22:34:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb4003520 con 0x7f4cc8148910 2024-05-16T22:34:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 856621554 0 0) 0x7f4cb4003520 con 0x7f4cc8148910 2024-05-16T22:34:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 >> v2:172.21.15.157:3300/0 conn(0x7f4cc814ed70 msgr2=0x7f4cc8159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4cc77fe640 1 --2- 172.21.15.5:0/1402567027 >> v2:172.21.15.157:3300/0 conn(0x7f4cc814ed70 0x7f4cc8159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.201+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 >> v1:172.21.15.157:6789/0 conn(0x7f4cc80a9060 legacy=0x7f4cc80ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc80b8ff0 con 0x7f4cc8148910 2024-05-16T22:34:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f4cb8001c40 con 0x7f4cc8148910 2024-05-16T22:34:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 >> v1:172.21.15.5:6789/0 conn(0x7f4cc8148910 legacy=0x7f4cc814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cb4003a50 0x7f4cb4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb4004800 0x7f4cb4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4005250 0x7f4cb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc80b8d10 con 0x7f4cb4004800 2024-05-16T22:34:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb400c1d0 con 0x7f4cb4005250 2024-05-16T22:34:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb400c3d0 con 0x7f4cb4003a50 2024-05-16T22:34:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc7fff640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb4004800 0x7f4cb4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4ccd76b640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4005250 0x7f4cb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cccf6a640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cb4003a50 0x7f4cb4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc7fff640 1 -- 172.21.15.5:0/1402567027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cb4003a50 msgr2=0x7f4cb4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc7fff640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cb4003a50 0x7f4cb4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc7fff640 1 -- 172.21.15.5:0/1402567027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4005250 msgr2=0x7f4cb400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc7fff640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4005250 0x7f4cb400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4ccd76b640 1 -- 172.21.15.5:0/1402567027 reap_dead start 2024-05-16T22:34:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.202+0000 7f4cc7fff640 1 -- 172.21.15.5:0/1402567027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb4003520 con 0x7f4cb4004800 2024-05-16T22:34:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.203+0000 7f4cc7fff640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb4004800 0x7f4cb4004c10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800aa60 tx=0x7f4cb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae76ceccba2d2cc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.203+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800a6b0 con 0x7f4cb4004800 2024-05-16T22:34:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.203+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb802f070 con 0x7f4cb4004800 2024-05-16T22:34:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.203+0000 7f4cc77fe640 1 -- 172.21.15.5:0/1402567027 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb802bdb0 con 0x7f4cb4004800 2024-05-16T22:34:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.204+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1402567027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb4004800 msgr2=0x7f4cb4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.204+0000 7f4ccf1ce640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb4004800 0x7f4cb4004c10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800aa60 tx=0x7f4cb4005830 comp rx=0 tx=0).stop 2024-05-16T22:34:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.204+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1402567027 shutdown_connections 2024-05-16T22:34:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.204+0000 7f4ccf1ce640 1 --2- 172.21.15.5:0/1402567027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb4004800 0x7f4cb4004c10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.204+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1402567027 >> 172.21.15.5:0/1402567027 conn(0x7f4cc80c07c0 msgr2=0x7f4cc80c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.204+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1402567027 shutdown_connections 2024-05-16T22:34:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.204+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1402567027 wait complete. 2024-05-16T22:34:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.205+0000 7f4ccf1ce640 1 Processor -- start 2024-05-16T22:34:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.205+0000 7f4ccf1ce640 1 -- start start 2024-05-16T22:34:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.206+0000 7f4ccf1ce640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4004800 0x7f4cc80c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccf1ce640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cc81d7780 0x7f4cc813e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccf1ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc81d7b90 0x7f4cc81e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccf1ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc808d580 con 0x7f4cc81d7b90 2024-05-16T22:34:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccf1ce640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc808d400 con 0x7f4cb4004800 2024-05-16T22:34:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccf1ce640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc808da30 con 0x7f4cc81d7780 2024-05-16T22:34:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc81d7b90 0x7f4cc81e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc81d7b90 0x7f4cc81e7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47706/0 (socket says 172.21.15.5:47706) 2024-05-16T22:34:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 -- 172.21.15.5:0/1675921249 learned_addr learned my addr 172.21.15.5:0/1675921249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4cccf6a640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4004800 0x7f4cc80c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4cc7fff640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cc81d7780 0x7f4cc813e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 -- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cc81d7780 msgr2=0x7f4cc813e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cc81d7780 0x7f4cc813e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 -- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4004800 msgr2=0x7f4cc80c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4004800 0x7f4cc80c2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 -- 172.21.15.5:0/1675921249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc81e5430 con 0x7f4cc81d7b90 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4cccf6a640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cb4004800 0x7f4cc80c2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccd76b640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc81d7b90 0x7f4cc81e7a50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4cc814c140 tx=0x7f4cb0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0004030 con 0x7f4cc81d7b90 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb001b070 con 0x7f4cc81d7b90 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0004430 con 0x7f4cc81d7b90 2024-05-16T22:34:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc80c27a0 con 0x7f4cc81d7b90 2024-05-16T22:34:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.207+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81e4e70 con 0x7f4cc81d7b90 2024-05-16T22:34:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.208+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4cc81e49b0 con 0x7f4cc81d7b90 2024-05-16T22:34:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.209+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4cb0012040 con 0x7f4cc81d7b90 2024-05-16T22:34:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cc57fa640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4ca80762d0 0x7f4ca80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f4cb0097f00 con 0x7f4cc81d7b90 2024-05-16T22:34:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cc57fa640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f4ca807c280 0x7f4ca807e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cb0020e50 con 0x7f4ca807c280 2024-05-16T22:34:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4cb0098390 con 0x7f4cc81d7b90 2024-05-16T22:34:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cc7fff640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f4ca807c280 0x7f4ca807e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cccf6a640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4ca80762d0 0x7f4ca80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cc7fff640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f4ca807c280 0x7f4ca807e6d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.210+0000 7f4cccf6a640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4ca80762d0 0x7f4ca80787e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0003790 tx=0x7f4cc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.211+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 <== osd.2 v2:172.21.15.5:6816/2608436175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4cb0020e50 con 0x7f4ca807c280 2024-05-16T22:34:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.224+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 --> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4cc80ba9e0 con 0x7f4ca807c280 2024-05-16T22:34:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4cc57fa640 1 -- 172.21.15.5:0/1675921249 <== osd.2 v2:172.21.15.5:6816/2608436175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4cc80ba9e0 con 0x7f4ca807c280 2024-05-16T22:34:04.224 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T22:34:04.224 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T22:34:04.224 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T22:34:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f4ca807c280 msgr2=0x7f4ca807e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.5:6816/2608436175,v1:172.21.15.5:6817/2608436175] conn(0x7f4ca807c280 0x7f4ca807e6d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4ca80762d0 msgr2=0x7f4ca80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f4ca80762d0 0x7f4ca80787e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0003790 tx=0x7f4cc0009040 comp rx=0 tx=0).stop 2024-05-16T22:34:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc81d7b90 msgr2=0x7f4cc81e7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 --2- 172.21.15.5:0/1675921249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc81d7b90 0x7f4cc81e7a50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4cc814c140 tx=0x7f4cb0011cf0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccd76b640 1 -- 172.21.15.5:0/1675921249 reap_dead start 2024-05-16T22:34:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 shutdown_connections 2024-05-16T22:34:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 >> 172.21.15.5:0/1675921249 conn(0x7f4cc80c07c0 msgr2=0x7f4cc80c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 shutdown_connections 2024-05-16T22:34:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.225+0000 7f4ccf1ce640 1 -- 172.21.15.5:0/1675921249 wait complete. 2024-05-16T22:34:04.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-16T22:34:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.348+0000 7f7202b84640 1 Processor -- start 2024-05-16T22:34:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.348+0000 7f7202b84640 1 -- start start 2024-05-16T22:34:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f7202b84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 0x7f71fc14b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f7202b84640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71fc0bb700 con 0x7f71fc14bb90 2024-05-16T22:34:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f7202b84640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71fc0a5b60 con 0x7f71fc145580 2024-05-16T22:34:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f7202b84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc0bcf10 con 0x7f71fc0bcb00 2024-05-16T22:34:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f7201121640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f71fc14bb90 0x7f71fc155a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49938/0 (socket says 172.21.15.5:49938) 2024-05-16T22:34:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f7201121640 1 -- 172.21.15.5:0/3962026006 learned_addr learned my addr 172.21.15.5:0/3962026006 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fbfff640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 0x7f71fc14b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516881474 0 0) 0x7f71ec001110 con 0x7f71fc14bb90 2024-05-16T22:34:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e8003520 con 0x7f71fc14bb90 2024-05-16T22:34:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2386847895 0 0) 0x7f71e8003520 con 0x7f71fc14bb90 2024-05-16T22:34:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 msgr2=0x7f71fc14b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fb7fe640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 0x7f71fc14b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 >> v1:172.21.15.157:6789/0 conn(0x7f71fc145580 legacy=0x7f71fc0baff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc14eef0 con 0x7f71fc14bb90 2024-05-16T22:34:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.349+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7f71ec0018c0 con 0x7f71fc14bb90 2024-05-16T22:34:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 >> v1:172.21.15.5:6789/0 conn(0x7f71fc14bb90 legacy=0x7f71fc155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fb7fe640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71e8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fb7fe640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 0x7f71e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fb7fe640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71e8004d40 0x7f71e80051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc0bcf10 con 0x7f71e8003a30 2024-05-16T22:34:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f71e800bb80 con 0x7f71e8004d40 2024-05-16T22:34:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f71e800df90 con 0x7f71fc0bcb00 2024-05-16T22:34:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f7200920640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71e8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fbfff640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 0x7f71e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f7201121640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71e8004d40 0x7f71e80051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f7200920640 1 -- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 msgr2=0x7f71e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f7200920640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 0x7f71e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f7200920640 1 -- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71e8004d40 msgr2=0x7f71e80051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f7200920640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71e8004d40 0x7f71e80051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f7200920640 1 -- 172.21.15.5:0/3962026006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e8003520 con 0x7f71e8003a30 2024-05-16T22:34:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.350+0000 7f71fbfff640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc0bcb00 0x7f71e8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f7200920640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71e8003ea0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f71f4001e90 tx=0x7f71e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce15be37b2a2c66c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4001ab0 con 0x7f71e8003a30 2024-05-16T22:34:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f402ae50 con 0x7f71e8003a30 2024-05-16T22:34:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f71fb7fe640 1 -- 172.21.15.5:0/3962026006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4003b70 con 0x7f71e8003a30 2024-05-16T22:34:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f7202b84640 1 -- 172.21.15.5:0/3962026006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 msgr2=0x7f71e8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f7202b84640 1 --2- 172.21.15.5:0/3962026006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71e8003ea0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f71f4001e90 tx=0x7f71e8005830 comp rx=0 tx=0).stop 2024-05-16T22:34:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f7201121640 1 -- 172.21.15.5:0/3962026006 reap_dead start 2024-05-16T22:34:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f7202b84640 1 -- 172.21.15.5:0/3962026006 shutdown_connections 2024-05-16T22:34:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.351+0000 7f7202b84640 1 -- 172.21.15.5:0/3962026006 >> 172.21.15.5:0/3962026006 conn(0x7f71fc0bd0f0 msgr2=0x7f71fc0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.352+0000 7f7202b84640 1 -- 172.21.15.5:0/3962026006 shutdown_connections 2024-05-16T22:34:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.352+0000 7f7202b84640 1 -- 172.21.15.5:0/3962026006 wait complete. 2024-05-16T22:34:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.353+0000 7f7202b84640 1 Processor -- start 2024-05-16T22:34:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.353+0000 7f7202b84640 1 -- start start 2024-05-16T22:34:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.354+0000 7f7202b84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71fc0b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.354+0000 7f7202b84640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71fc14cb90 0x7f71fc1437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.354+0000 7f7202b84640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc143cf0 0x7f71fc1e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.354+0000 7f7202b84640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc14bfa0 con 0x7f71e8003a30 2024-05-16T22:34:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.354+0000 7f7202b84640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc14f4b0 con 0x7f71fc14cb90 2024-05-16T22:34:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.354+0000 7f7202b84640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc0c0240 con 0x7f71fc143cf0 2024-05-16T22:34:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.354+0000 7f7200920640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71fc0b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.354+0000 7f7200920640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71fc0b9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47726/0 (socket says 172.21.15.5:47726) 2024-05-16T22:34:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7200920640 1 -- 172.21.15.5:0/1648892609 learned_addr learned my addr 172.21.15.5:0/1648892609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f71fbfff640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71fc14cb90 0x7f71fc1437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7201121640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc143cf0 0x7f71fc1e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7200920640 1 -- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc143cf0 msgr2=0x7f71fc1e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7200920640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc143cf0 0x7f71fc1e7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7200920640 1 -- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71fc14cb90 msgr2=0x7f71fc1437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7200920640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71fc14cb90 0x7f71fc1437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7200920640 1 -- 172.21.15.5:0/1648892609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc14e170 con 0x7f71e8003a30 2024-05-16T22:34:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7200920640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71fc0b9c00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f71f4001e90 tx=0x7f71f40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f71f97fa640 1 -- 172.21.15.5:0/1648892609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4040030 con 0x7f71e8003a30 2024-05-16T22:34:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f71f97fa640 1 -- 172.21.15.5:0/1648892609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f402ac50 con 0x7f71e8003a30 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f71f97fa640 1 -- 172.21.15.5:0/1648892609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4007df0 con 0x7f71e8003a30 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc0ba140 con 0x7f71e8003a30 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.355+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc1e4cb0 con 0x7f71e8003a30 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.356+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc0c0030 con 0x7f71e8003a30 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.357+0000 7f71f97fa640 1 -- 172.21.15.5:0/1648892609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f71f4043070 con 0x7f71e8003a30 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.357+0000 7f71f97fa640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f71dc0762d0 0x7f71dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.358+0000 7f71f97fa640 1 -- 172.21.15.5:0/1648892609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f71f40b7570 con 0x7f71e8003a30 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.358+0000 7f71fbfff640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f71dc0762d0 0x7f71dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.358+0000 7f71fbfff640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f71dc0762d0 0x7f71dc0787e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009160 tx=0x7f71e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.362+0000 7f71f97fa640 1 -- 172.21.15.5:0/1648892609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f71fc0c0030 con 0x7f71e8003a30 2024-05-16T22:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.553+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f71fc148800 con 0x7f71dc0762d0 2024-05-16T22:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.554+0000 7f71f97fa640 1 -- 172.21.15.5:0/1648892609 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f71e4004030 con 0x7f71dc0762d0 2024-05-16T22:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-05-16T22:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f71dc0762d0 msgr2=0x7f71dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f71dc0762d0 0x7f71dc0787e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009160 tx=0x7f71e4008040 comp rx=0 tx=0).stop 2024-05-16T22:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 msgr2=0x7f71fc0b9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71fc0b9c00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f71f4001e90 tx=0x7f71f40014a0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 shutdown_connections 2024-05-16T22:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f71dc0762d0 0x7f71dc0787e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71fc143cf0 0x7f71fc1e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71fc14cb90 0x7f71fc1437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 --2- 172.21.15.5:0/1648892609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71e8003a30 0x7f71fc0b9c00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 >> 172.21.15.5:0/1648892609 conn(0x7f71fc0bd0f0 msgr2=0x7f71fc073090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 shutdown_connections 2024-05-16T22:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.556+0000 7f7202b84640 1 -- 172.21.15.5:0/1648892609 wait complete. 2024-05-16T22:34:04.566 INFO:tasks.ceph:Scrubbing osd.3 2024-05-16T22:34:04.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-16T22:34:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.683+0000 7fab49a13640 1 Processor -- start 2024-05-16T22:34:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.683+0000 7fab49a13640 1 -- start start 2024-05-16T22:34:04.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab49a13640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab44151fc0 0x7fab440bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab49a13640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fab4406da30 0x7fab440be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab49a13640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406de40 0x7fab440bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab49a13640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fab440bdc10 con 0x7fab44151fc0 2024-05-16T22:34:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab49a13640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fab440c36f0 con 0x7fab4406da30 2024-05-16T22:34:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab49a13640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fab44152530 con 0x7fab4406de40 2024-05-16T22:34:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab42ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab44151fc0 0x7fab440bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab42ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab44151fc0 0x7fab440bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47728/0 (socket says 172.21.15.5:47728) 2024-05-16T22:34:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab42ffd640 1 -- 172.21.15.5:0/1526620182 learned_addr learned my addr 172.21.15.5:0/1526620182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab437fe640 1 --2- 172.21.15.5:0/1526620182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406de40 0x7fab440bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab427fc640 1 --2- 172.21.15.5:0/1526620182 >> v2:172.21.15.157:3300/0 conn(0x7fab4406da30 0x7fab440be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.684+0000 7fab42ffd640 1 -- 172.21.15.5:0/1526620182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406de40 msgr2=0x7fab440bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab42ffd640 1 --2- 172.21.15.5:0/1526620182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406de40 0x7fab440bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab42ffd640 1 -- 172.21.15.5:0/1526620182 >> v2:172.21.15.157:3300/0 conn(0x7fab4406da30 msgr2=0x7fab440be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab42ffd640 1 --2- 172.21.15.5:0/1526620182 >> v2:172.21.15.157:3300/0 conn(0x7fab4406da30 0x7fab440be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab42ffd640 1 -- 172.21.15.5:0/1526620182 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44152810 con 0x7fab44151fc0 2024-05-16T22:34:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab427fc640 1 --2- 172.21.15.5:0/1526620182 >> v2:172.21.15.157:3300/0 conn(0x7fab4406da30 0x7fab440be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab42ffd640 1 --2- 172.21.15.5:0/1526620182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab44151fc0 0x7fab440bd6d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab440c38d0 tx=0x7fab3402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae77b103ae36185 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab41ffb640 1 -- 172.21.15.5:0/1526620182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34037070 con 0x7fab44151fc0 2024-05-16T22:34:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab41ffb640 1 -- 172.21.15.5:0/1526620182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab34032440 con 0x7fab44151fc0 2024-05-16T22:34:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.685+0000 7fab41ffb640 1 -- 172.21.15.5:0/1526620182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34032810 con 0x7fab44151fc0 2024-05-16T22:34:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 -- 172.21.15.5:0/1526620182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab44151fc0 msgr2=0x7fab440bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 --2- 172.21.15.5:0/1526620182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab44151fc0 0x7fab440bd6d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab440c38d0 tx=0x7fab3402a1c0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 -- 172.21.15.5:0/1526620182 shutdown_connections 2024-05-16T22:34:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 --2- 172.21.15.5:0/1526620182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406de40 0x7fab440bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 --2- 172.21.15.5:0/1526620182 >> v2:172.21.15.157:3300/0 conn(0x7fab4406da30 0x7fab440be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 --2- 172.21.15.5:0/1526620182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab44151fc0 0x7fab440bd6d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 -- 172.21.15.5:0/1526620182 >> 172.21.15.5:0/1526620182 conn(0x7fab440c3d20 msgr2=0x7fab440c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 -- 172.21.15.5:0/1526620182 shutdown_connections 2024-05-16T22:34:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.686+0000 7fab49a13640 1 -- 172.21.15.5:0/1526620182 wait complete. 2024-05-16T22:34:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.688+0000 7fab49a13640 1 Processor -- start 2024-05-16T22:34:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.688+0000 7fab49a13640 1 -- start start 2024-05-16T22:34:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab49a13640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406da30 0x7fab440baea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab49a13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab4406de40 0x7fab440b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab49a13640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab44151fc0 0x7fab441e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab49a13640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fab440a3050 con 0x7fab4406de40 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab49a13640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fab440a2ed0 con 0x7fab44151fc0 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab49a13640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fab4414e570 con 0x7fab4406da30 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab427fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab4406de40 0x7fab440b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab427fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab4406de40 0x7fab440b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47736/0 (socket says 172.21.15.5:47736) 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab427fc640 1 -- 172.21.15.5:0/382019571 learned_addr learned my addr 172.21.15.5:0/382019571 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab42ffd640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406da30 0x7fab440baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.689+0000 7fab437fe640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab44151fc0 0x7fab441e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab427fc640 1 -- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406da30 msgr2=0x7fab440baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab427fc640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab4406da30 0x7fab440baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab427fc640 1 -- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab44151fc0 msgr2=0x7fab441e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab427fc640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab44151fc0 0x7fab441e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab427fc640 1 -- 172.21.15.5:0/382019571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab440bc890 con 0x7fab4406de40 2024-05-16T22:34:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab427fc640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab4406de40 0x7fab440b5940 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab3800d5a0 tx=0x7fab3800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38004030 con 0x7fab4406de40 2024-05-16T22:34:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab380041d0 con 0x7fab4406de40 2024-05-16T22:34:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab440bba40 con 0x7fab4406de40 2024-05-16T22:34:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38014620 con 0x7fab4406de40 2024-05-16T22:34:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.690+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab441e4980 con 0x7fab4406de40 2024-05-16T22:34:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.691+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab44151770 con 0x7fab4406de40 2024-05-16T22:34:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.691+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab380147c0 con 0x7fab4406de40 2024-05-16T22:34:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.692+0000 7fab2bfff640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fab300762d0 0x7fab300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.692+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fab380978d0 con 0x7fab4406de40 2024-05-16T22:34:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.692+0000 7fab2bfff640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7fab3007c280 0x7fab3007e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.692+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab3007eda0 con 0x7fab3007c280 2024-05-16T22:34:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.692+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fab3809c2c0 con 0x7fab4406de40 2024-05-16T22:34:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.692+0000 7fab42ffd640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fab300762d0 0x7fab300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.692+0000 7fab437fe640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7fab3007c280 0x7fab3007e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.693+0000 7fab437fe640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7fab3007c280 0x7fab3007e6d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.693+0000 7fab42ffd640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fab300762d0 0x7fab300787e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fab34034000 tx=0x7fab3402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.693+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 <== osd.3 v2:172.21.15.5:6808/1040173321 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab3007eda0 con 0x7fab3007c280 2024-05-16T22:34:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.706+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 --> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fab44050940 con 0x7fab3007c280 2024-05-16T22:34:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab2bfff640 1 -- 172.21.15.5:0/382019571 <== osd.3 v2:172.21.15.5:6808/1040173321 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fab44050940 con 0x7fab3007c280 2024-05-16T22:34:04.706 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T22:34:04.706 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T22:34:04.706 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T22:34:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7fab3007c280 msgr2=0x7fab3007e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.5:6808/1040173321,v1:172.21.15.5:6809/1040173321] conn(0x7fab3007c280 0x7fab3007e6d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fab300762d0 msgr2=0x7fab300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fab300762d0 0x7fab300787e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fab34034000 tx=0x7fab3402e000 comp rx=0 tx=0).stop 2024-05-16T22:34:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab4406de40 msgr2=0x7fab440b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 --2- 172.21.15.5:0/382019571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab4406de40 0x7fab440b5940 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab3800d5a0 tx=0x7fab3800da60 comp rx=0 tx=0).stop 2024-05-16T22:34:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab437fe640 1 -- 172.21.15.5:0/382019571 reap_dead start 2024-05-16T22:34:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 shutdown_connections 2024-05-16T22:34:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 >> 172.21.15.5:0/382019571 conn(0x7fab440c3d20 msgr2=0x7fab440c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 shutdown_connections 2024-05-16T22:34:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.707+0000 7fab49a13640 1 -- 172.21.15.5:0/382019571 wait complete. 2024-05-16T22:34:04.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-16T22:34:04.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.830+0000 7fdaf73d6640 1 Processor -- start 2024-05-16T22:34:04.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.830+0000 7fdaf73d6640 1 -- start start 2024-05-16T22:34:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdaf73d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf00b4500 0x7fdaf00b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdaf73d6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf00bba80 con 0x7fdaf00bb490 2024-05-16T22:34:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdaf73d6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf00bbd20 con 0x7fdaf00b9ee0 2024-05-16T22:34:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdaf73d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf00b4f60 con 0x7fdaf00b4500 2024-05-16T22:34:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdaf4971640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdaf00bb490 0x7fdaf006faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49952/0 (socket says 172.21.15.5:49952) 2024-05-16T22:34:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdaf4971640 1 -- 172.21.15.5:0/2081503355 learned_addr learned my addr 172.21.15.5:0/2081503355 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379500951 0 0) 0x7fdaf00bba80 con 0x7fdaf00bb490 2024-05-16T22:34:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdadc003520 con 0x7fdaf00bb490 2024-05-16T22:34:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.831+0000 7fdaf5172640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf00b4500 0x7fdaf00b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4242639251 0 0) 0x7fdadc003520 con 0x7fdaf00bb490 2024-05-16T22:34:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf00b4500 msgr2=0x7fdaf00b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf00b4500 0x7fdaf00b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 >> v1:172.21.15.157:6789/0 conn(0x7fdaf00b9ee0 legacy=0x7fdaf00a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf00b5240 con 0x7fdaf00bb490 2024-05-16T22:34:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3452093673 0 0) 0x7fdae0001710 con 0x7fdaf00bb490 2024-05-16T22:34:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 >> v1:172.21.15.5:6789/0 conn(0x7fdaf00bb490 legacy=0x7fdaf006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdadc0039e0 0x7fdadc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdadc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf00b4500 0x7fdadc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00b4f60 con 0x7fdadc004800 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc00baf0 con 0x7fdadc0039e0 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdadc00bcf0 con 0x7fdaf00b4500 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdaf4971640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdadc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdaf5172640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdadc0039e0 0x7fdadc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdaf5973640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf00b4500 0x7fdadc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdaf4971640 1 -- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf00b4500 msgr2=0x7fdadc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdaf4971640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf00b4500 0x7fdadc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdaf4971640 1 -- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdadc0039e0 msgr2=0x7fdadc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdaf4971640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdadc0039e0 0x7fdadc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.832+0000 7fdaf4971640 1 -- 172.21.15.5:0/2081503355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc003520 con 0x7fdadc004800 2024-05-16T22:34:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.833+0000 7fdaf4971640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdadc004c10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdae000c240 tx=0x7fdadc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382db54920fbc0ac server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.833+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0007db0 con 0x7fdadc004800 2024-05-16T22:34:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.833+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae0005ad0 con 0x7fdadc004800 2024-05-16T22:34:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.833+0000 7fdae7fff640 1 -- 172.21.15.5:0/2081503355 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0007070 con 0x7fdadc004800 2024-05-16T22:34:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.834+0000 7fdaf73d6640 1 -- 172.21.15.5:0/2081503355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 msgr2=0x7fdadc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.834+0000 7fdaf73d6640 1 --2- 172.21.15.5:0/2081503355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdadc004c10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdae000c240 tx=0x7fdadc005830 comp rx=0 tx=0).stop 2024-05-16T22:34:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.834+0000 7fdaf5973640 1 -- 172.21.15.5:0/2081503355 reap_dead start 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.834+0000 7fdaf73d6640 1 -- 172.21.15.5:0/2081503355 shutdown_connections 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.834+0000 7fdaf73d6640 1 -- 172.21.15.5:0/2081503355 >> 172.21.15.5:0/2081503355 conn(0x7fdaf00a1ac0 msgr2=0x7fdaf00bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.834+0000 7fdaf73d6640 1 -- 172.21.15.5:0/2081503355 shutdown_connections 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.834+0000 7fdaf73d6640 1 -- 172.21.15.5:0/2081503355 wait complete. 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.835+0000 7fdaf73d6640 1 Processor -- start 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.836+0000 7fdaf73d6640 1 -- start start 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf73d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdaf00b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf73d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaf01e46b0 0x7fdaf01407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf73d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf0140ce0 0x7fdaf009b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf73d6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00a46e0 con 0x7fdadc004800 2024-05-16T22:34:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf73d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00ba2f0 con 0x7fdaf01e46b0 2024-05-16T22:34:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf73d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf00a4860 con 0x7fdaf0140ce0 2024-05-16T22:34:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdaf00b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdaf00b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47746/0 (socket says 172.21.15.5:47746) 2024-05-16T22:34:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 -- 172.21.15.5:0/4113677526 learned_addr learned my addr 172.21.15.5:0/4113677526 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf4971640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaf01e46b0 0x7fdaf01407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5973640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf0140ce0 0x7fdaf009b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 -- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf0140ce0 msgr2=0x7fdaf009b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf0140ce0 0x7fdaf009b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 -- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaf01e46b0 msgr2=0x7fdaf01407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaf01e46b0 0x7fdaf01407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 -- 172.21.15.5:0/4113677526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf00b8300 con 0x7fdadc004800 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf5172640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdaf00b7dc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdaec011a00 tx=0x7fdaec011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdae5ffb640 1 -- 172.21.15.5:0/4113677526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00faf0 con 0x7fdadc004800 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdae5ffb640 1 -- 172.21.15.5:0/4113677526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaec00fc90 con 0x7fdadc004800 2024-05-16T22:34:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf009f400 con 0x7fdadc004800 2024-05-16T22:34:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.837+0000 7fdae5ffb640 1 -- 172.21.15.5:0/4113677526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec014440 con 0x7fdadc004800 2024-05-16T22:34:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.838+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf00a0c70 con 0x7fdadc004800 2024-05-16T22:34:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.839+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf009f040 con 0x7fdadc004800 2024-05-16T22:34:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.839+0000 7fdae5ffb640 1 -- 172.21.15.5:0/4113677526 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdaec012040 con 0x7fdadc004800 2024-05-16T22:34:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.840+0000 7fdae5ffb640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdad40762d0 0x7fdad40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.840+0000 7fdae5ffb640 1 -- 172.21.15.5:0/4113677526 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fdaec0979d0 con 0x7fdadc004800 2024-05-16T22:34:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.840+0000 7fdaf4971640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdad40762d0 0x7fdad40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.841+0000 7fdaf4971640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdad40762d0 0x7fdad40787e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdae0032000 tx=0x7fdae0007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:04.845+0000 7fdae5ffb640 1 -- 172.21.15.5:0/4113677526 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdaec019030 con 0x7fdadc004800 2024-05-16T22:34:05.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.038+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fdaf00a07e0 con 0x7fdad40762d0 2024-05-16T22:34:05.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.039+0000 7fdae5ffb640 1 -- 172.21.15.5:0/4113677526 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdaf00a07e0 con 0x7fdad40762d0 2024-05-16T22:34:05.038 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-05-16T22:34:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdad40762d0 msgr2=0x7fdad40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdad40762d0 0x7fdad40787e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdae0032000 tx=0x7fdae0007000 comp rx=0 tx=0).stop 2024-05-16T22:34:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 msgr2=0x7fdaf00b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdaf00b7dc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdaec011a00 tx=0x7fdaec011ec0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 shutdown_connections 2024-05-16T22:34:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fdad40762d0 0x7fdad40787e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaf0140ce0 0x7fdaf009b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaf01e46b0 0x7fdaf01407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 --2- 172.21.15.5:0/4113677526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdadc004800 0x7fdaf00b7dc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.041+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 >> 172.21.15.5:0/4113677526 conn(0x7fdaf00a1ac0 msgr2=0x7fdaf00a3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.042+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 shutdown_connections 2024-05-16T22:34:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.042+0000 7fdaf73d6640 1 -- 172.21.15.5:0/4113677526 wait complete. 2024-05-16T22:34:05.051 INFO:tasks.ceph:Scrubbing osd.4 2024-05-16T22:34:05.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-16T22:34:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.168+0000 7fa6b131c640 1 Processor -- start 2024-05-16T22:34:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.168+0000 7fa6b131c640 1 -- start start 2024-05-16T22:34:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.169+0000 7fa6b131c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 0x7fa6ac0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.169+0000 7fa6b131c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ac0c36f0 con 0x7fa6ac06da30 2024-05-16T22:34:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.169+0000 7fa6b131c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ac152530 con 0x7fa6ac0bf050 2024-05-16T22:34:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.169+0000 7fa6b131c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac0bdc10 con 0x7fa6ac151fc0 2024-05-16T22:34:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.169+0000 7fa6a3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6ac06da30 0x7fa6ac0be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49954/0 (socket says 172.21.15.5:49954) 2024-05-16T22:34:05.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.169+0000 7fa6a3fff640 1 -- 172.21.15.5:0/4117172675 learned_addr learned my addr 172.21.15.5:0/4117172675 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.169+0000 7fa6aaffd640 1 --2- 172.21.15.5:0/4117172675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 0x7fa6ac0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.170+0000 7fa6aa7fc640 1 -- 172.21.15.5:0/4117172675 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161228209 0 0) 0x7fa6ac0c36f0 con 0x7fa6ac06da30 2024-05-16T22:34:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.170+0000 7fa6aa7fc640 1 -- 172.21.15.5:0/4117172675 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa698003520 con 0x7fa6ac06da30 2024-05-16T22:34:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.170+0000 7fa6aa7fc640 1 -- 172.21.15.5:0/4117172675 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890603694 0 0) 0x7fa6ac152530 con 0x7fa6ac0bf050 2024-05-16T22:34:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.170+0000 7fa6aa7fc640 1 -- 172.21.15.5:0/4117172675 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6ac0c36f0 con 0x7fa6ac0bf050 2024-05-16T22:34:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.170+0000 7fa6aaffd640 1 -- 172.21.15.5:0/4117172675 >> v1:172.21.15.157:6789/0 conn(0x7fa6ac0bf050 legacy=0x7fa6ac158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.170+0000 7fa6aa7fc640 1 -- 172.21.15.5:0/4117172675 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2709517358 0 0) 0x7fa698003520 con 0x7fa6ac06da30 2024-05-16T22:34:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.170+0000 7fa6aaffd640 1 -- 172.21.15.5:0/4117172675 >> v1:172.21.15.5:6789/0 conn(0x7fa6ac06da30 legacy=0x7fa6ac0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.170+0000 7fa6aaffd640 1 -- 172.21.15.5:0/4117172675 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac152810 con 0x7fa6ac151fc0 2024-05-16T22:34:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.171+0000 7fa6aaffd640 1 --2- 172.21.15.5:0/4117172675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 0x7fa6ac0bd6d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0097d0 tx=0x7fa69c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcf7c979ebbc7a4a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.171+0000 7fa6aa7fc640 1 -- 172.21.15.5:0/4117172675 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c037070 con 0x7fa6ac151fc0 2024-05-16T22:34:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.171+0000 7fa6aa7fc640 1 -- 172.21.15.5:0/4117172675 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69c02ab90 con 0x7fa6ac151fc0 2024-05-16T22:34:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.171+0000 7fa6aa7fc640 1 -- 172.21.15.5:0/4117172675 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6940016f0 con 0x7fa6ac151fc0 2024-05-16T22:34:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.172+0000 7fa6b131c640 1 -- 172.21.15.5:0/4117172675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 msgr2=0x7fa6ac0bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.172+0000 7fa6b131c640 1 --2- 172.21.15.5:0/4117172675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 0x7fa6ac0bd6d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0097d0 tx=0x7fa69c02a100 comp rx=0 tx=0).stop 2024-05-16T22:34:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.172+0000 7fa6b131c640 1 -- 172.21.15.5:0/4117172675 shutdown_connections 2024-05-16T22:34:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.172+0000 7fa6b131c640 1 --2- 172.21.15.5:0/4117172675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 0x7fa6ac0bd6d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.172+0000 7fa6b131c640 1 -- 172.21.15.5:0/4117172675 >> 172.21.15.5:0/4117172675 conn(0x7fa6ac0c3d20 msgr2=0x7fa6ac0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.172+0000 7fa6b131c640 1 -- 172.21.15.5:0/4117172675 shutdown_connections 2024-05-16T22:34:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.172+0000 7fa6b131c640 1 -- 172.21.15.5:0/4117172675 wait complete. 2024-05-16T22:34:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.173+0000 7fa6b131c640 1 Processor -- start 2024-05-16T22:34:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.173+0000 7fa6b131c640 1 -- start start 2024-05-16T22:34:05.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6b131c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ac06da30 0x7fa6ac14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6b131c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6ac0bf050 0x7fa6ac14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6b131c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 0x7fa6ac14b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6b131c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0a3050 con 0x7fa6ac0bf050 2024-05-16T22:34:05.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6b131c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0a2ed0 con 0x7fa6ac06da30 2024-05-16T22:34:05.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6b131c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac06de40 con 0x7fa6ac151fc0 2024-05-16T22:34:05.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6ac0bf050 0x7fa6ac14b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6ac0bf050 0x7fa6ac14b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47762/0 (socket says 172.21.15.5:47762) 2024-05-16T22:34:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6a3fff640 1 -- 172.21.15.5:0/2184231961 learned_addr learned my addr 172.21.15.5:0/2184231961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6aaffd640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ac06da30 0x7fa6ac14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.174+0000 7fa6ab7fe640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 0x7fa6ac14b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a3fff640 1 -- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 msgr2=0x7fa6ac14b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a3fff640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6ac151fc0 0x7fa6ac14b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a3fff640 1 -- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ac06da30 msgr2=0x7fa6ac14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a3fff640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6ac06da30 0x7fa6ac14eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a3fff640 1 -- 172.21.15.5:0/2184231961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac14eff0 con 0x7fa6ac0bf050 2024-05-16T22:34:05.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a3fff640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6ac0bf050 0x7fa6ac14b2d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa69400c490 tx=0x7fa69400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694017070 con 0x7fa6ac0bf050 2024-05-16T22:34:05.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa694005ce0 con 0x7fa6ac0bf050 2024-05-16T22:34:05.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6940072b0 con 0x7fa6ac0bf050 2024-05-16T22:34:05.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ac1e86c0 con 0x7fa6ac0bf050 2024-05-16T22:34:05.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.175+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ac1e7900 con 0x7fa6ac0bf050 2024-05-16T22:34:05.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.176+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa6ac0b6c90 con 0x7fa6ac0bf050 2024-05-16T22:34:05.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.177+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa69401a070 con 0x7fa6ac0bf050 2024-05-16T22:34:05.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.177+0000 7fa6a37fe640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa68c076300 0x7fa68c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.177+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fa694096690 con 0x7fa6ac0bf050 2024-05-16T22:34:05.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.178+0000 7fa6a37fe640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7fa68c07c2b0 0x7fa68c07e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.178+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 --> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa68c07edd0 con 0x7fa68c07c2b0 2024-05-16T22:34:05.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.178+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fa69409d050 con 0x7fa6ac0bf050 2024-05-16T22:34:05.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.178+0000 7fa6aaffd640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa68c076300 0x7fa68c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.178+0000 7fa6ab7fe640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7fa68c07c2b0 0x7fa68c07e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.178+0000 7fa6aaffd640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa68c076300 0x7fa68c078810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa69c034000 tx=0x7fa69c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.178+0000 7fa6ab7fe640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7fa68c07c2b0 0x7fa68c07e700 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.179+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 <== osd.4 v2:172.21.15.157:6824/3329892271 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa68c07edd0 con 0x7fa68c07c2b0 2024-05-16T22:34:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.192+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 --> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa6ac0b6ae0 con 0x7fa68c07c2b0 2024-05-16T22:34:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6a37fe640 1 -- 172.21.15.5:0/2184231961 <== osd.4 v2:172.21.15.157:6824/3329892271 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa6ac0b6ae0 con 0x7fa68c07c2b0 2024-05-16T22:34:05.192 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T22:34:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T22:34:05.192 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T22:34:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7fa68c07c2b0 msgr2=0x7fa68c07e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6824/3329892271,v1:172.21.15.157:6825/3329892271] conn(0x7fa68c07c2b0 0x7fa68c07e700 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa68c076300 msgr2=0x7fa68c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fa68c076300 0x7fa68c078810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa69c034000 tx=0x7fa69c02e000 comp rx=0 tx=0).stop 2024-05-16T22:34:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6ac0bf050 msgr2=0x7fa6ac14b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 --2- 172.21.15.5:0/2184231961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6ac0bf050 0x7fa6ac14b2d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa69400c490 tx=0x7fa69400c950 comp rx=0 tx=0).stop 2024-05-16T22:34:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6ab7fe640 1 -- 172.21.15.5:0/2184231961 reap_dead start 2024-05-16T22:34:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 shutdown_connections 2024-05-16T22:34:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 >> 172.21.15.5:0/2184231961 conn(0x7fa6ac0c3d20 msgr2=0x7fa6ac0be940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 shutdown_connections 2024-05-16T22:34:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.193+0000 7fa6b131c640 1 -- 172.21.15.5:0/2184231961 wait complete. 2024-05-16T22:34:05.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-16T22:34:05.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.316+0000 7f5d0d1ea640 1 Processor -- start 2024-05-16T22:34:05.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.316+0000 7f5d0d1ea640 1 -- start start 2024-05-16T22:34:05.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.317+0000 7f5d0d1ea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d080bc1c0 0x7f5d080a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d0d1ea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d08146380 0x7f5d08070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d0d1ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d0814c8e0 0x7f5d0814ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d0d1ea640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5d0814c450 con 0x7f5d080bc1c0 2024-05-16T22:34:05.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d0d1ea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5d0814c120 con 0x7f5d08146380 2024-05-16T22:34:05.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d0d1ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d08071e40 con 0x7f5d0814c8e0 2024-05-16T22:34:05.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d06d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d080bc1c0 0x7f5d080a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d06d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d080bc1c0 0x7f5d080a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47778/0 (socket says 172.21.15.5:47778) 2024-05-16T22:34:05.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d06d9d640 1 -- 172.21.15.5:0/1752429938 learned_addr learned my addr 172.21.15.5:0/1752429938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:05.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d0759e640 1 --2- 172.21.15.5:0/1752429938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d0814c8e0 0x7f5d0814ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d0659c640 1 --2- 172.21.15.5:0/1752429938 >> v2:172.21.15.157:3300/0 conn(0x7f5d08146380 0x7f5d08070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d06d9d640 1 -- 172.21.15.5:0/1752429938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d0814c8e0 msgr2=0x7f5d0814ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:05.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d06d9d640 1 --2- 172.21.15.5:0/1752429938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d0814c8e0 0x7f5d0814ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d06d9d640 1 -- 172.21.15.5:0/1752429938 >> v2:172.21.15.157:3300/0 conn(0x7f5d08146380 msgr2=0x7f5d08070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:05.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d06d9d640 1 --2- 172.21.15.5:0/1752429938 >> v2:172.21.15.157:3300/0 conn(0x7f5d08146380 0x7f5d08070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.318+0000 7f5d06d9d640 1 -- 172.21.15.5:0/1752429938 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d080713d0 con 0x7f5d080bc1c0 2024-05-16T22:34:05.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.319+0000 7f5d06d9d640 1 --2- 172.21.15.5:0/1752429938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d080bc1c0 0x7f5d080a0ba0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5d080bbe80 tx=0x7f5d0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b578434cff4cb06 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.319+0000 7f5d05d9b640 1 -- 172.21.15.5:0/1752429938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00037070 con 0x7f5d080bc1c0 2024-05-16T22:34:05.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.319+0000 7f5d05d9b640 1 -- 172.21.15.5:0/1752429938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d00032440 con 0x7f5d080bc1c0 2024-05-16T22:34:05.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.319+0000 7f5d05d9b640 1 -- 172.21.15.5:0/1752429938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00032810 con 0x7f5d080bc1c0 2024-05-16T22:34:05.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1752429938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d080bc1c0 msgr2=0x7f5d080a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1752429938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d080bc1c0 0x7f5d080a0ba0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5d080bbe80 tx=0x7f5d0002a140 comp rx=0 tx=0).stop 2024-05-16T22:34:05.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1752429938 shutdown_connections 2024-05-16T22:34:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1752429938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d0814c8e0 0x7f5d0814ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1752429938 >> v2:172.21.15.157:3300/0 conn(0x7f5d08146380 0x7f5d08070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1752429938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d080bc1c0 0x7f5d080a0ba0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1752429938 >> 172.21.15.5:0/1752429938 conn(0x7f5d080c17c0 msgr2=0x7f5d080c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1752429938 shutdown_connections 2024-05-16T22:34:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.320+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1752429938 wait complete. 2024-05-16T22:34:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.321+0000 7f5d0d1ea640 1 Processor -- start 2024-05-16T22:34:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.322+0000 7f5d0d1ea640 1 -- start start 2024-05-16T22:34:05.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0d1ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d080bc1c0 0x7f5d0814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0d1ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08146380 0x7f5d0814db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0d1ea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d0814c8e0 0x7f5d0813f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0d1ea640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080bd5f0 con 0x7f5d08146380 2024-05-16T22:34:05.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0d1ea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08146790 con 0x7f5d0814c8e0 2024-05-16T22:34:05.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0d1ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d080bd770 con 0x7f5d080bc1c0 2024-05-16T22:34:05.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08146380 0x7f5d0814db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08146380 0x7f5d0814db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47782/0 (socket says 172.21.15.5:47782) 2024-05-16T22:34:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 -- 172.21.15.5:0/1352991079 learned_addr learned my addr 172.21.15.5:0/1352991079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d06d9d640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d080bc1c0 0x7f5d0814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0759e640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d0814c8e0 0x7f5d0813f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 -- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d080bc1c0 msgr2=0x7f5d0814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d080bc1c0 0x7f5d0814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 -- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d0814c8e0 msgr2=0x7f5d0813f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d0814c8e0 0x7f5d0813f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 -- 172.21.15.5:0/1352991079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0814eab0 con 0x7f5d08146380 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0659c640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08146380 0x7f5d0814db60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000d830 tx=0x7f5cf000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5cff7fe640 1 -- 172.21.15.5:0/1352991079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0018030 con 0x7f5d08146380 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5cff7fe640 1 -- 172.21.15.5:0/1352991079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf000be10 con 0x7f5d08146380 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d080a14e0 con 0x7f5d08146380 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5cff7fe640 1 -- 172.21.15.5:0/1352991079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00098b0 con 0x7f5d08146380 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.323+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d080a4230 con 0x7f5d08146380 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.325+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d08149b20 con 0x7f5d08146380 2024-05-16T22:34:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.325+0000 7f5cff7fe640 1 -- 172.21.15.5:0/1352991079 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5cf001b070 con 0x7f5d08146380 2024-05-16T22:34:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.326+0000 7f5cff7fe640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ce80762d0 0x7f5ce80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.326+0000 7f5cff7fe640 1 -- 172.21.15.5:0/1352991079 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f5cf00973b0 con 0x7f5d08146380 2024-05-16T22:34:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.326+0000 7f5d06d9d640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ce80762d0 0x7f5ce80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.326+0000 7f5d06d9d640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ce80762d0 0x7f5ce80787e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5d00034000 tx=0x7f5d0002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.330+0000 7f5cff7fe640 1 -- 172.21.15.5:0/1352991079 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5cf0060960 con 0x7f5d08146380 2024-05-16T22:34:05.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.520+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5d080a7790 con 0x7f5ce80762d0 2024-05-16T22:34:05.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.520+0000 7f5cff7fe640 1 -- 172.21.15.5:0/1352991079 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5d000326a0 con 0x7f5ce80762d0 2024-05-16T22:34:05.519 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-05-16T22:34:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ce80762d0 msgr2=0x7f5ce80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ce80762d0 0x7f5ce80787e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5d00034000 tx=0x7f5d0002e000 comp rx=0 tx=0).stop 2024-05-16T22:34:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08146380 msgr2=0x7f5d0814db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08146380 0x7f5d0814db60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000d830 tx=0x7f5cf000dcf0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 shutdown_connections 2024-05-16T22:34:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f5ce80762d0 0x7f5ce80787e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d0814c8e0 0x7f5d0813f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08146380 0x7f5d0814db60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 --2- 172.21.15.5:0/1352991079 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d080bc1c0 0x7f5d0814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 >> 172.21.15.5:0/1352991079 conn(0x7f5d080c17c0 msgr2=0x7f5d080c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 shutdown_connections 2024-05-16T22:34:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.522+0000 7f5d0d1ea640 1 -- 172.21.15.5:0/1352991079 wait complete. 2024-05-16T22:34:05.532 INFO:tasks.ceph:Scrubbing osd.5 2024-05-16T22:34:05.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-16T22:34:05.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.649+0000 7fd1867f8640 1 Processor -- start 2024-05-16T22:34:05.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.649+0000 7fd1867f8640 1 -- start start 2024-05-16T22:34:05.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd1867f8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1800a9060 0x7fd180148910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd1867f8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800ba0f0 0x7fd18014e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd1867f8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1800ba500 0x7fd18014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd1867f8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd1800b8a30 con 0x7fd1800a9060 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd1867f8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd1800b8d10 con 0x7fd1800ba500 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd1867f8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd1800b8ff0 con 0x7fd1800ba0f0 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1800a9060 0x7fd180148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1800a9060 0x7fd180148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47796/0 (socket says 172.21.15.5:47796) 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17ffff640 1 -- 172.21.15.5:0/3503579107 learned_addr learned my addr 172.21.15.5:0/3503579107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd184d95640 1 --2- 172.21.15.5:0/3503579107 >> v2:172.21.15.157:3300/0 conn(0x7fd1800ba500 0x7fd18014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17f7fe640 1 --2- 172.21.15.5:0/3503579107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800ba0f0 0x7fd18014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17ffff640 1 -- 172.21.15.5:0/3503579107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800ba0f0 msgr2=0x7fd18014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17ffff640 1 --2- 172.21.15.5:0/3503579107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800ba0f0 0x7fd18014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17ffff640 1 -- 172.21.15.5:0/3503579107 >> v2:172.21.15.157:3300/0 conn(0x7fd1800ba500 msgr2=0x7fd18014eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17ffff640 1 --2- 172.21.15.5:0/3503579107 >> v2:172.21.15.157:3300/0 conn(0x7fd1800ba500 0x7fd18014eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.650+0000 7fd17ffff640 1 -- 172.21.15.5:0/3503579107 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1800b92d0 con 0x7fd1800a9060 2024-05-16T22:34:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.651+0000 7fd17ffff640 1 --2- 172.21.15.5:0/3503579107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800a9060 0x7fd180148910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd1800ba060 tx=0x7fd17002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3b7fc5a59709f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.651+0000 7fd17effd640 1 -- 172.21.15.5:0/3503579107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170037070 con 0x7fd1800a9060 2024-05-16T22:34:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.651+0000 7fd17effd640 1 -- 172.21.15.5:0/3503579107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd170032440 con 0x7fd1800a9060 2024-05-16T22:34:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.651+0000 7fd17effd640 1 -- 172.21.15.5:0/3503579107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170032810 con 0x7fd1800a9060 2024-05-16T22:34:05.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 -- 172.21.15.5:0/3503579107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800a9060 msgr2=0x7fd180148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 --2- 172.21.15.5:0/3503579107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800a9060 0x7fd180148910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd1800ba060 tx=0x7fd17002a270 comp rx=0 tx=0).stop 2024-05-16T22:34:05.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 -- 172.21.15.5:0/3503579107 shutdown_connections 2024-05-16T22:34:05.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 --2- 172.21.15.5:0/3503579107 >> v2:172.21.15.157:3300/0 conn(0x7fd1800ba500 0x7fd18014eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 --2- 172.21.15.5:0/3503579107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800ba0f0 0x7fd18014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 --2- 172.21.15.5:0/3503579107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800a9060 0x7fd180148910 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 -- 172.21.15.5:0/3503579107 >> 172.21.15.5:0/3503579107 conn(0x7fd1800c07c0 msgr2=0x7fd1800c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 -- 172.21.15.5:0/3503579107 shutdown_connections 2024-05-16T22:34:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.652+0000 7fd1867f8640 1 -- 172.21.15.5:0/3503579107 wait complete. 2024-05-16T22:34:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.653+0000 7fd1867f8640 1 Processor -- start 2024-05-16T22:34:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.654+0000 7fd1867f8640 1 -- start start 2024-05-16T22:34:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd1867f8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800a9060 0x7fd1801d9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd1867f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800ba0f0 0x7fd1801462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd1867f8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800ba500 0x7fd1801430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd1867f8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd18008dbb0 con 0x7fd1800ba0f0 2024-05-16T22:34:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd1867f8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd18008da30 con 0x7fd1800ba500 2024-05-16T22:34:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd1867f8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd180151a30 con 0x7fd1800a9060 2024-05-16T22:34:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800ba0f0 0x7fd1801462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800ba0f0 0x7fd1801462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47810/0 (socket says 172.21.15.5:47810) 2024-05-16T22:34:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 -- 172.21.15.5:0/863389969 learned_addr learned my addr 172.21.15.5:0/863389969 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd184d95640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800ba500 0x7fd1801430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17ffff640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800a9060 0x7fd1801d9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 -- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800a9060 msgr2=0x7fd1801d9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1800a9060 0x7fd1801d9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 -- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800ba500 msgr2=0x7fd1801430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1800ba500 0x7fd1801430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 -- 172.21.15.5:0/863389969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1801da310 con 0x7fd1800ba0f0 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17f7fe640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800ba0f0 0x7fd1801462d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd17400d830 tx=0x7fd17400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174018030 con 0x7fd1800ba0f0 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17400be10 con 0x7fd1800ba0f0 2024-05-16T22:34:05.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1740098b0 con 0x7fd1800ba0f0 2024-05-16T22:34:05.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.655+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd180147540 con 0x7fd1800ba0f0 2024-05-16T22:34:05.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.656+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd180147b00 con 0x7fd1800ba0f0 2024-05-16T22:34:05.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.656+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd1800ba9e0 con 0x7fd1800ba0f0 2024-05-16T22:34:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.657+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd17401b070 con 0x7fd1800ba0f0 2024-05-16T22:34:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.658+0000 7fd17cff9640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd16c076300 0x7fd16c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.658+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fd174097500 con 0x7fd1800ba0f0 2024-05-16T22:34:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.658+0000 7fd17cff9640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fd16c07c2b0 0x7fd16c07e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.658+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd16c07edd0 con 0x7fd16c07c2b0 2024-05-16T22:34:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.658+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd17409e050 con 0x7fd1800ba0f0 2024-05-16T22:34:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.658+0000 7fd17ffff640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd16c076300 0x7fd16c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.658+0000 7fd184d95640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fd16c07c2b0 0x7fd16c07e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.659+0000 7fd17ffff640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd16c076300 0x7fd16c078810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd170034000 tx=0x7fd17002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.659+0000 7fd184d95640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fd16c07c2b0 0x7fd16c07e700 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.659+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 <== osd.5 v2:172.21.15.157:6808/2462600028 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd16c07edd0 con 0x7fd16c07c2b0 2024-05-16T22:34:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.673+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 --> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd180050940 con 0x7fd16c07c2b0 2024-05-16T22:34:05.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.673+0000 7fd17cff9640 1 -- 172.21.15.5:0/863389969 <== osd.5 v2:172.21.15.157:6808/2462600028 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd180050940 con 0x7fd16c07c2b0 2024-05-16T22:34:05.672 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T22:34:05.673 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T22:34:05.673 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T22:34:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fd16c07c2b0 msgr2=0x7fd16c07e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6808/2462600028,v1:172.21.15.157:6809/2462600028] conn(0x7fd16c07c2b0 0x7fd16c07e700 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd16c076300 msgr2=0x7fd16c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fd16c076300 0x7fd16c078810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd170034000 tx=0x7fd17002e000 comp rx=0 tx=0).stop 2024-05-16T22:34:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800ba0f0 msgr2=0x7fd1801462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 --2- 172.21.15.5:0/863389969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1800ba0f0 0x7fd1801462d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd17400d830 tx=0x7fd17400dcf0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd184d95640 1 -- 172.21.15.5:0/863389969 reap_dead start 2024-05-16T22:34:05.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 shutdown_connections 2024-05-16T22:34:05.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 >> 172.21.15.5:0/863389969 conn(0x7fd1800c07c0 msgr2=0x7fd1800be8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:05.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 shutdown_connections 2024-05-16T22:34:05.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.674+0000 7fd1867f8640 1 -- 172.21.15.5:0/863389969 wait complete. 2024-05-16T22:34:05.683 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-16T22:34:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.796+0000 7fe3dcf00640 1 Processor -- start 2024-05-16T22:34:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.796+0000 7fe3dcf00640 1 -- start start 2024-05-16T22:34:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.797+0000 7fe3dcf00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3d8148770 0x7fe3d80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.797+0000 7fe3dcf00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3d80bf9b0 0x7fe3d80bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.797+0000 7fe3dcf00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d80c0620 con 0x7fe3d814e360 2024-05-16T22:34:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.797+0000 7fe3dcf00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d8151e40 con 0x7fe3d8148770 2024-05-16T22:34:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.797+0000 7fe3dcf00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d8151ad0 con 0x7fe3d80bf9b0 2024-05-16T22:34:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.798+0000 7fe3d5d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3d8148770 0x7fe3d80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.798+0000 7fe3d5d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3d8148770 0x7fe3d80c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47824/0 (socket says 172.21.15.5:47824) 2024-05-16T22:34:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.798+0000 7fe3d5d9b640 1 -- 172.21.15.5:0/2952119179 learned_addr learned my addr 172.21.15.5:0/2952119179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.798+0000 7fe3d6d9d640 1 --2- 172.21.15.5:0/2952119179 >> v2:172.21.15.157:3300/0 conn(0x7fe3d80bf9b0 0x7fe3d80bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.798+0000 7fe3d5d9b640 1 -- 172.21.15.5:0/2952119179 >> v2:172.21.15.157:3300/0 conn(0x7fe3d80bf9b0 msgr2=0x7fe3d80bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.798+0000 7fe3d5d9b640 1 --2- 172.21.15.5:0/2952119179 >> v2:172.21.15.157:3300/0 conn(0x7fe3d80bf9b0 0x7fe3d80bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.798+0000 7fe3d5d9b640 1 -- 172.21.15.5:0/2952119179 >> v1:172.21.15.157:6789/0 conn(0x7fe3d814e360 legacy=0x7fe3d81522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.798+0000 7fe3d5d9b640 1 -- 172.21.15.5:0/2952119179 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d80c0300 con 0x7fe3d8148770 2024-05-16T22:34:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.799+0000 7fe3d5d9b640 1 --2- 172.21.15.5:0/2952119179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80c0c80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009870 tx=0x7fe3cc02a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9b9b8ce3961a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.799+0000 7fe3d559a640 1 -- 172.21.15.5:0/2952119179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc037070 con 0x7fe3d8148770 2024-05-16T22:34:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.799+0000 7fe3d559a640 1 -- 172.21.15.5:0/2952119179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc032640 con 0x7fe3d8148770 2024-05-16T22:34:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.799+0000 7fe3d559a640 1 -- 172.21.15.5:0/2952119179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc032a10 con 0x7fe3d8148770 2024-05-16T22:34:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.799+0000 7fe3dcf00640 1 -- 172.21.15.5:0/2952119179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 msgr2=0x7fe3d80c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.799+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/2952119179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80c0c80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009870 tx=0x7fe3cc02a330 comp rx=0 tx=0).stop 2024-05-16T22:34:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.800+0000 7fe3dcf00640 1 -- 172.21.15.5:0/2952119179 shutdown_connections 2024-05-16T22:34:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.800+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/2952119179 >> v2:172.21.15.157:3300/0 conn(0x7fe3d80bf9b0 0x7fe3d80bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.800+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/2952119179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80c0c80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.800+0000 7fe3dcf00640 1 -- 172.21.15.5:0/2952119179 >> 172.21.15.5:0/2952119179 conn(0x7fe3d80c17c0 msgr2=0x7fe3d80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:05.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.800+0000 7fe3dcf00640 1 -- 172.21.15.5:0/2952119179 shutdown_connections 2024-05-16T22:34:05.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.800+0000 7fe3dcf00640 1 -- 172.21.15.5:0/2952119179 wait complete. 2024-05-16T22:34:05.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.801+0000 7fe3dcf00640 1 Processor -- start 2024-05-16T22:34:05.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.801+0000 7fe3dcf00640 1 -- start start 2024-05-16T22:34:05.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3dcf00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3d80bf9b0 0x7fe3d80b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3dcf00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80b8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3dcf00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3d814e360 0x7fe3d813d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3dcf00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8158cc0 con 0x7fe3d8148770 2024-05-16T22:34:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3dcf00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80c13d0 con 0x7fe3d814e360 2024-05-16T22:34:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3dcf00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d8158e40 con 0x7fe3d80bf9b0 2024-05-16T22:34:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3d5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3d5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80b8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47838/0 (socket says 172.21.15.5:47838) 2024-05-16T22:34:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.802+0000 7fe3d5d9b640 1 -- 172.21.15.5:0/1670614338 learned_addr learned my addr 172.21.15.5:0/1670614338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d6d9d640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3d814e360 0x7fe3d813d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d659c640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3d80bf9b0 0x7fe3d80b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d5d9b640 1 -- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3d80bf9b0 msgr2=0x7fe3d80b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d5d9b640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3d80bf9b0 0x7fe3d80b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d5d9b640 1 -- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3d814e360 msgr2=0x7fe3d813d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:05.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d5d9b640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3d814e360 0x7fe3d813d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:05.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d5d9b640 1 -- 172.21.15.5:0/1670614338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d80b8850 con 0x7fe3d8148770 2024-05-16T22:34:05.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d6d9d640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3d814e360 0x7fe3d813d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:05.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3d5d9b640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80b8310 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000c00 tx=0x7fe3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3c6ffd640 1 -- 172.21.15.5:0/1670614338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc037040 con 0x7fe3d8148770 2024-05-16T22:34:05.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3c6ffd640 1 -- 172.21.15.5:0/1670614338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc042070 con 0x7fe3d8148770 2024-05-16T22:34:05.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d813fc90 con 0x7fe3d8148770 2024-05-16T22:34:05.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3c6ffd640 1 -- 172.21.15.5:0/1670614338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0309b0 con 0x7fe3d8148770 2024-05-16T22:34:05.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.803+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d8140250 con 0x7fe3d8148770 2024-05-16T22:34:05.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.804+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d80be660 con 0x7fe3d8148770 2024-05-16T22:34:05.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.805+0000 7fe3c6ffd640 1 -- 172.21.15.5:0/1670614338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe3cc030b50 con 0x7fe3d8148770 2024-05-16T22:34:05.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.805+0000 7fe3c6ffd640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3b80762d0 0x7fe3b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:05.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.806+0000 7fe3c6ffd640 1 -- 172.21.15.5:0/1670614338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fe3cc0b7cf0 con 0x7fe3d8148770 2024-05-16T22:34:05.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.806+0000 7fe3d659c640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3b80762d0 0x7fe3b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:05.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.806+0000 7fe3d659c640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3b80762d0 0x7fe3b80787e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80015e0 tx=0x7fe3c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:05.810+0000 7fe3c6ffd640 1 -- 172.21.15.5:0/1670614338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe3cc0bc070 con 0x7fe3d8148770 2024-05-16T22:34:06.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.001+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe3d8071890 con 0x7fe3b80762d0 2024-05-16T22:34:06.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.002+0000 7fe3c6ffd640 1 -- 172.21.15.5:0/1670614338 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe3d8071890 con 0x7fe3b80762d0 2024-05-16T22:34:06.001 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-05-16T22:34:06.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3b80762d0 msgr2=0x7fe3b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3b80762d0 0x7fe3b80787e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80015e0 tx=0x7fe3c8009040 comp rx=0 tx=0).stop 2024-05-16T22:34:06.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 msgr2=0x7fe3d80b8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80b8310 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000c00 tx=0x7fe3cc0046c0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 shutdown_connections 2024-05-16T22:34:06.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fe3b80762d0 0x7fe3b80787e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3d814e360 0x7fe3d813d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d8148770 0x7fe3d80b8310 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 --2- 172.21.15.5:0/1670614338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3d80bf9b0 0x7fe3d80b6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 >> 172.21.15.5:0/1670614338 conn(0x7fe3d80c17c0 msgr2=0x7fe3d80bd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 shutdown_connections 2024-05-16T22:34:06.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.004+0000 7fe3dcf00640 1 -- 172.21.15.5:0/1670614338 wait complete. 2024-05-16T22:34:06.014 INFO:tasks.ceph:Scrubbing osd.6 2024-05-16T22:34:06.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-16T22:34:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.130+0000 7f8cdc48b640 1 Processor -- start 2024-05-16T22:34:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.130+0000 7f8cdc48b640 1 -- start start 2024-05-16T22:34:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cdc48b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd40bd6d0 0x7f8cd40be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cdc48b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8cd40bee80 0x7f8cd4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cdc48b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd406e140 con 0x7f8cd4151fc0 2024-05-16T22:34:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cdc48b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd40c36f0 con 0x7f8cd40bee80 2024-05-16T22:34:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cdc48b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd4152530 con 0x7f8cd40bd6d0 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cd9a26640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd40bd6d0 0x7f8cd40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cdaa28640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8cd40bee80 0x7f8cd4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cd9a26640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd40bd6d0 0x7f8cd40be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51820/0 (socket says 172.21.15.5:51820) 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cda227640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8cd4151fc0 0x7f8cd406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:52094/0 (socket says 172.21.15.5:52094) 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.131+0000 7f8cd9a26640 1 -- 172.21.15.5:0/607929987 learned_addr learned my addr 172.21.15.5:0/607929987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.132+0000 7f8cd9225640 1 -- 172.21.15.5:0/607929987 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018415070 0 0) 0x7f8cd0001110 con 0x7f8cd4151fc0 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.132+0000 7f8cd9225640 1 -- 172.21.15.5:0/607929987 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cc0003520 con 0x7f8cd4151fc0 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.132+0000 7f8cd9a26640 1 -- 172.21.15.5:0/607929987 >> v2:172.21.15.157:3300/0 conn(0x7f8cd40bee80 msgr2=0x7f8cd4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.132+0000 7f8cd9a26640 1 --2- 172.21.15.5:0/607929987 >> v2:172.21.15.157:3300/0 conn(0x7f8cd40bee80 0x7f8cd4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.132+0000 7f8cd9a26640 1 -- 172.21.15.5:0/607929987 >> v1:172.21.15.157:6789/0 conn(0x7f8cd4151fc0 legacy=0x7f8cd406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.132+0000 7f8cd9a26640 1 -- 172.21.15.5:0/607929987 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd4152810 con 0x7f8cd40bd6d0 2024-05-16T22:34:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.132+0000 7f8cdaa28640 1 --2- 172.21.15.5:0/607929987 >> v2:172.21.15.157:3300/0 conn(0x7f8cd40bee80 0x7f8cd4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:34:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.133+0000 7f8cd9a26640 1 --2- 172.21.15.5:0/607929987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd40bd6d0 0x7f8cd40be940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009870 tx=0x7f8cc402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6098e7ab2ac123c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.133+0000 7f8cd9225640 1 -- 172.21.15.5:0/607929987 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4037070 con 0x7f8cd40bd6d0 2024-05-16T22:34:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.133+0000 7f8cd9225640 1 -- 172.21.15.5:0/607929987 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc4032440 con 0x7f8cd40bd6d0 2024-05-16T22:34:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.133+0000 7f8cd9225640 1 -- 172.21.15.5:0/607929987 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40327f0 con 0x7f8cd40bd6d0 2024-05-16T22:34:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.133+0000 7f8cdc48b640 1 -- 172.21.15.5:0/607929987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd40bd6d0 msgr2=0x7f8cd40be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.133+0000 7f8cdc48b640 1 --2- 172.21.15.5:0/607929987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd40bd6d0 0x7f8cd40be940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009870 tx=0x7f8cc402a250 comp rx=0 tx=0).stop 2024-05-16T22:34:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.134+0000 7f8cdc48b640 1 -- 172.21.15.5:0/607929987 shutdown_connections 2024-05-16T22:34:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.134+0000 7f8cdc48b640 1 --2- 172.21.15.5:0/607929987 >> v2:172.21.15.157:3300/0 conn(0x7f8cd40bee80 0x7f8cd4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.134+0000 7f8cdc48b640 1 --2- 172.21.15.5:0/607929987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd40bd6d0 0x7f8cd40be940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.134+0000 7f8cdc48b640 1 -- 172.21.15.5:0/607929987 >> 172.21.15.5:0/607929987 conn(0x7f8cd40c3d20 msgr2=0x7f8cd40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.134+0000 7f8cdc48b640 1 -- 172.21.15.5:0/607929987 shutdown_connections 2024-05-16T22:34:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.134+0000 7f8cdc48b640 1 -- 172.21.15.5:0/607929987 wait complete. 2024-05-16T22:34:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.135+0000 7f8cdc48b640 1 Processor -- start 2024-05-16T22:34:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.135+0000 7f8cdc48b640 1 -- start start 2024-05-16T22:34:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cdc48b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cd40bd6d0 0x7f8cd414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cdc48b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cd40bee80 0x7f8cd414cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cdc48b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd4151fc0 0x7f8cd4148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cdc48b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd40bdae0 con 0x7f8cd40bee80 2024-05-16T22:34:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cdc48b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd40c0070 con 0x7f8cd40bd6d0 2024-05-16T22:34:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cdc48b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd40a2ed0 con 0x7f8cd4151fc0 2024-05-16T22:34:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cd9a26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cd40bee80 0x7f8cd414cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cd9a26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cd40bee80 0x7f8cd414cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47850/0 (socket says 172.21.15.5:47850) 2024-05-16T22:34:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cd9a26640 1 -- 172.21.15.5:0/259164449 learned_addr learned my addr 172.21.15.5:0/259164449 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.136+0000 7f8cda227640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cd40bd6d0 0x7f8cd414e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cdaa28640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd4151fc0 0x7f8cd4148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cd9a26640 1 -- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd4151fc0 msgr2=0x7f8cd4148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cd9a26640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8cd4151fc0 0x7f8cd4148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cd9a26640 1 -- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cd40bd6d0 msgr2=0x7f8cd414e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cd9a26640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cd40bd6d0 0x7f8cd414e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cd9a26640 1 -- 172.21.15.5:0/259164449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd414eb00 con 0x7f8cd40bee80 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cd9a26640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cd40bee80 0x7f8cd414cf40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4035040 tx=0x7f8cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4037040 con 0x7f8cd40bee80 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc4004230 con 0x7f8cd40bee80 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd414d480 con 0x7f8cd40bee80 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4003610 con 0x7f8cd40bee80 2024-05-16T22:34:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.137+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd41e7ad0 con 0x7f8cd40bee80 2024-05-16T22:34:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.138+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cd4050940 con 0x7f8cd40bee80 2024-05-16T22:34:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.139+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8cc40037b0 con 0x7f8cd40bee80 2024-05-16T22:34:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.139+0000 7f8ccaffd640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8cb80762d0 0x7f8cb80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.140+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f8cc40b8000 con 0x7f8cd40bee80 2024-05-16T22:34:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.140+0000 7f8ccaffd640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f8cb807c280 0x7f8cb807e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.140+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 --> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cc4007e80 con 0x7f8cb807c280 2024-05-16T22:34:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.140+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8cc40bf050 con 0x7f8cd40bee80 2024-05-16T22:34:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.140+0000 7f8cda227640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8cb80762d0 0x7f8cb80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.140+0000 7f8cdaa28640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f8cb807c280 0x7f8cb807e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.140+0000 7f8cda227640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8cb80762d0 0x7f8cb80787e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0005b30 tx=0x7f8cd0007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.140+0000 7f8cdaa28640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f8cb807c280 0x7f8cb807e6d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.141+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 <== osd.6 v2:172.21.15.157:6800/3966496545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8cc4007e80 con 0x7f8cb807c280 2024-05-16T22:34:06.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.154+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 --> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8cd414c420 con 0x7f8cb807c280 2024-05-16T22:34:06.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8ccaffd640 1 -- 172.21.15.5:0/259164449 <== osd.6 v2:172.21.15.157:6800/3966496545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8cd414c420 con 0x7f8cb807c280 2024-05-16T22:34:06.154 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T22:34:06.154 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T22:34:06.155 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T22:34:06.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f8cb807c280 msgr2=0x7f8cb807e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdc48b640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6800/3966496545,v1:172.21.15.157:6801/3966496545] conn(0x7f8cb807c280 0x7f8cb807e6d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8cb80762d0 msgr2=0x7f8cb80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdc48b640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8cb80762d0 0x7f8cb80787e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0005b30 tx=0x7f8cd0007a30 comp rx=0 tx=0).stop 2024-05-16T22:34:06.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cd40bee80 msgr2=0x7f8cd414cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdc48b640 1 --2- 172.21.15.5:0/259164449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cd40bee80 0x7f8cd414cf40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4035040 tx=0x7f8cc40046c0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdaa28640 1 -- 172.21.15.5:0/259164449 reap_dead start 2024-05-16T22:34:06.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 shutdown_connections 2024-05-16T22:34:06.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.155+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 >> 172.21.15.5:0/259164449 conn(0x7f8cd40c3d20 msgr2=0x7f8cd40a4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.156+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 shutdown_connections 2024-05-16T22:34:06.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.156+0000 7f8cdc48b640 1 -- 172.21.15.5:0/259164449 wait complete. 2024-05-16T22:34:06.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-16T22:34:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.278+0000 7f91aba49640 1 Processor -- start 2024-05-16T22:34:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.278+0000 7f91aba49640 1 -- start start 2024-05-16T22:34:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91aba49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91a40bd440 0x7f91a40bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91aba49640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a40b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91aba49640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a40bdd90 con 0x7f91a414e530 2024-05-16T22:34:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91aba49640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f91a40b88e0 con 0x7f91a40bd440 2024-05-16T22:34:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91aba49640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f91a414ece0 con 0x7f91a40b8d70 2024-05-16T22:34:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a8fe4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91a40bd440 0x7f91a40bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a8fe4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91a40bd440 0x7f91a40bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47852/0 (socket says 172.21.15.5:47852) 2024-05-16T22:34:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a8fe4640 1 -- 172.21.15.5:0/838437138 learned_addr learned my addr 172.21.15.5:0/838437138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a9fe6640 1 --2- 172.21.15.5:0/838437138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a40b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a8fe4640 1 -- 172.21.15.5:0/838437138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 msgr2=0x7f91a40b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a8fe4640 1 --2- 172.21.15.5:0/838437138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a40b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a8fe4640 1 -- 172.21.15.5:0/838437138 >> v1:172.21.15.157:6789/0 conn(0x7f91a414e530 legacy=0x7f91a40ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a8fe4640 1 -- 172.21.15.5:0/838437138 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a414efc0 con 0x7f91a40bd440 2024-05-16T22:34:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.279+0000 7f91a9fe6640 1 --2- 172.21.15.5:0/838437138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a40b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.280+0000 7f91a8fe4640 1 --2- 172.21.15.5:0/838437138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a40bd440 0x7f91a40bd850 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9198009870 tx=0x7f919802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745195475efd909 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.280+0000 7f91a3fff640 1 -- 172.21.15.5:0/838437138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198037070 con 0x7f91a40bd440 2024-05-16T22:34:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.280+0000 7f91a3fff640 1 -- 172.21.15.5:0/838437138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9198032440 con 0x7f91a40bd440 2024-05-16T22:34:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.280+0000 7f91a3fff640 1 -- 172.21.15.5:0/838437138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198032810 con 0x7f91a40bd440 2024-05-16T22:34:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.281+0000 7f91aba49640 1 -- 172.21.15.5:0/838437138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a40bd440 msgr2=0x7f91a40bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.281+0000 7f91aba49640 1 --2- 172.21.15.5:0/838437138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a40bd440 0x7f91a40bd850 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9198009870 tx=0x7f919802a270 comp rx=0 tx=0).stop 2024-05-16T22:34:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.281+0000 7f91aba49640 1 -- 172.21.15.5:0/838437138 shutdown_connections 2024-05-16T22:34:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.281+0000 7f91aba49640 1 --2- 172.21.15.5:0/838437138 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a40b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.281+0000 7f91aba49640 1 --2- 172.21.15.5:0/838437138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a40bd440 0x7f91a40bd850 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.281+0000 7f91aba49640 1 -- 172.21.15.5:0/838437138 >> 172.21.15.5:0/838437138 conn(0x7f91a40c0570 msgr2=0x7f91a40c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.281+0000 7f91aba49640 1 -- 172.21.15.5:0/838437138 shutdown_connections 2024-05-16T22:34:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.281+0000 7f91aba49640 1 -- 172.21.15.5:0/838437138 wait complete. 2024-05-16T22:34:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.283+0000 7f91aba49640 1 Processor -- start 2024-05-16T22:34:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.283+0000 7f91aba49640 1 -- start start 2024-05-16T22:34:06.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91aba49640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a41e7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91aba49640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91a40bd440 0x7f91a4142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91aba49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a414e530 0x7f91a413e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91aba49640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f91a40b96c0 con 0x7f91a414e530 2024-05-16T22:34:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91aba49640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f91a40bbb70 con 0x7f91a40bd440 2024-05-16T22:34:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91aba49640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f91a414e940 con 0x7f91a40b8d70 2024-05-16T22:34:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a9fe6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a414e530 0x7f91a413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a9fe6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a414e530 0x7f91a413e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47866/0 (socket says 172.21.15.5:47866) 2024-05-16T22:34:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a9fe6640 1 -- 172.21.15.5:0/1482818602 learned_addr learned my addr 172.21.15.5:0/1482818602 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a97e5640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a41e7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a8fe4640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91a40bd440 0x7f91a4142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a9fe6640 1 -- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 msgr2=0x7f91a41e7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a9fe6640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a41e7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a9fe6640 1 -- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91a40bd440 msgr2=0x7f91a4142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a9fe6640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91a40bd440 0x7f91a4142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.284+0000 7f91a9fe6640 1 -- 172.21.15.5:0/1482818602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a413bc20 con 0x7f91a414e530 2024-05-16T22:34:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.285+0000 7f91a9fe6640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a414e530 0x7f91a413e030 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f919400d580 tx=0x7f919400da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.285+0000 7f91a1ffb640 1 -- 172.21.15.5:0/1482818602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194012630 con 0x7f91a414e530 2024-05-16T22:34:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.285+0000 7f91a1ffb640 1 -- 172.21.15.5:0/1482818602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9194019070 con 0x7f91a414e530 2024-05-16T22:34:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.285+0000 7f91a1ffb640 1 -- 172.21.15.5:0/1482818602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91940129f0 con 0x7f91a414e530 2024-05-16T22:34:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.285+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a4144380 con 0x7f91a414e530 2024-05-16T22:34:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.285+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a41528c0 con 0x7f91a414e530 2024-05-16T22:34:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.286+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a40beba0 con 0x7f91a414e530 2024-05-16T22:34:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.286+0000 7f91a1ffb640 1 -- 172.21.15.5:0/1482818602 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9194012b90 con 0x7f91a414e530 2024-05-16T22:34:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.287+0000 7f91a1ffb640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9190076300 0x7f9190078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.287+0000 7f91a1ffb640 1 -- 172.21.15.5:0/1482818602 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f91940975d0 con 0x7f91a414e530 2024-05-16T22:34:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.287+0000 7f91a97e5640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9190076300 0x7f9190078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.288+0000 7f91a97e5640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9190076300 0x7f9190078810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f919c007fd0 tx=0x7f919c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.292+0000 7f91a1ffb640 1 -- 172.21.15.5:0/1482818602 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9194060b00 con 0x7f91a414e530 2024-05-16T22:34:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.482+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f91a4050940 con 0x7f9190076300 2024-05-16T22:34:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.482+0000 7f91a1ffb640 1 -- 172.21.15.5:0/1482818602 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f91a4050940 con 0x7f9190076300 2024-05-16T22:34:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2024-05-16T22:34:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.484+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9190076300 msgr2=0x7f9190078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.484+0000 7f91aba49640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9190076300 0x7f9190078810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f919c007fd0 tx=0x7f919c009040 comp rx=0 tx=0).stop 2024-05-16T22:34:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.484+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a414e530 msgr2=0x7f91a413e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.484+0000 7f91aba49640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a414e530 0x7f91a413e030 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f919400d580 tx=0x7f919400da40 comp rx=0 tx=0).stop 2024-05-16T22:34:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.485+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 shutdown_connections 2024-05-16T22:34:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.485+0000 7f91aba49640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f9190076300 0x7f9190078810 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.485+0000 7f91aba49640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a414e530 0x7f91a413e030 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.485+0000 7f91aba49640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91a40bd440 0x7f91a4142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.485+0000 7f91aba49640 1 --2- 172.21.15.5:0/1482818602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91a40b8d70 0x7f91a41e7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.485+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 >> 172.21.15.5:0/1482818602 conn(0x7f91a40c0570 msgr2=0x7f91a40c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.485+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 shutdown_connections 2024-05-16T22:34:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.485+0000 7f91aba49640 1 -- 172.21.15.5:0/1482818602 wait complete. 2024-05-16T22:34:06.494 INFO:tasks.ceph:Scrubbing osd.7 2024-05-16T22:34:06.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-16T22:34:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.611+0000 7f8fdd614640 1 Processor -- start 2024-05-16T22:34:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.611+0000 7f8fdd614640 1 -- start start 2024-05-16T22:34:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.612+0000 7f8fdd614640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd8148770 0x7f8fd80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.612+0000 7f8fdd614640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8fd80bf9b0 0x7f8fd80bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.612+0000 7f8fdd614640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd80c0620 con 0x7f8fd814e360 2024-05-16T22:34:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.612+0000 7f8fdd614640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd8151e40 con 0x7f8fd80bf9b0 2024-05-16T22:34:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.612+0000 7f8fdd614640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd8151ad0 con 0x7f8fd8148770 2024-05-16T22:34:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd67fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd8148770 0x7f8fd80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd77fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8fd80bf9b0 0x7f8fd80bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd6ffd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8fd814e360 0x7f8fd81522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.5:52108/0 (socket says 172.21.15.5:52108) 2024-05-16T22:34:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd67fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd8148770 0x7f8fd80c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.5:51852/0 (socket says 172.21.15.5:51852) 2024-05-16T22:34:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd6ffd640 1 -- 172.21.15.5:0/4176154923 learned_addr learned my addr 172.21.15.5:0/4176154923 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd67fc640 1 -- 172.21.15.5:0/4176154923 >> v2:172.21.15.157:3300/0 conn(0x7f8fd80bf9b0 msgr2=0x7f8fd80bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd67fc640 1 --2- 172.21.15.5:0/4176154923 >> v2:172.21.15.157:3300/0 conn(0x7f8fd80bf9b0 0x7f8fd80bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd67fc640 1 -- 172.21.15.5:0/4176154923 >> v1:172.21.15.157:6789/0 conn(0x7f8fd814e360 legacy=0x7f8fd81522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd67fc640 1 -- 172.21.15.5:0/4176154923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd80c0300 con 0x7f8fd8148770 2024-05-16T22:34:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.613+0000 7f8fd77fe640 1 --2- 172.21.15.5:0/4176154923 >> v2:172.21.15.157:3300/0 conn(0x7f8fd80bf9b0 0x7f8fd80bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:34:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.614+0000 7f8fd67fc640 1 --2- 172.21.15.5:0/4176154923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd8148770 0x7f8fd80c0c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00097a0 tx=0x7f8fc002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b0d0c7e1f61a6b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.614+0000 7f8fd5ffb640 1 -- 172.21.15.5:0/4176154923 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0037070 con 0x7f8fd8148770 2024-05-16T22:34:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.614+0000 7f8fd5ffb640 1 -- 172.21.15.5:0/4176154923 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc0032440 con 0x7f8fd8148770 2024-05-16T22:34:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.614+0000 7f8fd5ffb640 1 -- 172.21.15.5:0/4176154923 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0032810 con 0x7f8fd8148770 2024-05-16T22:34:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.615+0000 7f8fdd614640 1 -- 172.21.15.5:0/4176154923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd8148770 msgr2=0x7f8fd80c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.615+0000 7f8fdd614640 1 --2- 172.21.15.5:0/4176154923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd8148770 0x7f8fd80c0c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00097a0 tx=0x7f8fc002a210 comp rx=0 tx=0).stop 2024-05-16T22:34:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.615+0000 7f8fdd614640 1 -- 172.21.15.5:0/4176154923 shutdown_connections 2024-05-16T22:34:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.615+0000 7f8fdd614640 1 --2- 172.21.15.5:0/4176154923 >> v2:172.21.15.157:3300/0 conn(0x7f8fd80bf9b0 0x7f8fd80bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.615+0000 7f8fdd614640 1 --2- 172.21.15.5:0/4176154923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd8148770 0x7f8fd80c0c80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.615+0000 7f8fdd614640 1 -- 172.21.15.5:0/4176154923 >> 172.21.15.5:0/4176154923 conn(0x7f8fd80c17c0 msgr2=0x7f8fd80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.615+0000 7f8fdd614640 1 -- 172.21.15.5:0/4176154923 shutdown_connections 2024-05-16T22:34:06.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.615+0000 7f8fdd614640 1 -- 172.21.15.5:0/4176154923 wait complete. 2024-05-16T22:34:06.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.616+0000 7f8fdd614640 1 Processor -- start 2024-05-16T22:34:06.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.616+0000 7f8fdd614640 1 -- start start 2024-05-16T22:34:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.617+0000 7f8fdd614640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd80bf9b0 0x7f8fd81e5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.617+0000 7f8fdd614640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd8148770 0x7f8fd8141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.617+0000 7f8fdd614640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd814e360 0x7f8fd81423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.617+0000 7f8fdd614640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8158cc0 con 0x7f8fd8148770 2024-05-16T22:34:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fdd614640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd80c13d0 con 0x7f8fd814e360 2024-05-16T22:34:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fdd614640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd8158e40 con 0x7f8fd80bf9b0 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd8148770 0x7f8fd8141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd8148770 0x7f8fd8141eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47878/0 (socket says 172.21.15.5:47878) 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 -- 172.21.15.5:0/3952555162 learned_addr learned my addr 172.21.15.5:0/3952555162 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd6ffd640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd80bf9b0 0x7f8fd81e5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd77fe640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd814e360 0x7f8fd81423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 -- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd80bf9b0 msgr2=0x7f8fd81e5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd80bf9b0 0x7f8fd81e5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 -- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd814e360 msgr2=0x7f8fd81423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd814e360 0x7f8fd81423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 -- 172.21.15.5:0/3952555162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd81441e0 con 0x7f8fd8148770 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fd67fc640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd8148770 0x7f8fd8141eb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8fc002a250 tx=0x7f8fc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0041020 con 0x7f8fd8148770 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc0030640 con 0x7f8fd8148770 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd81444c0 con 0x7f8fd8148770 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0037040 con 0x7f8fd8148770 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.618+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd81e4c70 con 0x7f8fd8148770 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.619+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fd8050940 con 0x7f8fd8148770 2024-05-16T22:34:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.620+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8fc0044020 con 0x7f8fd8148770 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.620+0000 7f8fcf7fe640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8fb8076300 0x7f8fb8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.621+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f8fc00b7a30 con 0x7f8fd8148770 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.621+0000 7f8fcf7fe640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7f8fb807c2b0 0x7f8fb807e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.621+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fc0007e60 con 0x7f8fb807c2b0 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.621+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8fc00bc2c0 con 0x7f8fd8148770 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.621+0000 7f8fd6ffd640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8fb8076300 0x7f8fb8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.621+0000 7f8fd77fe640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7f8fb807c2b0 0x7f8fb807e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.621+0000 7f8fd6ffd640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8fb8076300 0x7f8fb8078810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8005c00 tx=0x7f8fc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.621+0000 7f8fd77fe640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7f8fb807c2b0 0x7f8fb807e700 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.622+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 <== osd.7 v2:172.21.15.157:6816/3015790228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fc0007e60 con 0x7f8fb807c2b0 2024-05-16T22:34:06.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.636+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 --> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8fd8144030 con 0x7f8fb807c2b0 2024-05-16T22:34:06.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.636+0000 7f8fcf7fe640 1 -- 172.21.15.5:0/3952555162 <== osd.7 v2:172.21.15.157:6816/3015790228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8fd8144030 con 0x7f8fb807c2b0 2024-05-16T22:34:06.635 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-05-16T22:34:06.636 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T22:34:06.636 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-05-16T22:34:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.636+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7f8fb807c2b0 msgr2=0x7f8fb807e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.636+0000 7f8fdd614640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6816/3015790228,v1:172.21.15.157:6817/3015790228] conn(0x7f8fb807c2b0 0x7f8fb807e700 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.636+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8fb8076300 msgr2=0x7f8fb8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.636+0000 7f8fdd614640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f8fb8076300 0x7f8fb8078810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8005c00 tx=0x7f8fc8009040 comp rx=0 tx=0).stop 2024-05-16T22:34:06.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.636+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd8148770 msgr2=0x7f8fd8141eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.636+0000 7f8fdd614640 1 --2- 172.21.15.5:0/3952555162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fd8148770 0x7f8fd8141eb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8fc002a250 tx=0x7f8fc00046c0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.637+0000 7f8fd77fe640 1 -- 172.21.15.5:0/3952555162 reap_dead start 2024-05-16T22:34:06.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.637+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 shutdown_connections 2024-05-16T22:34:06.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.637+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 >> 172.21.15.5:0/3952555162 conn(0x7f8fd80c17c0 msgr2=0x7f8fd814c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.637+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 shutdown_connections 2024-05-16T22:34:06.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.637+0000 7f8fdd614640 1 -- 172.21.15.5:0/3952555162 wait complete. 2024-05-16T22:34:06.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-16T22:34:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.759+0000 7f7991297640 1 Processor -- start 2024-05-16T22:34:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.759+0000 7f7991297640 1 -- start start 2024-05-16T22:34:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.760+0000 7f7991297640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f798c148330 0x7f798c0be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.760+0000 7f7991297640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f798c14e670 0x7f798c158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.760+0000 7f7991297640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c1518d0 con 0x7f798c14e260 2024-05-16T22:34:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.760+0000 7f7991297640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f798c148740 con 0x7f798c14e670 2024-05-16T22:34:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.760+0000 7f7991297640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f798c151bb0 con 0x7f798c148330 2024-05-16T22:34:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.760+0000 7f798b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f798c14e670 0x7f798c158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.760+0000 7f798a7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f798c14e260 0x7f798c0bfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46000/0 (socket says 172.21.15.5:46000) 2024-05-16T22:34:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.760+0000 7f798a7fc640 1 -- 172.21.15.5:0/3722068810 learned_addr learned my addr 172.21.15.5:0/3722068810 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.761+0000 7f798affd640 1 --2- 172.21.15.5:0/3722068810 >> v2:172.21.15.157:3300/0 conn(0x7f798c148330 0x7f798c0be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.761+0000 7f798b7fe640 1 -- 172.21.15.5:0/3722068810 >> v2:172.21.15.157:3300/0 conn(0x7f798c148330 msgr2=0x7f798c0be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.761+0000 7f798b7fe640 1 --2- 172.21.15.5:0/3722068810 >> v2:172.21.15.157:3300/0 conn(0x7f798c148330 0x7f798c0be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.761+0000 7f798b7fe640 1 -- 172.21.15.5:0/3722068810 >> v1:172.21.15.5:6789/0 conn(0x7f798c14e260 legacy=0x7f798c0bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.761+0000 7f7989ffb640 1 -- 172.21.15.5:0/3722068810 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186400130 0 0) 0x7f798c1518d0 con 0x7f798c14e260 2024-05-16T22:34:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.761+0000 7f798b7fe640 1 -- 172.21.15.5:0/3722068810 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c151e90 con 0x7f798c14e670 2024-05-16T22:34:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f798b7fe640 1 --2- 172.21.15.5:0/3722068810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c158bc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f798c0a45b0 tx=0x7f797c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4cf3ac5af1082d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7989ffb640 1 -- 172.21.15.5:0/3722068810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c007740 con 0x7f798c14e670 2024-05-16T22:34:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7989ffb640 1 -- 172.21.15.5:0/3722068810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797c0078e0 con 0x7f798c14e670 2024-05-16T22:34:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7989ffb640 1 -- 172.21.15.5:0/3722068810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c007cb0 con 0x7f798c14e670 2024-05-16T22:34:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7991297640 1 -- 172.21.15.5:0/3722068810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 msgr2=0x7f798c158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7991297640 1 --2- 172.21.15.5:0/3722068810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c158bc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f798c0a45b0 tx=0x7f797c02a680 comp rx=0 tx=0).stop 2024-05-16T22:34:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7991297640 1 -- 172.21.15.5:0/3722068810 shutdown_connections 2024-05-16T22:34:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7991297640 1 --2- 172.21.15.5:0/3722068810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c158bc0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7991297640 1 --2- 172.21.15.5:0/3722068810 >> v2:172.21.15.157:3300/0 conn(0x7f798c148330 0x7f798c0be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7991297640 1 -- 172.21.15.5:0/3722068810 >> 172.21.15.5:0/3722068810 conn(0x7f798c0c17c0 msgr2=0x7f798c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7991297640 1 -- 172.21.15.5:0/3722068810 shutdown_connections 2024-05-16T22:34:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.762+0000 7f7991297640 1 -- 172.21.15.5:0/3722068810 wait complete. 2024-05-16T22:34:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.764+0000 7f7991297640 1 Processor -- start 2024-05-16T22:34:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.764+0000 7f7991297640 1 -- start start 2024-05-16T22:34:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f7991297640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f798c148330 0x7f798c0bd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f7991297640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f798c14e260 0x7f798c0bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f7991297640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f7991297640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f798c152690 con 0x7f798c14e670 2024-05-16T22:34:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f7991297640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f798c0c10b0 con 0x7f798c14e260 2024-05-16T22:34:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f7991297640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f798c0c01b0 con 0x7f798c148330 2024-05-16T22:34:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f798b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f798b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38098/0 (socket says 172.21.15.5:38098) 2024-05-16T22:34:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f798b7fe640 1 -- 172.21.15.5:0/263918562 learned_addr learned my addr 172.21.15.5:0/263918562 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.765+0000 7f798a7fc640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f798c14e260 0x7f798c0bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f798affd640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f798c148330 0x7f798c0bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f798b7fe640 1 -- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f798c148330 msgr2=0x7f798c0bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f798b7fe640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f798c148330 0x7f798c0bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f798b7fe640 1 -- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f798c14e260 msgr2=0x7f798c0bc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f798b7fe640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f798c14e260 0x7f798c0bc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f798b7fe640 1 -- 172.21.15.5:0/263918562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c0bcee0 con 0x7f798c14e670 2024-05-16T22:34:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f798b7fe640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c143b50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f797c009e50 tx=0x7f797c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f79837fe640 1 -- 172.21.15.5:0/263918562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c03f070 con 0x7f798c14e670 2024-05-16T22:34:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f79837fe640 1 -- 172.21.15.5:0/263918562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797c031bf0 con 0x7f798c14e670 2024-05-16T22:34:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798c1dab70 con 0x7f798c14e670 2024-05-16T22:34:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f79837fe640 1 -- 172.21.15.5:0/263918562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c044460 con 0x7f798c14e670 2024-05-16T22:34:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.766+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798c1db130 con 0x7f798c14e670 2024-05-16T22:34:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.767+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f798c14bbf0 con 0x7f798c14e670 2024-05-16T22:34:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.768+0000 7f79837fe640 1 -- 172.21.15.5:0/263918562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f797c007790 con 0x7f798c14e670 2024-05-16T22:34:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.769+0000 7f79837fe640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f796c076300 0x7f796c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.769+0000 7f79837fe640 1 -- 172.21.15.5:0/263918562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f797c0b8ca0 con 0x7f798c14e670 2024-05-16T22:34:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.769+0000 7f798affd640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f796c076300 0x7f796c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.769+0000 7f798affd640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f796c076300 0x7f796c078810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f798c073fb0 tx=0x7f7984008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.773+0000 7f79837fe640 1 -- 172.21.15.5:0/263918562 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f797c0823c0 con 0x7f798c14e670 2024-05-16T22:34:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.964+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f798c14f910 con 0x7f796c076300 2024-05-16T22:34:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.965+0000 7f79837fe640 1 -- 172.21.15.5:0/263918562 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f798c14f910 con 0x7f796c076300 2024-05-16T22:34:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2024-05-16T22:34:06.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f796c076300 msgr2=0x7f796c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f796c076300 0x7f796c078810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f798c073fb0 tx=0x7f7984008040 comp rx=0 tx=0).stop 2024-05-16T22:34:06.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 msgr2=0x7f798c143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:06.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c143b50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f797c009e50 tx=0x7f797c004a40 comp rx=0 tx=0).stop 2024-05-16T22:34:06.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 shutdown_connections 2024-05-16T22:34:06.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f796c076300 0x7f796c078810 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c14e670 0x7f798c143b50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f798c14e260 0x7f798c0bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 --2- 172.21.15.5:0/263918562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f798c148330 0x7f798c0bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:06.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 >> 172.21.15.5:0/263918562 conn(0x7f798c0c17c0 msgr2=0x7f798c145d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:06.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 shutdown_connections 2024-05-16T22:34:06.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:06.967+0000 7f7991297640 1 -- 172.21.15.5:0/263918562 wait complete. 2024-05-16T22:34:06.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:34:07.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.090+0000 7f949dc15640 1 Processor -- start 2024-05-16T22:34:07.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.090+0000 7f949dc15640 1 -- start start 2024-05-16T22:34:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f949dc15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94980bd6d0 0x7f94980be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f949dc15640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94980bee80 0x7f9498158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f949dc15640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949806e140 con 0x7f9498151fc0 2024-05-16T22:34:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f949dc15640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f94980c36f0 con 0x7f94980bee80 2024-05-16T22:34:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f949dc15640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9498152530 con 0x7f94980bd6d0 2024-05-16T22:34:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f9497fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94980bee80 0x7f9498158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f9497fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94980bee80 0x7f9498158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38110/0 (socket says 172.21.15.5:38110) 2024-05-16T22:34:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f9497fff640 1 -- 172.21.15.5:0/147874256 learned_addr learned my addr 172.21.15.5:0/147874256 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f9496ffd640 1 --2- 172.21.15.5:0/147874256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94980bd6d0 0x7f94980be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:07.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f9497fff640 1 -- 172.21.15.5:0/147874256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94980bd6d0 msgr2=0x7f94980be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:07.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f9497fff640 1 --2- 172.21.15.5:0/147874256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94980bd6d0 0x7f94980be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f9497fff640 1 -- 172.21.15.5:0/147874256 >> v1:172.21.15.157:6789/0 conn(0x7f9498151fc0 legacy=0x7f949806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:07.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.091+0000 7f9497fff640 1 -- 172.21.15.5:0/147874256 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9498152810 con 0x7f94980bee80 2024-05-16T22:34:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.092+0000 7f9497fff640 1 --2- 172.21.15.5:0/147874256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bee80 0x7f9498158e90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9490009e50 tx=0x7f949002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cae43d89742a8e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.092+0000 7f94967fc640 1 -- 172.21.15.5:0/147874256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490036070 con 0x7f94980bee80 2024-05-16T22:34:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.092+0000 7f94967fc640 1 -- 172.21.15.5:0/147874256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9490031600 con 0x7f94980bee80 2024-05-16T22:34:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.092+0000 7f94967fc640 1 -- 172.21.15.5:0/147874256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94900319d0 con 0x7f94980bee80 2024-05-16T22:34:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.093+0000 7f949dc15640 1 -- 172.21.15.5:0/147874256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bee80 msgr2=0x7f9498158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.093+0000 7f949dc15640 1 --2- 172.21.15.5:0/147874256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bee80 0x7f9498158e90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9490009e50 tx=0x7f949002a710 comp rx=0 tx=0).stop 2024-05-16T22:34:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.093+0000 7f949dc15640 1 -- 172.21.15.5:0/147874256 shutdown_connections 2024-05-16T22:34:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.093+0000 7f949dc15640 1 --2- 172.21.15.5:0/147874256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bee80 0x7f9498158e90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.093+0000 7f949dc15640 1 --2- 172.21.15.5:0/147874256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94980bd6d0 0x7f94980be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.093+0000 7f949dc15640 1 -- 172.21.15.5:0/147874256 >> 172.21.15.5:0/147874256 conn(0x7f94980c3d20 msgr2=0x7f94980c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.093+0000 7f949dc15640 1 -- 172.21.15.5:0/147874256 shutdown_connections 2024-05-16T22:34:07.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.093+0000 7f949dc15640 1 -- 172.21.15.5:0/147874256 wait complete. 2024-05-16T22:34:07.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.094+0000 7f949dc15640 1 Processor -- start 2024-05-16T22:34:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.095+0000 7f949dc15640 1 -- start start 2024-05-16T22:34:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f949dc15640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bd6d0 0x7f94980b9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f949dc15640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94980bee80 0x7f94981e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f949dc15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9498151fc0 0x7f94980b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f949dc15640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94980bdae0 con 0x7f94980bd6d0 2024-05-16T22:34:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f949dc15640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f94980c0070 con 0x7f94980bee80 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f949dc15640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f94980a2ed0 con 0x7f9498151fc0 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bd6d0 0x7f94980b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bd6d0 0x7f94980b9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38114/0 (socket says 172.21.15.5:38114) 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 -- 172.21.15.5:0/152909887 learned_addr learned my addr 172.21.15.5:0/152909887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f9496ffd640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94980bee80 0x7f94981e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f9497fff640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9498151fc0 0x7f94980b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 -- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9498151fc0 msgr2=0x7f94980b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9498151fc0 0x7f94980b8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 -- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94980bee80 msgr2=0x7f94981e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94980bee80 0x7f94981e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 -- 172.21.15.5:0/152909887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94981e7ff0 con 0x7f94980bd6d0 2024-05-16T22:34:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.096+0000 7f94977fe640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bd6d0 0x7f94980b9780 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c3d0 tx=0x7f948c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.097+0000 7f947ffff640 1 -- 172.21.15.5:0/152909887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c017070 con 0x7f94980bd6d0 2024-05-16T22:34:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.097+0000 7f947ffff640 1 -- 172.21.15.5:0/152909887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948c0052d0 con 0x7f94980bd6d0 2024-05-16T22:34:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.097+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94980b8770 con 0x7f94980bd6d0 2024-05-16T22:34:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.097+0000 7f947ffff640 1 -- 172.21.15.5:0/152909887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c003830 con 0x7f94980bd6d0 2024-05-16T22:34:07.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.097+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94980b9e90 con 0x7f94980bd6d0 2024-05-16T22:34:07.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.098+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9498050940 con 0x7f94980bd6d0 2024-05-16T22:34:07.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.098+0000 7f947ffff640 1 -- 172.21.15.5:0/152909887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f948c01a070 con 0x7f94980bd6d0 2024-05-16T22:34:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.099+0000 7f947ffff640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f94840762d0 0x7f94840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.099+0000 7f947ffff640 1 -- 172.21.15.5:0/152909887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f948c0965e0 con 0x7f94980bd6d0 2024-05-16T22:34:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.099+0000 7f9496ffd640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f94840762d0 0x7f94840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.100+0000 7f9496ffd640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f94840762d0 0x7f94840787e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f94981da950 tx=0x7f9488008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:07.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.104+0000 7f947ffff640 1 -- 172.21.15.5:0/152909887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f949806e140 con 0x7f94980bd6d0 2024-05-16T22:34:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.291+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f949814e300 con 0x7f94840762d0 2024-05-16T22:34:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.293+0000 7f947ffff640 1 -- 172.21.15.5:0/152909887 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7f949814e300 con 0x7f94840762d0 2024-05-16T22:34:07.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T22:34:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T22:34:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f94840762d0 msgr2=0x7f94840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f94840762d0 0x7f94840787e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f94981da950 tx=0x7f9488008040 comp rx=0 tx=0).stop 2024-05-16T22:34:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bd6d0 msgr2=0x7f94980b9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bd6d0 0x7f94980b9780 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c3d0 tx=0x7f948c00c890 comp rx=0 tx=0).stop 2024-05-16T22:34:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 shutdown_connections 2024-05-16T22:34:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f94840762d0 0x7f94840787e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9498151fc0 0x7f94980b8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94980bee80 0x7f94981e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 --2- 172.21.15.5:0/152909887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94980bd6d0 0x7f94980b9780 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 >> 172.21.15.5:0/152909887 conn(0x7f94980c3d20 msgr2=0x7f94980a4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 shutdown_connections 2024-05-16T22:34:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:07.295+0000 7f949dc15640 1 -- 172.21.15.5:0/152909887 wait complete. 2024-05-16T22:34:07.305 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1897,"stamp":"2024-05-16T22:34:07.214072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254804,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719916,"statfs":{"total":773094113280,"available":772833193984,"internally_reserved":0,"allocated":5480448,"data_stored":2907640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002643"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-16T22:30:24.470099+0000","last_change":"2024-05-16T21:32:12.462990+0000","last_active":"2024-05-16T22:30:24.470099+0000","last_peered":"2024-05-16T22:30:24.470099+0000","last_clean":"2024-05-16T22:30:24.470099+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T22:30:24.470099+0000","last_undegraded":"2024-05-16T22:30:24.470099+0000","last_fullsized":"2024-05-16T22:30:24.470099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T21:32:10.740253+0000","last_clean_scrub_stamp":"2024-05-16T21:32:10.740253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:34:54.971781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575595,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575595,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575595,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575595,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:34:07.308 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-16T21:32:10.740253+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=16, tm_hour=21, tm_min=32, tm_sec=10, tm_wday=3, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=16, tm_hour=22, tm_min=34, tm_sec=2, tm_wday=3, tm_yday=137, tm_isdst=0) 2024-05-16T22:34:07.308 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-16T22:34:17.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:17.608 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:17.611 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:27.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:34:27.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.437+0000 7f0dad1a9640 1 Processor -- start 2024-05-16T22:34:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.437+0000 7f0dad1a9640 1 -- start start 2024-05-16T22:34:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0dad1a9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0da814e530 0x7f0da80ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0dad1a9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0da80b8d70 0x7f0da80b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0dad1a9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da80ba860 con 0x7f0da80bd440 2024-05-16T22:34:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0dad1a9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0da80b88e0 con 0x7f0da80b8d70 2024-05-16T22:34:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0dad1a9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0da814ece0 con 0x7f0da814e530 2024-05-16T22:34:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0da759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0da80b8d70 0x7f0da80b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0d9ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0da80bd440 0x7f0da80bd850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59206/0 (socket says 172.21.15.5:59206) 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0d9ffff640 1 -- 172.21.15.5:0/3013031445 learned_addr learned my addr 172.21.15.5:0/3013031445 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0da6d9d640 1 --2- 172.21.15.5:0/3013031445 >> v2:172.21.15.157:3300/0 conn(0x7f0da814e530 0x7f0da80ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0da759e640 1 -- 172.21.15.5:0/3013031445 >> v2:172.21.15.157:3300/0 conn(0x7f0da814e530 msgr2=0x7f0da80ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0da759e640 1 --2- 172.21.15.5:0/3013031445 >> v2:172.21.15.157:3300/0 conn(0x7f0da814e530 0x7f0da80ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.438+0000 7f0da759e640 1 -- 172.21.15.5:0/3013031445 >> v1:172.21.15.5:6789/0 conn(0x7f0da80bd440 legacy=0x7f0da80bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.439+0000 7f0da759e640 1 -- 172.21.15.5:0/3013031445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da814efc0 con 0x7f0da80b8d70 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.439+0000 7f0da759e640 1 --2- 172.21.15.5:0/3013031445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da80b9180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0da808d0d0 tx=0x7f0da002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f5cc47ea984b34 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.439+0000 7f0da659c640 1 -- 172.21.15.5:0/3013031445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0007740 con 0x7f0da80b8d70 2024-05-16T22:34:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.439+0000 7f0da659c640 1 -- 172.21.15.5:0/3013031445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da00078e0 con 0x7f0da80b8d70 2024-05-16T22:34:27.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.439+0000 7f0da659c640 1 -- 172.21.15.5:0/3013031445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0007cb0 con 0x7f0da80b8d70 2024-05-16T22:34:27.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.440+0000 7f0dad1a9640 1 -- 172.21.15.5:0/3013031445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 msgr2=0x7f0da80b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.440+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/3013031445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da80b9180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0da808d0d0 tx=0x7f0da002a680 comp rx=0 tx=0).stop 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.440+0000 7f0dad1a9640 1 -- 172.21.15.5:0/3013031445 shutdown_connections 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.440+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/3013031445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da80b9180 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.440+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/3013031445 >> v2:172.21.15.157:3300/0 conn(0x7f0da814e530 0x7f0da80ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.440+0000 7f0dad1a9640 1 -- 172.21.15.5:0/3013031445 >> 172.21.15.5:0/3013031445 conn(0x7f0da80c0570 msgr2=0x7f0da80c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.440+0000 7f0dad1a9640 1 -- 172.21.15.5:0/3013031445 shutdown_connections 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.440+0000 7f0dad1a9640 1 -- 172.21.15.5:0/3013031445 wait complete. 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.442+0000 7f0dad1a9640 1 Processor -- start 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.442+0000 7f0dad1a9640 1 -- start start 2024-05-16T22:34:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0dad1a9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da81db160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0dad1a9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0da80bd440 0x7f0da81e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0dad1a9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0da814e530 0x7f0da814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0dad1a9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0da80b96c0 con 0x7f0da80b8d70 2024-05-16T22:34:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0dad1a9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0da80bbb70 con 0x7f0da814e530 2024-05-16T22:34:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0dad1a9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0da814e940 con 0x7f0da80bd440 2024-05-16T22:34:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0da6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da81db160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0da6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da81db160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55446/0 (socket says 172.21.15.5:55446) 2024-05-16T22:34:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0da6d9d640 1 -- 172.21.15.5:0/704818471 learned_addr learned my addr 172.21.15.5:0/704818471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0da759e640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0da814e530 0x7f0da814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0d9ffff640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0da80bd440 0x7f0da81e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.443+0000 7f0da6d9d640 1 -- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0da80bd440 msgr2=0x7f0da81e8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0da6d9d640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0da80bd440 0x7f0da81e8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0da6d9d640 1 -- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0da814e530 msgr2=0x7f0da814d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0da6d9d640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0da814e530 0x7f0da814d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0da6d9d640 1 -- 172.21.15.5:0/704818471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da81db6a0 con 0x7f0da80b8d70 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0d9ffff640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0da80bd440 0x7f0da81e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0da759e640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0da814e530 0x7f0da814d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0da6d9d640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da81db160 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800e8a0 tx=0x7f0d9800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0d9f7fe640 1 -- 172.21.15.5:0/704818471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98017070 con 0x7f0da80b8d70 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0d9f7fe640 1 -- 172.21.15.5:0/704818471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9800c940 con 0x7f0da80b8d70 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da81e8780 con 0x7f0da80b8d70 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0d9f7fe640 1 -- 172.21.15.5:0/704818471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800ccf0 con 0x7f0da80b8d70 2024-05-16T22:34:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.444+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da814cdc0 con 0x7f0da80b8d70 2024-05-16T22:34:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.445+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da81447e0 con 0x7f0da80b8d70 2024-05-16T22:34:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.446+0000 7f0d9f7fe640 1 -- 172.21.15.5:0/704818471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d9801a070 con 0x7f0da80b8d70 2024-05-16T22:34:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.446+0000 7f0d9f7fe640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0d880762d0 0x7f0d880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.446+0000 7f0d9f7fe640 1 -- 172.21.15.5:0/704818471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f0d98097640 con 0x7f0da80b8d70 2024-05-16T22:34:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.447+0000 7f0d9ffff640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0d880762d0 0x7f0d880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.447+0000 7f0d9ffff640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0d880762d0 0x7f0d880787e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0da814bfb0 tx=0x7f0d90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.451+0000 7f0d9f7fe640 1 -- 172.21.15.5:0/704818471 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0d98061240 con 0x7f0da80b8d70 2024-05-16T22:34:27.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.639+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 --> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0da8050940 con 0x7f0d880762d0 2024-05-16T22:34:27.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.640+0000 7f0d9f7fe640 1 -- 172.21.15.5:0/704818471 <== mgr.4100 v2:172.21.15.157:6832/37216281 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13345 (secure 0 0 0) 0x7f0da8050940 con 0x7f0d880762d0 2024-05-16T22:34:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T22:34:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-05-16T22:34:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0d880762d0 msgr2=0x7f0d880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0d880762d0 0x7f0d880787e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0da814bfb0 tx=0x7f0d90009040 comp rx=0 tx=0).stop 2024-05-16T22:34:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 msgr2=0x7f0da81db160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da81db160 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800e8a0 tx=0x7f0d9800ed60 comp rx=0 tx=0).stop 2024-05-16T22:34:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 shutdown_connections 2024-05-16T22:34:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f0d880762d0 0x7f0d880787e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0da814e530 0x7f0da814d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0da80bd440 0x7f0da81e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 --2- 172.21.15.5:0/704818471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0da80b8d70 0x7f0da81db160 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 >> 172.21.15.5:0/704818471 conn(0x7f0da80c0570 msgr2=0x7f0da80bdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:27.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 shutdown_connections 2024-05-16T22:34:27.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.642+0000 7f0dad1a9640 1 -- 172.21.15.5:0/704818471 wait complete. 2024-05-16T22:34:27.652 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1907,"stamp":"2024-05-16T22:34:27.218636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254796,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719924,"statfs":{"total":773094113280,"available":772833202176,"internally_reserved":0,"allocated":5480448,"data_stored":2907640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002584"},"pg_stats":[{"pgid":"1.0","version":"45'74","reported_seq":197,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-16T22:34:07.497723+0000","last_change":"2024-05-16T22:34:07.497769+0000","last_active":"2024-05-16T22:34:07.497723+0000","last_peered":"2024-05-16T22:34:07.497723+0000","last_clean":"2024-05-16T22:34:07.497723+0000","last_became_active":"2024-05-16T21:32:12.461913+0000","last_became_peered":"2024-05-16T21:32:12.461913+0000","last_unstale":"2024-05-16T22:34:07.497723+0000","last_undegraded":"2024-05-16T22:34:07.497723+0000","last_fullsized":"2024-05-16T22:34:07.497723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'74","last_scrub_stamp":"2024-05-16T22:34:07.497628+0000","last_deep_scrub":"45'74","last_deep_scrub_stamp":"2024-05-16T22:34:07.497628+0000","last_clean_scrub_stamp":"2024-05-16T22:34:07.497628+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:15:57.755347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575599,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575599,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1130496,"data_stored":806231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:34:27.653 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-16T22:34:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.764+0000 7fecc755e640 1 Processor -- start 2024-05-16T22:34:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.765+0000 7fecc755e640 1 -- start start 2024-05-16T22:34:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc755e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fecc0148910 0x7fecc014e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc755e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fecc014eba0 0x7fecc0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc755e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc00ba800 con 0x7fecc00a9060 2024-05-16T22:34:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc755e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fecc00b8a30 con 0x7fecc014eba0 2024-05-16T22:34:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc755e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fecc00b8d10 con 0x7fecc0148910 2024-05-16T22:34:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc5afb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fecc014eba0 0x7fecc0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc5afb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fecc014eba0 0x7fecc0158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55458/0 (socket says 172.21.15.5:55458) 2024-05-16T22:34:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc5afb640 1 -- 172.21.15.5:0/1020974824 learned_addr learned my addr 172.21.15.5:0/1020974824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc4af9640 1 --2- 172.21.15.5:0/1020974824 >> v2:172.21.15.157:3300/0 conn(0x7fecc0148910 0x7fecc014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc5afb640 1 -- 172.21.15.5:0/1020974824 >> v2:172.21.15.157:3300/0 conn(0x7fecc0148910 msgr2=0x7fecc014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc5afb640 1 --2- 172.21.15.5:0/1020974824 >> v2:172.21.15.157:3300/0 conn(0x7fecc0148910 0x7fecc014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc5afb640 1 -- 172.21.15.5:0/1020974824 >> v1:172.21.15.157:6789/0 conn(0x7fecc00a9060 legacy=0x7fecc00ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc5afb640 1 -- 172.21.15.5:0/1020974824 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc00b8ff0 con 0x7fecc014eba0 2024-05-16T22:34:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.766+0000 7fecc4af9640 1 --2- 172.21.15.5:0/1020974824 >> v2:172.21.15.157:3300/0 conn(0x7fecc0148910 0x7fecc014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:34:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.767+0000 7fecc5afb640 1 --2- 172.21.15.5:0/1020974824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc014eba0 0x7fecc0158db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fecc00c0370 tx=0x7fecb002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de728d006b47784f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.767+0000 7fecbffff640 1 -- 172.21.15.5:0/1020974824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0036070 con 0x7fecc014eba0 2024-05-16T22:34:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.767+0000 7fecbffff640 1 -- 172.21.15.5:0/1020974824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb0031600 con 0x7fecc014eba0 2024-05-16T22:34:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.767+0000 7fecbffff640 1 -- 172.21.15.5:0/1020974824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb00319d0 con 0x7fecc014eba0 2024-05-16T22:34:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.768+0000 7fecc755e640 1 -- 172.21.15.5:0/1020974824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc014eba0 msgr2=0x7fecc0158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.768+0000 7fecc755e640 1 --2- 172.21.15.5:0/1020974824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc014eba0 0x7fecc0158db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fecc00c0370 tx=0x7fecb002a730 comp rx=0 tx=0).stop 2024-05-16T22:34:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.768+0000 7fecc755e640 1 -- 172.21.15.5:0/1020974824 shutdown_connections 2024-05-16T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.768+0000 7fecc755e640 1 --2- 172.21.15.5:0/1020974824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc014eba0 0x7fecc0158db0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.768+0000 7fecc755e640 1 --2- 172.21.15.5:0/1020974824 >> v2:172.21.15.157:3300/0 conn(0x7fecc0148910 0x7fecc014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.768+0000 7fecc755e640 1 -- 172.21.15.5:0/1020974824 >> 172.21.15.5:0/1020974824 conn(0x7fecc00c07c0 msgr2=0x7fecc00c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.768+0000 7fecc755e640 1 -- 172.21.15.5:0/1020974824 shutdown_connections 2024-05-16T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.768+0000 7fecc755e640 1 -- 172.21.15.5:0/1020974824 wait complete. 2024-05-16T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.770+0000 7fecc755e640 1 Processor -- start 2024-05-16T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.770+0000 7fecc755e640 1 -- start start 2024-05-16T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc755e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc00a9060 0x7fecc01426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc755e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc0148910 0x7fecc013dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc755e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecc014eba0 0x7fecc013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc755e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fecc008d400 con 0x7fecc00a9060 2024-05-16T22:34:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc755e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fecc014efb0 con 0x7fecc0148910 2024-05-16T22:34:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc755e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fecc008d580 con 0x7fecc014eba0 2024-05-16T22:34:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc00a9060 0x7fecc01426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc00a9060 0x7fecc01426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55466/0 (socket says 172.21.15.5:55466) 2024-05-16T22:34:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 -- 172.21.15.5:0/2691338743 learned_addr learned my addr 172.21.15.5:0/2691338743 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc4af9640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc0148910 0x7fecc013dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc5afb640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecc014eba0 0x7fecc013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 -- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecc014eba0 msgr2=0x7fecc013e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecc014eba0 0x7fecc013e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 -- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc0148910 msgr2=0x7fecc013dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc0148910 0x7fecc013dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 -- 172.21.15.5:0/2691338743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc0142c20 con 0x7fecc00a9060 2024-05-16T22:34:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecc52fa640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc00a9060 0x7fecc01426e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b3f0 tx=0x7fecb800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecbdffb640 1 -- 172.21.15.5:0/2691338743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8015020 con 0x7fecc00a9060 2024-05-16T22:34:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.771+0000 7fecbdffb640 1 -- 172.21.15.5:0/2691338743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8011830 con 0x7fecc00a9060 2024-05-16T22:34:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.772+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc0144270 con 0x7fecc00a9060 2024-05-16T22:34:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.772+0000 7fecbdffb640 1 -- 172.21.15.5:0/2691338743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8011c20 con 0x7fecc00a9060 2024-05-16T22:34:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.772+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc00c3400 con 0x7fecc00a9060 2024-05-16T22:34:27.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.773+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc00ba9e0 con 0x7fecc00a9060 2024-05-16T22:34:27.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.774+0000 7fecbdffb640 1 -- 172.21.15.5:0/2691338743 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fecb8018020 con 0x7fecc00a9060 2024-05-16T22:34:27.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.774+0000 7fecbdffb640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fecac0762d0 0x7fecac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.774+0000 7fecbdffb640 1 -- 172.21.15.5:0/2691338743 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7fecb8096e90 con 0x7fecc00a9060 2024-05-16T22:34:27.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.774+0000 7fecc4af9640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fecac0762d0 0x7fecac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.775+0000 7fecc4af9640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fecac0762d0 0x7fecac0787e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fecc00bcf30 tx=0x7fecb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:27.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.779+0000 7fecbdffb640 1 -- 172.21.15.5:0/2691338743 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fecb801f030 con 0x7fecc00a9060 2024-05-16T22:34:27.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.974+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fecc0050940 con 0x7fecc00a9060 2024-05-16T22:34:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.977+0000 7fecbdffb640 1 -- 172.21.15.5:0/2691338743 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fecb8060b20 con 0x7fecc00a9060 2024-05-16T22:34:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.978+0000 7fecbdffb640 1 -- 172.21.15.5:0/2691338743 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fecb805ff30 con 0x7fecc00a9060 2024-05-16T22:34:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fecac0762d0 msgr2=0x7fecac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fecac0762d0 0x7fecac0787e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fecc00bcf30 tx=0x7fecb4008040 comp rx=0 tx=0).stop 2024-05-16T22:34:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc00a9060 msgr2=0x7fecc01426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc00a9060 0x7fecc01426e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b3f0 tx=0x7fecb800b8b0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 shutdown_connections 2024-05-16T22:34:27.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7fecac0762d0 0x7fecac0787e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecc014eba0 0x7fecc013e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecc0148910 0x7fecc013dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 --2- 172.21.15.5:0/2691338743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecc00a9060 0x7fecc01426e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 >> 172.21.15.5:0/2691338743 conn(0x7fecc00c07c0 msgr2=0x7fecc014dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:27.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 shutdown_connections 2024-05-16T22:34:27.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:27.980+0000 7fecc755e640 1 -- 172.21.15.5:0/2691338743 wait complete. 2024-05-16T22:34:27.990 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-16T22:34:27.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:34:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.102+0000 7f94130e2640 1 Processor -- start 2024-05-16T22:34:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.102+0000 7f94130e2640 1 -- start start 2024-05-16T22:34:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.103+0000 7f94130e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.103+0000 7f94130e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f940c14c8e0 0x7f940c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.103+0000 7f94130e2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940c071150 con 0x7f940c0bc1c0 2024-05-16T22:34:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.103+0000 7f94130e2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f940c14c450 con 0x7f940c14c8e0 2024-05-16T22:34:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.103+0000 7f94130e2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f940c14c120 con 0x7f940c0a0ba0 2024-05-16T22:34:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f9410e7e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f940c0bc1c0 0x7f940c070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59212/0 (socket says 172.21.15.5:59212) 2024-05-16T22:34:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f9410e7e640 1 -- 172.21.15.5:0/303364050 learned_addr learned my addr 172.21.15.5:0/303364050 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-05-16T22:34:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f941167f640 1 --2- 172.21.15.5:0/303364050 >> v2:172.21.15.5:3300/0 conn(0x7f940c14c8e0 0x7f940c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f940bfff640 1 --2- 172.21.15.5:0/303364050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f940b7fe640 1 -- 172.21.15.5:0/303364050 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073088872 0 0) 0x7f9404001490 con 0x7f940c0bc1c0 2024-05-16T22:34:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f940b7fe640 1 -- 172.21.15.5:0/303364050 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93f4003520 con 0x7f940c0bc1c0 2024-05-16T22:34:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f941167f640 1 -- 172.21.15.5:0/303364050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 msgr2=0x7f940c146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f941167f640 1 --2- 172.21.15.5:0/303364050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f941167f640 1 -- 172.21.15.5:0/303364050 >> v1:172.21.15.5:6789/0 conn(0x7f940c0bc1c0 legacy=0x7f940c070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f941167f640 1 -- 172.21.15.5:0/303364050 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c071e40 con 0x7f940c14c8e0 2024-05-16T22:34:28.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.104+0000 7f940bfff640 1 --2- 172.21.15.5:0/303364050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:28.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.105+0000 7f941167f640 1 --2- 172.21.15.5:0/303364050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c14ccf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097a0 tx=0x7f93fc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6837d5a2327759f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:28.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.105+0000 7f940b7fe640 1 -- 172.21.15.5:0/303364050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc037070 con 0x7f940c14c8e0 2024-05-16T22:34:28.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.105+0000 7f940b7fe640 1 -- 172.21.15.5:0/303364050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f93fc02ae50 con 0x7f940c14c8e0 2024-05-16T22:34:28.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.105+0000 7f940b7fe640 1 -- 172.21.15.5:0/303364050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc032680 con 0x7f940c14c8e0 2024-05-16T22:34:28.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.105+0000 7f94130e2640 1 -- 172.21.15.5:0/303364050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 msgr2=0x7f940c14ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:28.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.105+0000 7f94130e2640 1 --2- 172.21.15.5:0/303364050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c14ccf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097a0 tx=0x7f93fc02a100 comp rx=0 tx=0).stop 2024-05-16T22:34:28.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.106+0000 7f94130e2640 1 -- 172.21.15.5:0/303364050 shutdown_connections 2024-05-16T22:34:28.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.106+0000 7f94130e2640 1 --2- 172.21.15.5:0/303364050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c14ccf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.106+0000 7f94130e2640 1 --2- 172.21.15.5:0/303364050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.106+0000 7f94130e2640 1 -- 172.21.15.5:0/303364050 >> 172.21.15.5:0/303364050 conn(0x7f940c0c17c0 msgr2=0x7f940c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.106+0000 7f94130e2640 1 -- 172.21.15.5:0/303364050 shutdown_connections 2024-05-16T22:34:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.106+0000 7f94130e2640 1 -- 172.21.15.5:0/303364050 wait complete. 2024-05-16T22:34:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.107+0000 7f94130e2640 1 Processor -- start 2024-05-16T22:34:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.107+0000 7f94130e2640 1 -- start start 2024-05-16T22:34:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f94130e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f94130e2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f940c0bc1c0 0x7f940c1e2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f94130e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c13f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f94130e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0a0fb0 con 0x7f940c14c8e0 2024-05-16T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f94130e2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0716b0 con 0x7f940c0bc1c0 2024-05-16T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f94130e2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f940c0bd5f0 con 0x7f940c0a0ba0 2024-05-16T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f941167f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c13f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f941167f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c13f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55480/0 (socket says 172.21.15.5:55480) 2024-05-16T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.108+0000 7f941167f640 1 -- 172.21.15.5:0/4122676804 learned_addr learned my addr 172.21.15.5:0/4122676804 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-05-16T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f9410e7e640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f940bfff640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f940c0bc1c0 0x7f940c1e2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f941167f640 1 -- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 msgr2=0x7f940c145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f941167f640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f941167f640 1 -- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f940c0bc1c0 msgr2=0x7f940c1e2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f941167f640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f940c0bc1c0 0x7f940c1e2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f941167f640 1 -- 172.21.15.5:0/4122676804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c145740 con 0x7f940c14c8e0 2024-05-16T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f9410e7e640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f940bfff640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f940c0bc1c0 0x7f940c1e2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:34:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f941167f640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c13f500 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0098c0 tx=0x7f93fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f94097fa640 1 -- 172.21.15.5:0/4122676804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc041020 con 0x7f940c14c8e0 2024-05-16T22:34:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f94097fa640 1 -- 172.21.15.5:0/4122676804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f93fc03c670 con 0x7f940c14c8e0 2024-05-16T22:34:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c1e3020 con 0x7f940c14c8e0 2024-05-16T22:34:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f94097fa640 1 -- 172.21.15.5:0/4122676804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc037040 con 0x7f940c14c8e0 2024-05-16T22:34:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.109+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c0a7330 con 0x7f940c14c8e0 2024-05-16T22:34:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.110+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940c149b20 con 0x7f940c14c8e0 2024-05-16T22:34:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.111+0000 7f94097fa640 1 -- 172.21.15.5:0/4122676804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93fc044020 con 0x7f940c14c8e0 2024-05-16T22:34:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.111+0000 7f94097fa640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93f80762d0 0x7f93f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.111+0000 7f94097fa640 1 -- 172.21.15.5:0/4122676804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5029+0+0 (secure 0 0 0) 0x7f93fc0b7c40 con 0x7f940c14c8e0 2024-05-16T22:34:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.111+0000 7f9410e7e640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93f80762d0 0x7f93f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.112+0000 7f9410e7e640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93f80762d0 0x7f93f80787e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9404001770 tx=0x7f9404009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.116+0000 7f94097fa640 1 -- 172.21.15.5:0/4122676804 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93fc04b030 con 0x7f940c14c8e0 2024-05-16T22:34:28.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.347+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f940c0a7080 con 0x7f940c14c8e0 2024-05-16T22:34:28.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.348+0000 7f94097fa640 1 -- 172.21.15.5:0/4122676804 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+3041 (secure 0 0 0) 0x7f93fc0817b0 con 0x7f940c14c8e0 2024-05-16T22:34:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-05-16T22:34:28.348 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3130634553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3130634553},{"type":"v1","addr":"172.21.15.5:6833","nonce":3130634553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1649181153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1649181153},{"type":"v1","addr":"172.21.15.157:6835","nonce":1649181153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5331,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4216870969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4216870969},{"type":"v1","addr":"172.21.15.5:6835","nonce":4216870969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[]} 2024-05-16T22:34:28.348 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 33 2024-05-16T22:34:28.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93f80762d0 msgr2=0x7f93f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:28.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93f80762d0 0x7f93f80787e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9404001770 tx=0x7f9404009040 comp rx=0 tx=0).stop 2024-05-16T22:34:28.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 msgr2=0x7f940c13f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:28.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c13f500 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0098c0 tx=0x7f93fc0046c0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 shutdown_connections 2024-05-16T22:34:28.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:6832/37216281,v1:172.21.15.157:6833/37216281] conn(0x7f93f80762d0 0x7f93f80787e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f940c14c8e0 0x7f940c13f500 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f940c0bc1c0 0x7f940c1e2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 --2- 172.21.15.5:0/4122676804 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f940c0a0ba0 0x7f940c145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:28.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 >> 172.21.15.5:0/4122676804 conn(0x7f940c0c17c0 msgr2=0x7f940c0be060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:28.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 shutdown_connections 2024-05-16T22:34:28.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-05-16T22:34:28.350+0000 7f94130e2640 1 -- 172.21.15.5:0/4122676804 wait complete. 2024-05-16T22:34:28.360 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-16T22:34:28.360 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-16T22:34:28.361 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-16T22:34:28.361 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.371 INFO:tasks.ceph.mds.a:Stopped 2024-05-16T22:34:28.371 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-16T22:34:28.371 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.423 INFO:tasks.ceph.mds.c:Stopped 2024-05-16T22:34:28.424 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-16T22:34:28.424 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.437 INFO:tasks.ceph.mds.b:Stopped 2024-05-16T22:34:28.437 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-16T22:34:28.437 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-16T22:34:28.437 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.503 INFO:tasks.ceph.osd.0:Stopped 2024-05-16T22:34:28.504 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-16T22:34:28.504 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.570 INFO:tasks.ceph.osd.1:Stopped 2024-05-16T22:34:28.570 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-16T22:34:28.570 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.641 INFO:tasks.ceph.osd.2:Stopped 2024-05-16T22:34:28.642 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-16T22:34:28.642 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.718 INFO:tasks.ceph.osd.3:Stopped 2024-05-16T22:34:28.718 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-16T22:34:28.719 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.753 INFO:tasks.ceph.osd.4:Stopped 2024-05-16T22:34:28.754 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-16T22:34:28.754 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.821 INFO:tasks.ceph.osd.5:Stopped 2024-05-16T22:34:28.822 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-16T22:34:28.822 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.894 INFO:tasks.ceph.osd.6:Stopped 2024-05-16T22:34:28.894 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-16T22:34:28.894 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.959 INFO:tasks.ceph.osd.7:Stopped 2024-05-16T22:34:28.960 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-16T22:34:28.960 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-16T22:34:28.960 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:28.986 INFO:tasks.ceph.mgr.y:Stopped 2024-05-16T22:34:28.987 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-16T22:34:28.987 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:29.029 INFO:tasks.ceph.mgr.x:Stopped 2024-05-16T22:34:29.029 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-16T22:34:29.030 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-16T22:34:29.030 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:29.042 INFO:tasks.ceph.mon.a:Stopped 2024-05-16T22:34:29.042 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-16T22:34:29.043 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:29.082 INFO:tasks.ceph.mon.b:Stopped 2024-05-16T22:34:29.082 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-16T22:34:29.082 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:34:29.135 INFO:tasks.ceph.mon.c:Stopped 2024-05-16T22:34:29.135 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-16T22:34:29.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-16T22:34:29.171 INFO:teuthology.orchestra.run.smithi005.stdout:2024-05-16T21:33:49.125841+0000 mds.c (mds.0) 1 : cluster [ERR] bad backtrace on directory inode 0x10000000001 2024-05-16T22:34:29.172 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-05-16T22:34:29.172 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T22:34:29.172 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-16T22:34:29.386 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T22:34:29.386 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-16T22:34:29.546 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T22:34:29.546 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-16T22:34:29.595 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T22:34:29.595 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-16T22:34:29.635 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T22:34:29.635 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-16T22:34:29.798 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T22:34:29.798 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-16T22:34:29.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T22:34:29.869 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-16T22:34:29.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T22:34:29.926 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-16T22:34:29.992 INFO:tasks.ceph:Archiving mon data... 2024-05-16T22:34:29.994 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/data/mon.a.tgz 2024-05-16T22:34:29.994 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-05-16T22:34:30.011 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.kPzJxKQOIN 2024-05-16T22:34:30.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kPzJxKQOIN 2024-05-16T22:34:30.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.kPzJxKQOIN 2024-05-16T22:34:30.214 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.kPzJxKQOIN is 238KB 2024-05-16T22:34:30.308 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.kPzJxKQOIN 2024-05-16T22:34:30.324 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/data/mon.b.tgz 2024-05-16T22:34:30.324 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-05-16T22:34:30.341 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.M9XDsBGt0e 2024-05-16T22:34:30.341 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.M9XDsBGt0e 2024-05-16T22:34:30.463 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.M9XDsBGt0e 2024-05-16T22:34:30.544 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.M9XDsBGt0e is 244KB 2024-05-16T22:34:30.636 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.M9XDsBGt0e 2024-05-16T22:34:30.650 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/data/mon.c.tgz 2024-05-16T22:34:30.651 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-05-16T22:34:30.705 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.NNIvSufU5U 2024-05-16T22:34:30.705 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.NNIvSufU5U 2024-05-16T22:34:30.810 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.NNIvSufU5U 2024-05-16T22:34:30.891 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.NNIvSufU5U is 244KB 2024-05-16T22:34:30.955 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.NNIvSufU5U 2024-05-16T22:34:30.970 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-16T22:34:30.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-16T22:34:30.973 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-16T22:34:31.012 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-16T22:34:31.117 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-16T22:34:31.131 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-16T22:34:31.186 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-16T22:34:31.186 INFO:tasks.ceph:Archiving crash dumps... 2024-05-16T22:34:31.188 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi005/crash 2024-05-16T22:34:31.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-16T22:34:31.216 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi157/crash 2024-05-16T22:34:31.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-16T22:34:31.241 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi181/crash 2024-05-16T22:34:31.241 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-16T22:34:31.336 INFO:tasks.ceph:Shutting down logrotate 2024-05-16T22:34:31.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:31.339 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:31.342 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:31.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:31.478 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:31.501 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:31.586 INFO:tasks.ceph:Compressing logs... 2024-05-16T22:34:31.586 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-16T22:34:31.589 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-16T22:34:31.591 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-16T22:34:31.611 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37758.log 2024-05-16T22:34:31.611 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-16T22:34:31.615 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37718.log 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37758.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37758.log.gz 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37718.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37718.log.gz 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-16T22:34:31.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-16T22:34:31.617 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.x.log: 93.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37627.log 2024-05-16T22:34:31.617 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-16T22:34:31.617 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-16T22:34:31.617 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37627.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37627.log.gz 2024-05-16T22:34:31.617 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 2024-05-16T22:34:31.634 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.6.log: 95.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-16T22:34:31.634 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37587.log 2024-05-16T22:34:31.634 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37678.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-05-16T22:34:31.634 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37547.log 2024-05-16T22:34:31.634 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37587.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37587.log.gz 2024-05-16T22:34:31.634 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37838.log 2024-05-16T22:34:31.634 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37547.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37547.log.gz 2024-05-16T22:34:31.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37798.log 2024-05-16T22:34:31.635 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37838.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37838.log.gz 2024-05-16T22:34:31.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-16T22:34:31.635 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37798.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37798.log.gz 2024-05-16T22:34:31.655 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2024-05-16T22:34:31.655 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50172.log 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43115.log 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45851.log 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50172.log.gz 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47878.log 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43115.log.gz 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48106.log 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45851.log.gz 2024-05-16T22:34:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44890.log 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46061.log 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47878.log.gz 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53389.log 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48106.log.gz 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44890.log.gz 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47649.log 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46061.log.gz 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47565.log 2024-05-16T22:34:31.657 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53389.log.gz 2024-05-16T22:34:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43470.log 2024-05-16T22:34:31.658 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47649.log.gz 2024-05-16T22:34:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46147.log 2024-05-16T22:34:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47565.log: /var/log/ceph/ceph-client.admin.43470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48936.log 2024-05-16T22:34:31.658 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47565.log.gz 2024-05-16T22:34:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46147.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.43470.log.gz -5 2024-05-16T22:34:31.658 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44885.log 2024-05-16T22:34:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48936.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46147.log.gz 2024-05-16T22:34:31.659 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49590.log 2024-05-16T22:34:31.659 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48936.log.gz 2024-05-16T22:34:31.659 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44556.log 2024-05-16T22:34:31.659 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44885.log.gz 2024-05-16T22:34:31.659 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49394.log 2024-05-16T22:34:31.659 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49590.log.gz 2024-05-16T22:34:31.659 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44219.log 2024-05-16T22:34:31.659 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44556.log.gz 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53347.log 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49394.log.gz 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45172.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44219.log.gz 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44881.log 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49967.log 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53347.log.gz 2024-05-16T22:34:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2024-05-16T22:34:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49967.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44881.log.gz 2024-05-16T22:34:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-16T22:34:31.661 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49967.log.gz 2024-05-16T22:34:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46603.log 2024-05-16T22:34:31.661 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2024-05-16T22:34:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38270.log 2024-05-16T22:34:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44549.log 2024-05-16T22:34:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46434.log 2024-05-16T22:34:31.662 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46603.log.gz 2024-05-16T22:34:31.662 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38270.log: /var/log/ceph/ceph-client.admin.44549.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38270.log.gz 2024-05-16T22:34:31.662 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52927.log 2024-05-16T22:34:31.662 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46434.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44549.log.gz 2024-05-16T22:34:31.662 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48554.log 2024-05-16T22:34:31.662 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46434.log.gz 2024-05-16T22:34:31.662 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52927.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-16T22:34:31.662 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48554.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52927.log.gz 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49086.log 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48554.log.gz 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43428.log 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52675.log 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49086.log.gz 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53053.log 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53095.log 2024-05-16T22:34:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52675.log: /var/log/ceph/ceph-client.admin.53053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48004.log 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52675.log.gz 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53053.log.gz 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48852.log 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48004.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53095.log.gz 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47184.log 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48004.log.gz 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2024-05-16T22:34:31.664 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48852.log.gz 2024-05-16T22:34:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47184.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-16T22:34:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45574.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.47184.log.gz -5 2024-05-16T22:34:31.665 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2024-05-16T22:34:31.665 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2024-05-16T22:34:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48638.log 2024-05-16T22:34:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48978.log 2024-05-16T22:34:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48638.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2024-05-16T22:34:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46350.log 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 88.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48638.log.gz -- 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.46974.log 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48978.log: /var/log/ceph/ceph-client.admin.46350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46974.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46350.log.gz 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48978.log.gz 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46775.log 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46974.log.gz 2024-05-16T22:34:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48046.log 2024-05-16T22:34:31.667 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45616.log: /var/log/ceph/ceph-client.admin.46775.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-16T22:34:31.667 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-05-16T22:34:31.667 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47397.log 2024-05-16T22:34:31.667 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46775.log.gz 2024-05-16T22:34:31.667 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48046.log.gz 2024-05-16T22:34:31.667 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46645.log 2024-05-16T22:34:31.667 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49190.log 2024-05-16T22:34:31.667 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47397.log.gz 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47836.log 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46645.log.gz 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44891.log 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45935.log 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49190.log.gz 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47836.log.gz 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53573.log 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45935.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44891.log.gz 2024-05-16T22:34:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45298.log 2024-05-16T22:34:31.669 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45935.log.gz 2024-05-16T22:34:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47481.log 2024-05-16T22:34:31.669 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53573.log.gz 2024-05-16T22:34:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46477.log 2024-05-16T22:34:31.669 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45298.log.gz 2024-05-16T22:34:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53221.log 2024-05-16T22:34:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47481.log: /var/log/ceph/ceph-client.admin.46477.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-16T22:34:31.669 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47481.log.gz 2024-05-16T22:34:31.670 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46477.log.gz 2024-05-16T22:34:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44212.log 2024-05-16T22:34:31.670 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53221.log.gz 2024-05-16T22:34:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2024-05-16T22:34:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.44212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48810.log 2024-05-16T22:34:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43304.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44212.log.gz 2024-05-16T22:34:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44215.log 2024-05-16T22:34:31.670 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49841.log 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48684.log 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48810.log.gz 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44215.log: /var/log/ceph/ceph-client.admin.49841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52759.log 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44215.log.gz 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48684.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49841.log.gz 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48684.log.gz 2024-05-16T22:34:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47794.log 2024-05-16T22:34:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-16T22:34:31.672 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52759.log.gz 2024-05-16T22:34:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.47794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47607.log 2024-05-16T22:34:31.672 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47794.log.gz 2024-05-16T22:34:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49925.log 2024-05-16T22:34:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47607.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47607.log.gz 2024-05-16T22:34:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53263.log 2024-05-16T22:34:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48726.log/var/log/ceph/ceph-client.admin.49925.log: 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53263.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49925.log.gz 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53263.log.gz 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43996.log 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.48726.log.gz 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43514.log 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46687.log 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43996.log.gz 2024-05-16T22:34:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43514.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43514.log.gz 2024-05-16T22:34:31.674 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46104.log 2024-05-16T22:34:31.674 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47523.log 2024-05-16T22:34:31.674 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46687.log.gz 2024-05-16T22:34:31.674 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44551.log 2024-05-16T22:34:31.674 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47523.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46104.log.gz 2024-05-16T22:34:31.674 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44214.log 2024-05-16T22:34:31.674 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47523.log.gz 2024-05-16T22:34:31.674 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45809.log 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44551.log: /var/log/ceph/ceph-client.admin.44214.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44551.log.gz 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48459.log 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44214.log.gz 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45893.log 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48459.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45809.log.gz 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48459.log.gz 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46868.log 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46519.log 2024-05-16T22:34:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45893.log: /var/log/ceph/ceph-client.admin.46868.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45893.log.gz 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46868.log.gz 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49757.log 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53305.log 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46519.log: /var/log/ceph/ceph-client.admin.49757.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46519.log.gz 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44889.log 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49757.log.gz 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43642.log 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53305.log: /var/log/ceph/ceph-client.admin.44889.log: 88.5% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53305.log.gz 2024-05-16T22:34:31.676 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44889.log.gz 2024-05-16T22:34:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48249.log 2024-05-16T22:34:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46189.log 2024-05-16T22:34:31.677 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43642.log.gz 2024-05-16T22:34:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48249.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-16T22:34:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46189.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48249.log.gz 2024-05-16T22:34:31.677 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46189.log.gz 2024-05-16T22:34:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49044.log 2024-05-16T22:34:31.679 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.b.log: 94.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-16T22:34:31.683 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31645.log 2024-05-16T22:34:31.683 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30540.log 2024-05-16T22:34:31.683 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.31645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30977.log 2024-05-16T22:34:31.683 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31645.log.gz 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.30540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30559.log 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30540.log.gz 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.30977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30977.log.gz 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31641.log 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.30559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30559.log.gz 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30973.log 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.31641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31641.log.gz 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.30973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30973.log.gz 2024-05-16T22:34:31.684 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-05-16T22:34:31.685 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m0.040s 2024-05-16T22:34:31.685 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m0.011s 2024-05-16T22:34:31.685 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.066s 2024-05-16T22:34:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44545.log 2024-05-16T22:34:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49044.log: /var/log/ceph/ceph-mon.a.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49044.log.gz 2024-05-16T22:34:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45382.log 2024-05-16T22:34:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44545.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44545.log.gz 2024-05-16T22:34:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49883.log 2024-05-16T22:34:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45382.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45382.log.gz 2024-05-16T22:34:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37902.log 2024-05-16T22:34:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49883.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49883.log.gz 2024-05-16T22:34:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53179.log 2024-05-16T22:34:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37902.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37902.log.gz 2024-05-16T22:34:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44553.log 2024-05-16T22:34:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53179.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53179.log.gz 2024-05-16T22:34:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50051.log 2024-05-16T22:34:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44553.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44553.log.gz 2024-05-16T22:34:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48169.log 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50051.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50051.log.gz 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49632.log 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48169.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48169.log.gz 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46269.log 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49632.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49632.log.gz 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44888.log 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46269.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46269.log.gz 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49340.log 2024-05-16T22:34:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44888.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44888.log.gz 2024-05-16T22:34:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45256.log 2024-05-16T22:34:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49340.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49340.log.gz 2024-05-16T22:34:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47691.log 2024-05-16T22:34:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45256.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45256.log.gz 2024-05-16T22:34:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52717.log 2024-05-16T22:34:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47691.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47691.log.gz 2024-05-16T22:34:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32038.log 2024-05-16T22:34:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52717.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52717.log.gz 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52801.log 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.32038.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32038.log.gz 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52801.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52801.log.gz 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49799.log 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44218.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47268.log 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49799.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49799.log.gz 2024-05-16T22:34:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52843.log 2024-05-16T22:34:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47268.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47268.log.gz 2024-05-16T22:34:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53491.log 2024-05-16T22:34:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52843.log: 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-16T22:34:31.754 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52843.log.gz 2024-05-16T22:34:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44217.log 2024-05-16T22:34:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45214.log 2024-05-16T22:34:31.754 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53491.log.gz 2024-05-16T22:34:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43768.log 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44217.log.gz 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43726.log 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45214.log.gz/var/log/ceph/ceph-client.admin.43768.log: 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48372.log 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43768.log.gz/var/log/ceph/ceph-client.admin.43726.log: 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43726.log.gz 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47334.log 2024-05-16T22:34:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48372.log: /var/log/ceph/ceph-client.admin.47016.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48372.log.gz 2024-05-16T22:34:31.756 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz 2024-05-16T22:34:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-05-16T22:34:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50214.log 2024-05-16T22:34:31.756 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47334.log.gz 2024-05-16T22:34:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48768.log 2024-05-16T22:34:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50214.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-05-16T22:34:31.756 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50214.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48414.log 2024-05-16T22:34:31.756 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50009.log 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48768.log: /var/log/ceph/ceph-client.admin.48414.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48768.log.gz 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48414.log.gzgzip 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47962.log 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44555.log 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47962.log: /var/log/ceph/ceph-client.admin.50009.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50009.log.gz 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47962.log.gz 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50256.log 2024-05-16T22:34:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49524.log 2024-05-16T22:34:31.758 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44555.log.gz 2024-05-16T22:34:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38166.log 2024-05-16T22:34:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49524.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50256.log.gz 2024-05-16T22:34:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45532.log 2024-05-16T22:34:31.758 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49524.log.gz/var/log/ceph/ceph-client.admin.38166.log: 2024-05-16T22:34:31.758 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38166.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49273.log 2024-05-16T22:34:31.758 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-05-16T22:34:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43386.log 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45532.log.gz 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49482.log 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43386.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43386.log.gz 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49273.log.gz 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53431.log 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43954.log 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49482.log.gz 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53431.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2024-05-16T22:34:31.759 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53431.log.gz 2024-05-16T22:34:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46731.log 2024-05-16T22:34:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43954.log: /var/log/ceph/ceph-client.admin.46392.log: 87.5% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2024-05-16T22:34:31.760 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2024-05-16T22:34:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46019.log 2024-05-16T22:34:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47100.log 2024-05-16T22:34:31.760 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46731.log.gz 2024-05-16T22:34:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53531.log 2024-05-16T22:34:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47100.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46019.log.gz 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47100.log.gz 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47920.log 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.53531.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53531.log.gz 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48330.log 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48894.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47920.log.gz 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45130.log 2024-05-16T22:34:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45700.log 2024-05-16T22:34:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48330.log: /var/log/ceph/ceph-client.admin.45130.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48330.log.gz 2024-05-16T22:34:31.762 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45130.log.gz 2024-05-16T22:34:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53137.log 2024-05-16T22:34:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2024-05-16T22:34:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45700.log: /var/log/ceph/ceph-client.admin.53137.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45700.log.gz 2024-05-16T22:34:31.762 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53137.log.gz 2024-05-16T22:34:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44546.log 2024-05-16T22:34:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44892.log 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44546.log: /var/log/ceph/ceph-client.admin.44752.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44546.log.gz 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52633.log 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46826.log 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44892.log.gz 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47142.log 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7%/var/log/ceph/ceph-client.admin.46826.log: -- replaced with /var/log/ceph/ceph-client.admin.52633.log.gz 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46826.log.gz 2024-05-16T22:34:31.763 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45490.log 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49715.log 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47142.log.gz 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47058.log 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49715.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45490.log.gz 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43912.log 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49715.log.gz 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44220.log 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43912.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47058.log.gz 2024-05-16T22:34:31.764 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-05-16T22:34:31.765 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43912.log.gz 2024-05-16T22:34:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2024-05-16T22:34:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44220.log: /var/log/ceph/ceph-client.admin.43600.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44220.log.gz 2024-05-16T22:34:31.765 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-05-16T22:34:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50130.log 2024-05-16T22:34:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49213.log: -- /var/log/ceph/ceph-mds.a.log 2024-05-16T22:34:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50130.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50130.log.gz 2024-05-16T22:34:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46910.log 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46561.log 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46910.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46910.log.gz 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47733.log 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46561.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46561.log.gz 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52591.log 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47733.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47733.log.gz 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45658.log 2024-05-16T22:34:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52591.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52591.log.gz 2024-05-16T22:34:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-05-16T22:34:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45658.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45658.log.gz 2024-05-16T22:34:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45088.log 2024-05-16T22:34:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44209.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2024-05-16T22:34:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47439.log 2024-05-16T22:34:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45088.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45088.log.gz 2024-05-16T22:34:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44038.log 2024-05-16T22:34:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47439.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47439.log.gz 2024-05-16T22:34:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45340.log 2024-05-16T22:34:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44038.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44038.log.gz 2024-05-16T22:34:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52969.log 2024-05-16T22:34:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45340.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45340.log.gz 2024-05-16T22:34:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49436.log 2024-05-16T22:34:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52969.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52969.log.gz 2024-05-16T22:34:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52885.log 2024-05-16T22:34:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49436.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49436.log.gz 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43684.log 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52885.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52885.log.gz 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43684.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43684.log.gz 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44554.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48596.log 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43810.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz 2024-05-16T22:34:31.769 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-16T22:34:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45448.log 2024-05-16T22:34:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49128.log 2024-05-16T22:34:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48596.log: /var/log/ceph/ceph-client.admin.45448.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48596.log.gz 2024-05-16T22:34:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53011.log 2024-05-16T22:34:31.770 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45448.log.gz 2024-05-16T22:34:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47226.log 2024-05-16T22:34:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53011.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49128.log.gz 2024-05-16T22:34:31.770 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2024-05-16T22:34:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45767.log 2024-05-16T22:34:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47226.log: -- /var/log/ceph/ceph-client.admin.43852.log 2024-05-16T22:34:31.771 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47226.log.gz 2024-05-16T22:34:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45767.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45767.log.gz 2024-05-16T22:34:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43852.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gz 2024-05-16T22:34:32.116 INFO:teuthology.orchestra.run.smithi157.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-16T22:34:32.467 INFO:teuthology.orchestra.run.smithi157.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-16T22:34:32.480 INFO:teuthology.orchestra.run.smithi157.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-16T22:34:33.245 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-16T22:34:33.251 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-16T22:34:33.373 INFO:teuthology.orchestra.run.smithi157.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-16T22:34:33.455 INFO:teuthology.orchestra.run.smithi157.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-16T22:34:33.553 INFO:teuthology.orchestra.run.smithi157.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-16T22:34:33.561 INFO:teuthology.orchestra.run.smithi157.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-16T22:34:33.563 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-05-16T22:34:33.564 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m1.961s 2024-05-16T22:34:33.564 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m9.417s 2024-05-16T22:34:33.564 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.350s 2024-05-16T22:34:33.707 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-16T22:34:33.864 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-16T22:34:33.934 INFO:teuthology.orchestra.run.smithi005.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-16T22:34:36.855 INFO:teuthology.orchestra.run.smithi005.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-16T22:34:36.856 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-05-16T22:34:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m5.253s 2024-05-16T22:34:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m14.740s 2024-05-16T22:34:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.558s 2024-05-16T22:34:36.857 INFO:tasks.ceph:Archiving logs... 2024-05-16T22:34:36.857 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi005/log 2024-05-16T22:34:36.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-16T22:34:38.732 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi157/log 2024-05-16T22:34:38.733 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-16T22:34:39.912 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi181/log 2024-05-16T22:34:39.913 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-16T22:34:40.004 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-16T22:34:40.014 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-16T22:34:40.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-16T22:34:40.017 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-16T22:34:40.020 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-16T22:34:40.177 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-16T22:34:40.185 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-16T22:34:40.186 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T22:34:40.188 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T22:34:40.191 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T22:34:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-05-16T22:34:40.205 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-05-16T22:34:40.208 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T22:34:40.208 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-05-16T22:34:40.208 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +224us[ +228us] +/- 69ms 2024-05-16T22:34:40.208 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 33 -1302us[-1302us] +/- 76ms 2024-05-16T22:34:40.208 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +1172us[+1176us] +/- 77ms 2024-05-16T22:34:40.209 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:34:40.210 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T22:34:40.210 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-05-16T22:34:40.210 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +248us[ +246us] +/- 69ms 2024-05-16T22:34:40.210 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 103 -1271us[-1274us] +/- 75ms 2024-05-16T22:34:40.211 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +1206us[+1206us] +/- 77ms 2024-05-16T22:34:40.211 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:34:40.245 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-05-16T22:34:40.255 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T22:34:40.255 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-05-16T22:34:40.255 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 8 377 97 +360us[ +286us] +/- 68ms 2024-05-16T22:34:40.255 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 97 -1211us[-1285us] +/- 75ms 2024-05-16T22:34:40.255 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +1251us[+1251us] +/- 77ms 2024-05-16T22:34:40.255 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:34:40.256 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-16T22:34:40.266 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-16T22:34:40.266 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-16T22:34:40.275 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-16T22:34:40.349 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-16T22:34:40.416 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-16T22:34:40.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T22:34:40.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:34:40.622 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T22:34:40.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:34:40.653 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T22:34:40.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:34:40.736 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-16T22:34:40.748 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-16T22:34:40.756 INFO:teuthology.task.internal:Duration was 4291.924408 seconds 2024-05-16T22:34:40.756 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-16T22:34:40.765 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-16T22:34:40.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-16T22:34:40.767 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-16T22:34:40.770 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-16T22:34:40.810 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T22:34:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T22:34:40.914 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T22:34:41.322 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-16T22:34:41.322 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-05-16T22:34:41.322 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-16T22:34:41.347 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-05-16T22:34:41.347 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-16T22:34:41.376 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-05-16T22:34:41.376 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-16T22:34:41.445 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-16T22:34:41.445 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-16T22:34:41.448 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-16T22:34:41.451 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-16T22:34:41.522 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-16T22:34:41.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-16T22:34:41.525 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-16T22:34:41.527 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-16T22:34:41.720 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-16T22:34:41.730 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-16T22:34:41.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-16T22:34:41.755 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-16T22:34:41.779 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-16T22:34:41.865 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-16T22:34:41.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-16T22:34:41.878 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-16T22:34:41.881 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-16T22:34:41.899 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-05-16T22:34:41.901 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-05-16T22:34:41.975 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-05-16T22:34:42.014 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-16T22:34:42.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:34:42.028 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-16T22:34:42.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:34:42.043 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-16T22:34:42.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:34:42.095 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-16T22:34:42.105 INFO:teuthology.task.internal:Transferring archived files... 2024-05-16T22:34:42.106 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi005 2024-05-16T22:34:42.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-16T22:34:42.140 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi157 2024-05-16T22:34:42.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-16T22:34:42.172 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812/remote/smithi181 2024-05-16T22:34:42.172 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-16T22:34:42.265 INFO:teuthology.task.internal:Removing archive directory... 2024-05-16T22:34:42.266 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-16T22:34:42.268 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-16T22:34:42.271 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-16T22:34:42.323 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-16T22:34:42.334 INFO:teuthology.task.internal:Not uploading archives. 2024-05-16T22:34:42.334 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-16T22:34:42.344 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-16T22:34:42.344 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-16T22:34:42.346 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-16T22:34:42.349 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-16T22:34:42.359 INFO:teuthology.orchestra.run.smithi005.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 16 22:34 /home/ubuntu/cephtest 2024-05-16T22:34:42.361 INFO:teuthology.orchestra.run.smithi157.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 16 22:34 /home/ubuntu/cephtest 2024-05-16T22:34:42.400 INFO:teuthology.orchestra.run.smithi181.stdout: 393949 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 16 22:34 /home/ubuntu/cephtest 2024-05-16T22:34:42.403 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-16T22:34:42.413 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-16T22:34:42.473 INFO:teuthology.nuke:Checking targets against current locks 2024-05-16T22:34:42.500 DEBUG:teuthology.nuke:shortname: smithi005 2024-05-16T22:34:42.501 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-16T22:34:42.529 DEBUG:teuthology.nuke:shortname: smithi157 2024-05-16T22:34:42.529 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-16T22:34:42.534 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 21:13:44.549082', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAzAgzbPaeNVMRIcb7wBi8SfBlFbsrTCtgwCxEuX4eQnW+DRCqLaVkpyE5L44DDfqejjm+XuI1Y/SVjN0eNSX4='} 2024-05-16T22:34:42.550 DEBUG:teuthology.nuke:shortname: smithi181 2024-05-16T22:34:42.551 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-16T22:34:42.558 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 21:13:44.547856', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATVzC2gC1NYDFMZ1vJ/JrCiYdhhhaPfkFyv2BdJXbVt/IPBN4D0zmeSWCJnvyyVDs6CK6MyGcyUxbblceVikng='} 2024-05-16T22:34:42.570 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_21:11:55-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709812', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 21:13:44.546032', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJg5hwUyMtNK7XwqIYM+IC1H4vOmVX/BzJ0gFjqPlOk43bhByzy/7W9fsLpmCZRVkVgv3DX3sfDphpOBc7sVgeM='} 2024-05-16T22:34:42.583 INFO:teuthology.orchestra.console.smithi005:Power off 2024-05-16T22:34:42.583 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-16T22:34:42.612 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-05-16T22:34:42.612 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:42.625 INFO:teuthology.orchestra.console.smithi181:Power off 2024-05-16T22:34:42.625 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-16T22:34:42.635 INFO:teuthology.orchestra.console.smithi157:Power off 2024-05-16T22:34:42.636 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-16T22:34:42.647 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-05-16T22:34:42.647 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:42.655 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-05-16T22:34:42.659 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-05-16T22:34:42.659 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:42.671 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-05-16T22:34:42.682 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-05-16T22:34:46.656 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:46.672 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:46.682 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:46.770 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-05-16T22:34:46.782 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-05-16T22:34:46.791 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-05-16T22:34:50.770 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:50.783 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:50.792 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T22:34:50.881 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-05-16T22:34:50.891 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-05-16T22:34:50.900 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-05-16T22:34:50.983 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-05-16T22:34:50.992 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-05-16T22:34:51.001 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-05-16T22:34:51.106 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 42e114f04cb046558abf08b436bd2a0497043042 description: fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} duration: 4291.924408197403 failure_reason: 'Test failure: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=11e7594b5c844b05bf26c186e650a3bc status: fail success: false 2024-05-16T22:34:51.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-16T22:34:51.186 INFO:teuthology.run:FAIL